2023-05-14
marvin's @ai_model decorator implements something similar to what I had in mind for extracting structured data from an input to a language model.
2 entries
marvin's @ai_model decorator implements something similar to what I had in mind for extracting structured data from an input to a language model.
Restricting the next predicted token to adhere to a specific context free grammar seems like a big step forward in weaving language models into applications.