TIL

Debugging DSPy token usage and prompts

As I've experimented more with DSPy, I've attempted to dig further into the details of the specific LLM I am using to better understand things like token usage, reasoning, and the specific prompts being sent to the model. While, DSPy's abstraction is one of the more lightweight for LLM frameworks,...

TIL

Intro to DSPy

The viral "how many r's are there in the word 'strawberry'?" problem is a great motivating example to experiment with the capabilities of DSPy, an increasingly popular, powerful library for running inference with language models. While the counting letters problem itself is a poor application of a...