About a year and a half ago I wrote about using sqlite-vss to store and query embedding vectors in a SQLite database. Much has changed since then and I'm working on a project that motivated another pass at querying embeddings on a local system for smallish datasets. The sqlite-vector project seemed...
As I've experimented more with DSPy, I've attempted to dig further into the details of the specific LLM I am using to better understand things like token usage, reasoning, and the specific prompts being sent to the model. While, DSPy's abstraction is one of the more lightweight for LLM frameworks,...
The viral "how many r's are there in the word 'strawberry'?" problem is a great motivating example to experiment with the capabilities of DSPy, an increasingly popular, powerful library for running inference with language models. While the counting letters problem itself is a poor application of a...
Claude Code supports custom slash commands. Custom slash commands allow you to define frequently-used prompts as Markdown files that Claude Code can execute. Commands are organized by scope (project-specific or personal) and support namespacing through directory structures.
The .env file and the python-dotenv package are popular conventions in Python for managing environment variables. I often forget or pause when trying to remember exactly which package I need to install (python-dotenv) and how to do the import
When Datadog's magic breaks your API calls
Why I like the Chat Completions API
Model Context Protocol servers have become a popular way to expose software services for LLMs. Prior to this post, I'd not spent nearly enough time with them to have a strong opinion of their pros and cons, so I set out to change that.
It started because I was using the OpenAI completion API to try several different models while building Tomo.
I was working with Amazon Bedrock to run LLM inference. AWS has its fair share of complexity -- VPCs, subnets, security groups, etc.
Lots of language model providers implement the OpenAI API spec. These look similar in shape but often behave differently in subtle ways. Anthropic's prefill sequences are one such example.