Thought Eddies

Posts

Document Citations

Using Claude Citations to annotate the sources for document Q&A

The following is an implementation of document Q&A with citations using Anthropic's press release for Claude Citations, a feature meant to reduce LLM hallucinations and provide clarity for which part of the source text the model is using to produce answers to questions. The content below the next...

TIL

`llm` upgrade pip

The llm package uses a plugin architecture to support numerous different language model API providers and frameworks. Per the documentation, these plugins are installed using a version of pip, the popular Python package manager Use the llm install command (a thin wrapper around pip install) to...

Posts

LLM Conversation Branching

Visualizing and navigating branched conversations with LLMs and embeddings

I wrote about Conversation Branching on my main blog and I've been prototyping an LLM chat app called Delta that has first-class conversation branching. LLM conversations typically follow a linear path, making it unintuitive to explore alternative directions or recover from miscommunications. This...