Delta (2024)
Delta is an open source Electron app (initially started as a Next.js app) that enables a straightforward UX for conversation branching with language models. Conversation branch means rewinding a conversation to a previous response then continuing in another direction by sending a different message to the model. While this UX is supported by most LLM chat providers via an edit mechanism, what is different about Delta is that it provides a visual representation of conversation branches and makes it easy to navigate between them.
The interface is composed primarily of a chat and canvas. There is also a tracked list of past conversations.
The tool supports multiple model providers, image inputs (for models that support them) and models served by an ollama server.
I also wrote more about conversation branching and why I think this approach is useful here.
Tech: Electron, Electron Forge, Vercel AI SDK, Ollama
Recommended
Calling Deepseek with `llm` using OpenAI Compatible APIs
Deepseek V3 was recently released: a cheap, reliable, supposedly GPT-4 class model.
Conversation Branching
Language models are more than chatbots - they're tools for thought. The real value lies in using them as intellectual sounding boards to brainstorm,...
Running Huggingface Models with Llama.cpp and ollama
One challenge I've continued to have is figuring out how to use the models on Huggingface. There are usually Python snippets to "run" models that...