llm

3 entries

Using `llm` to handle large input context

Today, I ran into an issue where I wanted to use repomix to pack a large codebase into a single file to pass to an LLM, but I couldn't paste the output into any of the UIs I typically use. The React apps all became sluggish as I waited for ~500,000 tokens to paste.

llm repomix

`llm` upgrade pip

The llm package uses a plugin architecture to support numerous different language model API providers and frameworks. Per the documentation, these plugins are installed using a version of pip, the popular Python package manager Use the llm install command (a thin wrapper around pip install) to...

llm pip