openai-compatible-api

OpenAI Compatible API Implementation Variance

Lots of language model providers implement the OpenAI API spec. These look similar in shape but often behave differently in subtle ways. Anthropic's prefill sequences are one such example.