litellm

Documentation

Overview

Package litellm registers a "litellm" provider that wraps the openai provider with a custom base URL and API key. LiteLLM exposes an OpenAI-compatible /v1/chat/completions endpoint, so the openai client works unchanged once the URL and key are pointed at it.