About
LiteLLM is an open-source Python SDK and proxy server that gives you a single OpenAI-compatible API for 100+ LLM providers, including OpenAI, Anthropic, Gemini, Bedrock, and Azure. The proxy adds virtual API keys, per-team spend tracking and budgets, guardrails, retries, and load balancing across models. It is best for teams that switch between models or providers and want cost control and reliability without rewriting integration code for each vendor.
# Python SDK
uv add litellm
# Proxy server (self-hosted gateway)
uv tool install 'litellm[proxy]'
litellm --model gpt-4o
# Proxy now serves an OpenAI-compatible API at http://0.0.0.0:4000Copy individual commands
- Python SDK:
uv add litellm - Proxy server (self-hosted gateway):
uv tool install 'litellm[proxy]' litellm --model gpt-4o
Set the provider keys you use as environment variables (e.g. OPENAI_API_KEY, ANTHROPIC_API_KEY). pip install litellm works as the classic alternative to the uv commands.
More in AI Tools
View all
PocketBase
An open-source realtime backend in a single file — SQLite, auth, file storage, realtime, admin dashboard.
NocoDB
A free, self-hostable Airtable alternative — turn any database into a smart spreadsheet with APIs and automations.
Gitea
A painless self-hosted Git service in a single Go binary — repos, PRs, issues, wiki, registry and CI/CD.