What is LiteLLM?
Self-hosted proxy that puts 100+ LLM providers behind one OpenAI-style API, with keys and budgets.
Who is LiteLLM best for?
LiteLLM is best for platform teams that give their company one gateway to many LLM providers with spend limits.
Platform teams serving many apps
One OpenAI-compatible API reaches 140+ providers and 1,800+ models, so swapping models needs no code change.
Keeping AI spend in check
Virtual keys carry budgets per team or project, so usage can be capped before the bill arrives.
Python apps calling several models
The LiteLLM Python SDK calls 100+ LLMs in the OpenAI format without running a proxy.
Agents and MCP servers
Agents and MCP servers sit behind the same gateway and login as the models.
How much does LiteLLM cost?
LiteLLM's AI gateway is free under MIT when you host it yourself, and LiteLLM Enterprise is priced through sales after a free 30-day trial.
- MIT licence outside the enterprise folder
- Virtual keys, budgets, routing and logging
- SSO free for up to 5 users
LiteLLM Enterprise adds SSO and SCIM beyond 5 users, audit logs, admin roles, air-gapped deployment and 24/7 support with SLAs. It still runs in your own infrastructure and is priced by usage and deployment size through sales, with a free 30-day trial key. Full pricing on litellm.ai. We checked these prices on .
How do readers rate LiteLLM?
No one has rated LiteLLM yet. Be the first.
Sign in to rate. One rating per account.
Is LiteLLM open source?
Yes. LiteLLM's code is public under the MIT licence, so you can run it on your own server.
On GitHub
63,193stars
+2,177 (+3.6%) in the last 30 days
- Last commit
- 13 Nov
- Repository age
- 3 years
- Latest release
- 12 Nov
- Licence
- MIT
- Self-hosted
- Yes
- Repository
- BerriAI/litellm
What are the best LiteLLM alternatives?
LiteLLM is an open source alternative to Ramp Router and Eden AI. Portkey and APIPark do the same job and are open source too.
Questions about LiteLLM
What is LiteLLM?
Self-hosted proxy that puts 100+ LLM providers behind one OpenAI-style API, with keys and budgets.
Who is LiteLLM for?
LiteLLM is best for platform teams that give their company one gateway to many LLM providers with spend limits.
Is LiteLLM free?
Yes. LiteLLM's Python SDK and AI gateway are free and open source under the MIT licence, and you run them on your own infrastructure. LiteLLM Enterprise adds SSO beyond 5 users, audit logs and support, priced through sales after a free 30-day trial.
Is LiteLLM open source?
Yes. LiteLLM's code is public under the MIT licence, so you can run it on your own server.
What are the best LiteLLM alternatives?
The closest alternatives on Recaply are Ramp Router, Eden AI, Portkey and APIPark.
Where can I try LiteLLM?
On its official website, litellm.ai.
treg
LLMFly AI
Busabase
Jean
Agno
Milvus