# BerriAI/litellm

> Self-hosted AI gateway and Python SDK for 100+ LLM providers

Navigation: [Artificial Intelligence](category/artificial-intelligence.txt) · [Index](../llms.txt)

## Facts

- GitHub: https://github.com/BerriAI/litellm
- HTML: https://awesomeopensource.dev/project/berriai-litellm
- Website: https://docs.litellm.ai/docs/
- License: Other
- Language: Python
- stars: 63220
- Topics: ai-gateway, anthropic, azure-openai, bedrock, gateway, langchain, litellm, llm, llm-gateway, llmops, mcp-gateway, openai, openai-proxy, rust, rust-ai, vertex-ai
- Activity score: 5.0/5 (Thriving)
- Last commit (any branch): 2026-11-13
- Last release: v1.108.8 2026-11-13

## Description

LiteLLM is an AI gateway that exposes 100+ model providers through a single OpenAI-compatible API. It runs as a Python SDK or as a proxy server with virtual keys, spend tracking, budgets, rate limits, guardrails, load balancing, and an admin dashboard. Requests can be routed, retried, and failed over between OpenAI, Anthropic, Gemini, Bedrock, Azure, and other providers, and the Python-based project ships Docker deployment options for a self-hosted gateway.

## Maintenance activity

- Recency: 100% (weight 40%) — last commit: 0 days ago
- Commit volume: 100% (weight 25%)
- Releases: 100% (weight 25%) — last release: 0 days ago
- Bug fixes: 100% (weight 10%)
- Commits: 12917 / 90d, 29146 / 365d

## Screenshots

- [Screenshot of the LiteLLM dashboard showing audit logs with filters and user actions](https://awesomeopensource.dev/uploads/550/f4e5d210b2258108.png)
- [Screenshot of the LiteLLM admin panel showing teams and their assigned budgets](https://awesomeopensource.dev/uploads/550/6e66ca288ba825bb.png)

## Similar projects

- [openclaw/openclaw](openclaw-openclaw.md): Open-source AI assistant that lives on your own hardware and in your chat apps · Activity score 5.0/5 (Thriving)
- [n8n-io/n8n](n8n-io-n8n.md): Fair-code workflow automation with a visual canvas, custom code and 1500+ integrations · Activity score 5.0/5 (Thriving)
- [langgenius/dify](langgenius-dify.md): Visual platform for building LLM apps with RAG pipelines, agents and model integrations · Activity score 5.0/5 (Thriving)
- [open-webui/open-webui](open-webui-open-webui.md): Self-hosted web UI for chatting with Ollama and OpenAI-compatible models offline · Activity score 5.0/5 (Thriving)
- [langchain-ai/langchain](langchain-ai-langchain.md): Python framework for building agents and LLM applications from composable components · Activity score 5.0/5 (Thriving)
- [paperclipai/paperclip](paperclipai-paperclip.md): Manage a team of AI agents with goals, budgets and task tracking · Activity score 5.0/5 (Thriving)
