OSS Radar
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load… Why it matters: useful plumbing for shipping LLM-powered features.
GitHub description: The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Stars
61k
Last 24h
+52est.
Last 7 days
+364est.
Forks
12k
Star history (last 1 snapshot)
Only one snapshot so far. The chart fills in as OSS Radar collects daily snapshots.
* / est. Estimated: until we have enough daily snapshots for a repo, its gain is total stars ÷ days since creation. Measured numbers replace estimates automatically.
Maintainer? Add the badge to your README
Shows your live OSS Radar rank and links back here. Updates hourly.
[](https://ossradar.net/repo/BerriAI/litellm)<a href="https://ossradar.net/repo/BerriAI/litellm"><img src="https://ossradar.net/badge/BerriAI/litellm" alt="Trending on OSS Radar"></a>About litellm
BerriAI/litellm is a Python project in the LLM tooling category, created 3 years ago. It has 61k GitHub stars and 12k forks, and gained +364 stars over the last 7 days (early estimate), ranking #104 of 166 LLM tooling repos tracked by OSS Radar this week.
See more trending LLM tooling repos or the top AI repos this week.
- Language
- Python
- Category
- LLM tooling
- Created
- Jul 27, 2023
- Last push
- Oct 13, 2026
- ai-gateway
- anthropic
- azure-openai
- bedrock
- gateway
- langchain
- litellm
- llm
- llm-gateway
- llmops
- mcp-gateway
- openai
- openai-proxy
- rust
- rust-ai
- vertex-ai
Similar rising repos
- decolua/9router+764est.
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback… Why it matters: useful plumbing for shipping LLM-powered features.
- diegosouzapw/OmniRoute+2.2kest.
Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax… Why it matters: useful plumbing for shipping LLM-powered features.
- headroomlabs-ai/headroom+1.9kest.
Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same… Why it matters: useful plumbing for shipping LLM-powered features.
- langchain-ai/langchain+710est.
The agent engineering platform. Why it matters: useful plumbing for shipping LLM-powered features.
- lidge-jun/opencodex+1kest.
Universal provider proxy for OpenAI Codex & Claude Code — use any LLM (Claude, Gemini, Grok, DeepSeek, Ollama…) with Codex CLI, App, SDK, and Claude… Why it matters: useful plumbing for shipping LLM-powered features.
- can1357/oh-my-pi+864est.
⌥ Coding agent with the IDE wired in. Built by Stencil Labs. Why it matters: useful plumbing for shipping LLM-powered features.