The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
⭐55.6k105/day
Tracked by Kanon since Aug 5, 2026 · then ⭐55.6k · now ⭐55.6k
Signal source: GitHub
Visit official site →
On mobile tap Share for WeChat / RED (Xiaohongshu) / X; on desktop use Copy text and paste into the app.
FAQ
What is BerriAI/litellm?
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
How popular is BerriAI/litellm?
As tracked by KanonAgent: ⭐55.6k · 105/day (first indexed 2026-08-05).
What are the best BerriAI/litellm alternatives?
Similar AI agents tracked by KanonAgent: Comfy-Org/ComfyUI, bojieli/ai-agent-book, roboflow/supervision, usestrix/strix, Graphify-Labs/graphify, browser-use/video-use.