BerriAI/litellm

★ 41,221 stars

Python

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

View on GitHub

19 May 2026 · 0:33

Build Your OWN AI Gateway — One API for 100+ LLMs, Free and Open Source #Shorts