RepoStreet
BerriAI

berriai/litellm

hot

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Stars
51,118
Forks
9,062
Open issues
1,345
24h
+127
+0.3%
7d
+988
+2.1%
Refresh
30m

Star history (7 days)

Last checked
15m ago
Last pushed
48m ago
Next check
just now