berriai/litellm

hot

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Python View on GitHub

Stars

51,122

Forks

9,064

Open issues

1,346

24h

+127

+0.3%

+988

+2.1%

Refresh

Star history (7 days)

Last checked

9m ago

Last pushed

19m ago

Next check

just now