berriai/litellm

hot

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Python View on GitHub

Stars

51,118

Forks

9,062

Open issues

1,345

24h

+127

+0.3%

+988

+2.1%

Refresh

30m

Star history (7 days)

Last checked

15m ago

Last pushed

48m ago

Next check

just now