bentoml

bentoml/openllm

steady

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python View on GitHub

Stars

12,548

Forks

846

Open issues

6

24h

+2

+0.0%

7d

+4

+0.0%

Refresh

2h

Star history (7 days)

Last checked

1h ago

Last pushed

1d ago

Next check

just now