bentoml

bentoml/openllm

steady

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Python View on GitHub

Stars

12,380

Forks

818

Open issues

6

24h

+2

+0.0%

7d

+16

+0.1%

Refresh

2h

Star history (7 days)

Last checked

21m ago

Last pushed

3d ago

Next check

just now