Tiiny-AI

tiiny-ai/powerinfer

steady

High-speed Large Language Model Serving for Local Deployment

C++ View on GitHub

Stars

9,614

Forks

587

Open issues

123

24h

+2

+0.0%

7d

+28

+0.3%

Refresh

2h

Star history (7 days)

Last checked

4m ago

Last pushed

11 May 2026

Next check

just now