google-ai-edge

google-ai-edge/litert-lm

steady

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

C++ View on GitHub

Stars

6,527

Forks

731

Open issues

213

24h

+5

+0.1%

7d

+51

+0.8%

Refresh

1h

Star history (7 days)

Last checked

29m ago

Last pushed

19h ago

Next check

just now