google-ai-edge/litert-lm
steadyLiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
C++
View on GitHub
Stars
5,688
Forks
592
Open issues
185
24h
+22
+0.4%
7d
0
0.0%
Refresh
1h
Star history (7 days)
Last checked
just now
Last pushed
1h ago
Next check
just now