huggingface/tokenizers
steady💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Rust
View on GitHub
Stars
11,142
Forks
1,210
Open issues
114
24h
+2
+0.0%
7d
+14
+0.1%
Refresh
1h
Star history (7 days)
Last checked
1h ago
Last pushed
1d ago
Next check
just now