huggingface/tokenizers
steady💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
Rust
View on GitHub
Stars
10,878
Forks
1,142
Open issues
114
24h
0
0.0%
7d
+15
+0.1%
Refresh
1h
Star history (7 days)
Last checked
32m ago
Last pushed
17h ago
Next check
just now