openai/tiktoken
Python
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
Stars
18,642
24h
+2
+0.0%
7d
+75
+0.4%
Checked 1h ago
Pushed 24 May 2026