karpathy

karpathy/minbpe

steady

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Python View on GitHub

Stars

10,754

Forks

1,107

Open issues

34

24h

0

0.0%

7d

+8

+0.1%

Refresh

2h

Star history (7 days)

Last checked

2m ago

Last pushed

01 Jul 2024

Next check

just now