Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
pretraining
/
pico-tokenizer-32k
like
0
Follow
Krill 🦐
1
Transformers
arxiv:
1910.09700
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
pico-tokenizer-32k
/
README.md
Commit History
Upload tokenizer
45e484f
verified
minpeter
commited on
Aug 7, 2025
minpeter commited on 
