Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
pretraining
/
pico-tokenizer-32k
like
0
Follow
Krill 🦐
1
Transformers
arxiv:
1910.09700
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
pico-tokenizer-32k
Commit History
Upload tokenizer
e788be0
verified
minpeter
commited on
Aug 9, 2025
Upload tokenizer
e67cb7f
verified
minpeter
commited on
Aug 9, 2025
Upload tokenizer
45e484f
verified
minpeter
commited on
Aug 7, 2025
initial commit
3d1e8a4
verified
minpeter
commited on
Aug 7, 2025
minpeter commited on
minpeter commited on
minpeter commited on
minpeter commited on
