Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
flexitok
/
bpe_boundless_coverage_AllL_128000
like
0
Follow
Moto
3
19 languages
tokenizer
bpe
flexitok
fineweb2
License:
mit
Model card
Files
Files and versions
xet
Community
main
bpe_boundless_coverage_AllL_128000
/
tokenizer.json
Commit History
Upload folder using huggingface_hub
6f3f076
verified
gsaltintas
commited on
13 days ago
Upload folder using huggingface_hub
1d29481
verified
gsaltintas
commited on
13 days ago
Upload folder using huggingface_hub
8411e91
verified
gsaltintas
commited on
13 days ago
Upload folder using huggingface_hub
38b97e8
verified
gsaltintas
commited on
23 days ago
Upload folder using huggingface_hub
5c2c02c
verified
gsaltintas
commited on
23 days ago
Upload folder using huggingface_hub
da185aa
verified
gsaltintas
commited on
23 days ago