Hugging Face's logo

flexitok
/
bpe_spa_Latn_8000

Spanish
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
bpe_spa_Latn_8000

Commit History

Upload fineweb2_hq/flexitok--bpe_spa_Latn_8000_overlap.json with huggingface_hub
e344d61
verified

gsaltintas commited on

Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub
67e8663
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_spa_Latn_8000.yaml with huggingface_hub
a2c69e2
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_spa_Latn_8000_info.json with huggingface_hub
843edf2
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_spa_Latn_8000_vocab.json with huggingface_hub
76abaf3
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_spa_Latn_8000_super_mapping.json with huggingface_hub
f1df15f
verified

gsaltintas commited on

Upload folder using huggingface_hub
9c78d4e
verified

gsaltintas commited on

Upload folder using huggingface_hub
81c5800
verified

gsaltintas commited on

initial commit
cd9c43c
verified

gsaltintas commited on