Hugging Face's logo

flexitok
/
bpe_script_Roma_32000

tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_Roma_32000 / script_1

Commit History

Upload script_1/flexitok--bpe_script_Roma_32000_overlap.json with huggingface_hub
504fd4c
verified

gsaltintas commited on

Upload script_1/participating_tokenizers.json with huggingface_hub
d488d70
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Roma_32000.yaml with huggingface_hub
fb734f2
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Roma_32000_info.json with huggingface_hub
499f7c3
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Roma_32000_vocab.json with huggingface_hub
c9cc36a
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Roma_32000_super_mapping.json with huggingface_hub
472d9d8
verified

gsaltintas commited on