Hugging Face's logo

flexitok
/
mod-tokenizers-ltr_2digit

Undetermined
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-ltr_2digit

Commit History

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit_overlap.json with huggingface_hub
3db6ed9
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
0f39c2b
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit.yaml with huggingface_hub
4d9a6e1
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit_info.json with huggingface_hub
06ad6a4
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit_vocab.json with huggingface_hub
0c505e9
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit_super_mapping.json with huggingface_hub
2be1a05
verified

gsaltintas commited on

Upload folder using huggingface_hub
6c6f734
verified

gsaltintas commited on

Upload folder using huggingface_hub
78f6415
verified

gsaltintas commited on

Upload folder using huggingface_hub
3c5c2c5
verified

gsaltintas commited on

Upload folder using huggingface_hub
57756ab
verified

gsaltintas commited on

Upload folder using huggingface_hub
c234344
verified

gsaltintas commited on

Upload folder using huggingface_hub
65cb90b
verified

gsaltintas commited on

Upload folder using huggingface_hub
9634ef0
verified

gsaltintas commited on

initial commit
46ce3d9
verified

gsaltintas commited on