Hugging Face's logo

flexitok
/
mod-tokenizers-rtl_5digit

Undetermined
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-rtl_5digit

Commit History

Upload folder using huggingface_hub
8fffdb5
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_5digit_overlap.json with huggingface_hub
fbdd891
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
76b2898
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_5digit.yaml with huggingface_hub
f9cbd6f
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_5digit_info.json with huggingface_hub
03a0af2
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_5digit_vocab.json with huggingface_hub
82359f4
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_5digit_super_mapping.json with huggingface_hub
df65c74
verified

gsaltintas commited on

Upload folder using huggingface_hub
f209ee9
verified

gsaltintas commited on

Upload folder using huggingface_hub
e7fd830
verified

gsaltintas commited on

Upload folder using huggingface_hub
f56c1cc
verified

gsaltintas commited on

Upload folder using huggingface_hub
f4624b7
verified

gsaltintas commited on

Upload folder using huggingface_hub
fc4ea5d
verified

gsaltintas commited on

Upload folder using huggingface_hub
d245a19
verified

gsaltintas commited on

Upload folder using huggingface_hub
45c5da3
verified

gsaltintas commited on

initial commit
b559964
verified

gsaltintas commited on