Hugging Face's logo

flexitok
/
mod-tokenizers-ltr_4digit

Undetermined
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-ltr_4digit / mod_tokenizers

Commit History

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_4digit_overlap.json with huggingface_hub
80d6554
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
55b5cf4
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_4digit.yaml with huggingface_hub
207129a
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_4digit_info.json with huggingface_hub
255632e
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_4digit_vocab.json with huggingface_hub
0732510
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_4digit_super_mapping.json with huggingface_hub
6e4a885
verified

gsaltintas commited on