Hugging Face's logo

flexitok
/
mod-tokenizers-zero-padded-ltr_4digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-zero-padded-ltr_4digit / mod_tokenizers_zero_padded

Commit History

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_4digit_overlap.json with huggingface_hub
a8ae434
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub
b044774
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_4digit.yaml with huggingface_hub
7873366
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_4digit_info.json with huggingface_hub
8762a64
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_4digit_vocab.json with huggingface_hub
d9a5ef0
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-ltr_4digit_super_mapping.json with huggingface_hub
d91ed0d
verified

gsaltintas commited on