Hugging Face's logo

flexitok
/
mod-tokenizers-zero-padded-rtl_3digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-zero-padded-rtl_3digit

Commit History

Update metadata with huggingface_hub
cb10303
verified

gsaltintas commited on

Upload config
67eb9a9
verified

gsaltintas commited on

Upload model files
5a3222e
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_3digit_overlap.json with huggingface_hub
3496543
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub
dc5c3f6
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_3digit.yaml with huggingface_hub
75f6256
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_3digit_info.json with huggingface_hub
755c339
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_3digit_vocab.json with huggingface_hub
22cad21
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_3digit_super_mapping.json with huggingface_hub
f76d507
verified

gsaltintas commited on

Upload folder using huggingface_hub
430811f
verified

gsaltintas commited on

initial commit
ee9ed8c
verified

gsaltintas commited on