Hugging Face's logo

flexitok
/
mod-tokenizers-zero-padded-rtl_5digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-zero-padded-rtl_5digit

Commit History

Upload config
05aeeac
verified

gsaltintas commited on

Upload model files
2b47919
verified

gsaltintas commited on

Update metadata with huggingface_hub
ac42d45
verified

gsaltintas commited on

Upload config
a20504c
verified

gsaltintas commited on

Upload model files
c42d2ea
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_5digit_overlap.json with huggingface_hub
9c00f52
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub
af2d842
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_5digit.yaml with huggingface_hub
6ded697
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_5digit_info.json with huggingface_hub
53d22e3
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_5digit_vocab.json with huggingface_hub
3a235ed
verified

gsaltintas commited on

Upload mod_tokenizers_zero_padded/flexitok--mod-tokenizers-zero-padded-rtl_5digit_super_mapping.json with huggingface_hub
a7f4078
verified

gsaltintas commited on

Upload folder using huggingface_hub
8de58d8
verified

gsaltintas commited on

initial commit
590fb96
verified

gsaltintas commited on