Hugging Face's logo

flexitok
/
mod-tokenizers-rtl_3digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-rtl_3digit / mod_tokenizers

Commit History

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_overlap.json with huggingface_hub
6c75aed
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
2c8515c
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit.yaml with huggingface_hub
70351e3
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_info.json with huggingface_hub
87d2260
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_vocab.json with huggingface_hub
70e810f
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_super_mapping.json with huggingface_hub
bc21eb3
verified

gsaltintas commited on