Hugging Face's logo

flexitok
/
mod-tokenizers-rtl_2digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-rtl_2digit

Commit History

Delete flexitok--mod-tokenizers-rtl_2digit.yaml
34c4766
verified

gsaltintas commited on

Delete flexitok--mod-tokenizers-rtl_2digit_overlap.json
b7167c3
verified

gsaltintas commited on

Delete flexitok--mod-tokenizers-rtl_2digit_super_mapping.json
6bf3267
verified

gsaltintas commited on

Delete participating_tokenizers.json
c4a381e
verified

gsaltintas commited on

Upload folder using huggingface_hub
09f849f
verified

gsaltintas commited on

Update metadata with huggingface_hub
b00d214
verified

gsaltintas commited on

Upload config
7b0453f
verified

gsaltintas commited on

Upload model files
20e927c
verified

gsaltintas commited on

Upload tokenizer file flexitok--mod-tokenizers-rtl_2digit.yaml - Upload model files
eaf0fbc
verified

gsaltintas commited on

Upload tokenizer file participating_tokenizers.json - Upload model files
1d7272f
verified

gsaltintas commited on

Upload tokenizer file flexitok--mod-tokenizers-rtl_2digit_vocab.json - Upload model files
9b03fc8
verified

gsaltintas commited on

Upload tokenizer file flexitok--mod-tokenizers-rtl_2digit_super_mapping.json - Upload model files
d53ed56
verified

gsaltintas commited on

Upload tokenizer file flexitok--mod-tokenizers-rtl_2digit_overlap.json - Upload model files
f7eb240
verified

gsaltintas commited on

Upload tokenizer file flexitok--mod-tokenizers-rtl_2digit_info.json - Upload model files
628d176
verified

gsaltintas commited on

Upload tokenizer file vocab.json - Upload model files
521ee44
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_2digit_overlap.json with huggingface_hub
078eba3
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
b579c82
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_2digit.yaml with huggingface_hub
e1b180b
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_2digit_info.json with huggingface_hub
82249dc
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_2digit_vocab.json with huggingface_hub
d12cce7
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_2digit_super_mapping.json with huggingface_hub
f4e8fa5
verified

gsaltintas commited on

Upload folder using huggingface_hub
14f88f7
verified

gsaltintas commited on

Upload folder using huggingface_hub
7d273d1
verified

gsaltintas commited on

Upload folder using huggingface_hub
78b1942
verified

gsaltintas commited on

Upload folder using huggingface_hub
3dd1eb9
verified

gsaltintas commited on

Upload folder using huggingface_hub
9219f18
verified

gsaltintas commited on

Upload folder using huggingface_hub
119cad1
verified

gsaltintas commited on

Upload folder using huggingface_hub
24ef5c9
verified

gsaltintas commited on

initial commit
d9556fe
verified

gsaltintas commited on