Hugging Face's logo

flexitok
/
maddition_fas_Arab_2000

Persian
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_fas_Arab_2000

Commit History

Upload maddition/flexitok--maddition_fas_Arab_2000_vocab.json with huggingface_hub
739073f
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000_super_mapping.json with huggingface_hub
32a2ece
verified

gsaltintas commited on

Upload folder using huggingface_hub
45f8197
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000_overlap.json with huggingface_hub
091f7ab
verified

gsaltintas commited on

Upload maddition/participating_tokenizers.json with huggingface_hub
64eab85
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000.yaml with huggingface_hub
76beb90
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000_info.json with huggingface_hub
fab87d0
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000_vocab.json with huggingface_hub
8b48634
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_fas_Arab_2000_super_mapping.json with huggingface_hub
f118766
verified

gsaltintas commited on

Upload folder using huggingface_hub
e21cba0
verified

gsaltintas commited on

Upload folder using huggingface_hub
99c7cf4
verified

gsaltintas commited on

Upload folder using huggingface_hub
7d36c99
verified

gsaltintas commited on

initial commit
54828af
verified

gsaltintas commited on