Hugging Face's logo

flexitok
/
maddition_arb_Arab_2000

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_arb_Arab_2000

Commit History

Upload maddition/flexitok--maddition_arb_Arab_2000_vocab.json with huggingface_hub
fe9a4ea
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000_super_mapping.json with huggingface_hub
51e7674
verified

gsaltintas commited on

Upload folder using huggingface_hub
196375b
verified

gsaltintas commited on

Upload folder using huggingface_hub
1805e8b
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000_overlap.json with huggingface_hub
2b5f7e8
verified

gsaltintas commited on

Upload maddition/participating_tokenizers.json with huggingface_hub
ad7ad0e
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000.yaml with huggingface_hub
cc17e41
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000_info.json with huggingface_hub
a4316d1
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000_vocab.json with huggingface_hub
ba72ca8
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_arb_Arab_2000_super_mapping.json with huggingface_hub
d9fbce1
verified

gsaltintas commited on

Upload folder using huggingface_hub
cc0f1bf
verified

gsaltintas commited on

Upload folder using huggingface_hub
2b2123d
verified

gsaltintas commited on

Upload folder using huggingface_hub
05106ee
verified

gsaltintas commited on

initial commit
4ddb925
verified

gsaltintas commited on