Hugging Face's logo

flexitok
/
maddition_arb_Arab_360

Standard Arabic
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_arb_Arab_360

Commit History

Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub
ee81331
verified

gsaltintas commited on

Upload maddition_360_v2/participating_tokenizers.json with huggingface_hub
d75fb7f
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_arb_Arab_360.yaml with huggingface_hub
ccda279
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_info.json with huggingface_hub
0838e57
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_vocab.json with huggingface_hub
2e45c0d
verified

gsaltintas commited on

Upload maddition_360_v2/flexitok--maddition_arb_Arab_360_super_mapping.json with huggingface_hub
c66f755
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_arb_Arab_360_overlap.json with huggingface_hub
67c8c96
verified

gsaltintas commited on

Upload maddition_360/participating_tokenizers.json with huggingface_hub
5c351ec
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_arb_Arab_360.yaml with huggingface_hub
3f9eb18
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_arb_Arab_360_info.json with huggingface_hub
95e9f58
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_arb_Arab_360_vocab.json with huggingface_hub
9b23761
verified

gsaltintas commited on

Upload maddition_360/flexitok--maddition_arb_Arab_360_super_mapping.json with huggingface_hub
757f3a2
verified

gsaltintas commited on

Upload folder using huggingface_hub
c04681d
verified

gsaltintas commited on

initial commit
0fbf1be
verified

gsaltintas commited on