flexitok
/

bpe_ltr_arb_Arab_8000_v2

Standard Arabic

Model card Files Files and versions

bpe_ltr_arb_Arab_8000_v2

Commit History

Upload 8k_v2/flexitok--bpe_ltr_arb_Arab_8000_v2_overlap.json with huggingface_hub

d137a29
verified

gsaltintas commited on Apr 16

Upload 8k_v2/participating_tokenizers.json with huggingface_hub

ae597a7
verified

gsaltintas commited on Apr 16

Upload 8k_v2/flexitok--bpe_ltr_arb_Arab_8000_v2.yaml with huggingface_hub

e369f33
verified

gsaltintas commited on Apr 16

Upload 8k_v2/flexitok--bpe_ltr_arb_Arab_8000_v2_info.json with huggingface_hub

5b79104
verified

gsaltintas commited on Apr 16

Upload 8k_v2/flexitok--bpe_ltr_arb_Arab_8000_v2_vocab.json with huggingface_hub

eac7bc1
verified

gsaltintas commited on Apr 16

Upload 8k_v2/flexitok--bpe_ltr_arb_Arab_8000_v2_super_mapping.json with huggingface_hub

f168dce
verified

gsaltintas commited on Apr 16

Upload folder using huggingface_hub

b09b880
verified

gsaltintas commited on Apr 15

initial commit

8e7e146
verified

gsaltintas commited on Apr 15