Hugging Face's logo

flexitok
/
mod-tokenizers-rtl_4digit

Safetensors
Undetermined
llama
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
gsaltintas commited on
Commit
e6691f2
·
verified ·
1 Parent(s): 1665023

Delete participating_tokenizers.json

Browse files
Files changed (1) hide show
  1. participating_tokenizers.json +0 -1
participating_tokenizers.json DELETED
@@ -1 +0,0 @@
1
- ["flexitok/mod-tokenizers-individual", "flexitok/mod-tokenizers-ltr_3digit", "flexitok/mod-tokenizers-ltr_2digit", "flexitok/mod-tokenizers-ltr_4digit", "flexitok/mod-tokenizers-ltr_5digit", "flexitok/mod-tokenizers-rtl_2digit", "flexitok/mod-tokenizers-rtl_3digit", "flexitok/mod-tokenizers-rtl_4digit", "flexitok/mod-tokenizers-rtl_5digit"]