Upload tokenizer file participating_tokenizers.json - Upload model files
Browse files
participating_tokenizers.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
["flexitok/mod-tokenizers-individual", "flexitok/mod-tokenizers-ltr_3digit", "flexitok/mod-tokenizers-ltr_2digit", "flexitok/mod-tokenizers-ltr_4digit", "flexitok/mod-tokenizers-ltr_5digit", "flexitok/mod-tokenizers-rtl_2digit", "flexitok/mod-tokenizers-rtl_3digit", "flexitok/mod-tokenizers-rtl_4digit", "flexitok/mod-tokenizers-rtl_5digit"]
|