gsaltintas's picture
Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub
e42fd73 verified
raw
history blame contribute delete
450 Bytes
["flexitok/mod-tokenizers-zero-padded-individual", "flexitok/mod-tokenizers-zero-padded-ltr_3digit", "flexitok/mod-tokenizers-zero-padded-ltr_2digit", "flexitok/mod-tokenizers-zero-padded-ltr_4digit", "flexitok/mod-tokenizers-zero-padded-ltr_5digit", "flexitok/mod-tokenizers-zero-padded-rtl_2digit", "flexitok/mod-tokenizers-zero-padded-rtl_3digit", "flexitok/mod-tokenizers-zero-padded-rtl_4digit", "flexitok/mod-tokenizers-zero-padded-rtl_5digit"]