gsaltintas's picture
Upload mod_tokenizers_zero_padded/participating_tokenizers.json with huggingface_hub
dc5c3f6 verified
raw
history blame contribute delete
450 Bytes
["flexitok/mod-tokenizers-zero-padded-individual", "flexitok/mod-tokenizers-zero-padded-ltr_3digit", "flexitok/mod-tokenizers-zero-padded-ltr_2digit", "flexitok/mod-tokenizers-zero-padded-ltr_4digit", "flexitok/mod-tokenizers-zero-padded-ltr_5digit", "flexitok/mod-tokenizers-zero-padded-rtl_2digit", "flexitok/mod-tokenizers-zero-padded-rtl_3digit", "flexitok/mod-tokenizers-zero-padded-rtl_4digit", "flexitok/mod-tokenizers-zero-padded-rtl_5digit"]