flexitok
/

mod-tokenizers-rtl_3digit

Model card Files Files and versions

mod-tokenizers-rtl_3digit

85.9 kB

Ctrl+K

Ctrl+K

1 contributor

History: 25 commits

gsaltintas's picture

Upload tokenizer file participating_tokenizers.json - Upload model files

06ce8eb verified about 2 months ago

mod_tokenizers
Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_overlap.json with huggingface_hub about 2 months ago
.gitattributes

1.52 kB
initial commit about 2 months ago
README.md

1.09 kB
Upload folder using huggingface_hub about 2 months ago
flexitok--mod-tokenizers-rtl_3digit_overlap.json

454 Bytes
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_overlap.json - Upload model files about 2 months ago
flexitok--mod-tokenizers-rtl_3digit_super_mapping.json

13.9 kB
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_super_mapping.json - Upload model files about 2 months ago
merges.txt

11.8 kB
Upload folder using huggingface_hub about 2 months ago
participating_tokenizers.json

342 Bytes
Upload tokenizer file participating_tokenizers.json - Upload model files about 2 months ago
special_tokens_map.json

162 Bytes
Upload folder using huggingface_hub about 2 months ago
tokenizer.json

13.9 kB
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_vocab.json - Upload model files about 2 months ago
tokenizer_config.json

94 Bytes
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_info.json - Upload model files about 2 months ago
vocab.json

13.9 kB
Upload folder using huggingface_hub about 2 months ago