flexitok
/

mod-tokenizers-rtl_3digit

Model card Files Files and versions

mod-tokenizers-rtl_3digit

7.99 MB

Ctrl+K

Ctrl+K

1 contributor

History: 30 commits

gsaltintas's picture

Upload folder using huggingface_hub

af236bb verified about 2 months ago

mod_tokenizers
Upload mod_tokenizers/flexitok--mod-tokenizers-rtl_3digit_overlap.json with huggingface_hub 2 months ago
.gitattributes

1.52 kB
initial commit 2 months ago
README.md

1.09 kB
Upload folder using huggingface_hub about 2 months ago
config.json

602 Bytes
Upload config about 2 months ago
flexitok--mod-tokenizers-rtl_3digit.yaml

86 Bytes
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit.yaml - Upload model files about 2 months ago
flexitok--mod-tokenizers-rtl_3digit_overlap.json

454 Bytes
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_overlap.json - Upload model files about 2 months ago
flexitok--mod-tokenizers-rtl_3digit_super_mapping.json

13.9 kB
Upload tokenizer file flexitok--mod-tokenizers-rtl_3digit_super_mapping.json - Upload model files about 2 months ago
generation_config.json

150 Bytes
Upload model files about 2 months ago
merges.txt

11.8 kB
Upload folder using huggingface_hub 2 months ago
model.safetensors

7.86 MB
xet

Upload model files about 2 months ago
participating_tokenizers.json

342 Bytes
Upload tokenizer file participating_tokenizers.json - Upload model files about 2 months ago
special_tokens_map.json

162 Bytes
Upload folder using huggingface_hub 2 months ago
tokenizer.json

62.5 kB
Upload folder using huggingface_hub about 2 months ago
tokenizer_config.json

1.56 kB
Upload folder using huggingface_hub about 2 months ago
vocab.json

13.9 kB
Upload folder using huggingface_hub about 2 months ago