flexitok
/

mod-tokenizers-ltr_2digit

Model card Files Files and versions

mod-tokenizers-ltr_2digit

6.95 MB

Ctrl+K

Ctrl+K

1 contributor

History: 23 commits

gsaltintas's picture

Upload config

e514c9f verified 2 months ago

mod_tokenizers
Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_2digit_overlap.json with huggingface_hub 2 months ago
.gitattributes

1.52 kB
initial commit 2 months ago
README.md

1.1 kB
Upload folder using huggingface_hub 2 months ago
config.json

601 Bytes
Upload config 2 months ago
flexitok--mod-tokenizers-ltr_2digit.yaml

86 Bytes
Upload tokenizer file flexitok--mod-tokenizers-ltr_2digit.yaml - Upload model files 2 months ago
flexitok--mod-tokenizers-ltr_2digit_overlap.json

319 Bytes
Upload tokenizer file flexitok--mod-tokenizers-ltr_2digit_overlap.json - Upload model files 2 months ago
flexitok--mod-tokenizers-ltr_2digit_super_mapping.json

1.37 kB
Upload tokenizer file flexitok--mod-tokenizers-ltr_2digit_super_mapping.json - Upload model files 2 months ago
generation_config.json

150 Bytes
Upload model files 2 months ago
merges.txt

1 kB
Upload folder using huggingface_hub 2 months ago
model.safetensors

6.93 MB
xet

Upload model files 2 months ago
participating_tokenizers.json

342 Bytes
Upload tokenizer file participating_tokenizers.json - Upload model files 2 months ago
special_tokens_map.json

162 Bytes
Upload folder using huggingface_hub 2 months ago
tokenizer.json

1.3 kB
Upload tokenizer file flexitok--mod-tokenizers-ltr_2digit_vocab.json - Upload model files 2 months ago
tokenizer_config.json

94 Bytes
Upload tokenizer file flexitok--mod-tokenizers-ltr_2digit_info.json - Upload model files 2 months ago
vocab.json

1.28 kB
Upload folder using huggingface_hub 2 months ago