Hugging Face's logo

flexitok
/
mod-tokenizers-ltr_3digit

Undetermined
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
mod-tokenizers-ltr_3digit

Commit History

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_3digit_overlap.json with huggingface_hub
6766eca
verified

gsaltintas commited on

Upload mod_tokenizers/participating_tokenizers.json with huggingface_hub
3206ce8
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_3digit.yaml with huggingface_hub
cc844bb
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_3digit_info.json with huggingface_hub
5424ab7
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_3digit_vocab.json with huggingface_hub
8420cb9
verified

gsaltintas commited on

Upload mod_tokenizers/flexitok--mod-tokenizers-ltr_3digit_super_mapping.json with huggingface_hub
d1a992b
verified

gsaltintas commited on

Upload folder using huggingface_hub
80d6f6e
verified

gsaltintas commited on

Upload folder using huggingface_hub
8863e1a
verified

gsaltintas commited on

Upload folder using huggingface_hub
8c8bb99
verified

gsaltintas commited on

Upload folder using huggingface_hub
0ca7055
verified

gsaltintas commited on

Upload folder using huggingface_hub
b686a67
verified

gsaltintas commited on

Upload folder using huggingface_hub
0979ea6
verified

gsaltintas commited on

Upload folder using huggingface_hub
9634ef0
verified

gsaltintas commited on

initial commit
46ce3d9
verified

gsaltintas commited on