Hugging Face's logo

flexitok
/
maddition_digit_2000

Digo
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_digit_2000 / maddition

Commit History

Upload maddition/flexitok--maddition_digit_2000_vocab.json with huggingface_hub
3529fcd
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000_super_mapping.json with huggingface_hub
b461d23
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000_overlap.json with huggingface_hub
48f9fc6
verified

gsaltintas commited on

Upload maddition/participating_tokenizers.json with huggingface_hub
c75b118
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000.yaml with huggingface_hub
5532c98
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000_info.json with huggingface_hub
7e59e0f
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000_vocab.json with huggingface_hub
0c0cd14
verified

gsaltintas commited on

Upload maddition/flexitok--maddition_digit_2000_super_mapping.json with huggingface_hub
1631bf9
verified

gsaltintas commited on