Hugging Face's logo

flexitok
/
bpe_script_Germ_32000

tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_Germ_32000

Commit History

Upload script_1/flexitok--bpe_script_Germ_32000_overlap.json with huggingface_hub
519ebe1
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_vocab.json with huggingface_hub
dde88d0
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_super_mapping.json with huggingface_hub
6e81357
verified

gsaltintas commited on

Upload folder using huggingface_hub
1fe3a86
verified

gsaltintas commited on

Upload folder using huggingface_hub
55aeb76
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_overlap.json with huggingface_hub
a733f25
verified

gsaltintas commited on

Upload script_1/participating_tokenizers.json with huggingface_hub
67618c9
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000.yaml with huggingface_hub
6c75fb2
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_info.json with huggingface_hub
7625785
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_vocab.json with huggingface_hub
49e0244
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Germ_32000_super_mapping.json with huggingface_hub
cad876d
verified

gsaltintas commited on

Upload folder using huggingface_hub
bff542c
verified

gsaltintas commited on

initial commit
4cdb817
verified

gsaltintas commited on