Hugging Face's logo

flexitok
/
bpe_swe_Latn_8000

Swedish
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
bpe_swe_Latn_8000

Commit History

Upload fineweb2_hq/flexitok--bpe_swe_Latn_8000_overlap.json with huggingface_hub
6440944
verified

gsaltintas commited on

Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub
5331a2b
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_swe_Latn_8000.yaml with huggingface_hub
a3512f7
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_swe_Latn_8000_info.json with huggingface_hub
231b7b7
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_swe_Latn_8000_vocab.json with huggingface_hub
8b60916
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_swe_Latn_8000_super_mapping.json with huggingface_hub
d00519f
verified

gsaltintas commited on

Upload folder using huggingface_hub
90134f6
verified

gsaltintas commited on

Upload folder using huggingface_hub
139ddd8
verified

gsaltintas commited on

initial commit
88e9bda
verified

gsaltintas commited on