Hugging Face's logo

flexitok
/
bpe_pol_Latn_8000

Polish
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
bpe_pol_Latn_8000

Commit History

Upload fineweb2_hq/flexitok--bpe_pol_Latn_8000_overlap.json with huggingface_hub
c37c313
verified

gsaltintas commited on

Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub
31f3c7a
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_pol_Latn_8000.yaml with huggingface_hub
f5a11a0
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_pol_Latn_8000_info.json with huggingface_hub
f86e83b
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_pol_Latn_8000_vocab.json with huggingface_hub
6ff0e4c
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_pol_Latn_8000_super_mapping.json with huggingface_hub
6dea8a5
verified

gsaltintas commited on

Upload folder using huggingface_hub
d9a81e7
verified

gsaltintas commited on

Upload folder using huggingface_hub
6523332
verified

gsaltintas commited on

initial commit
bdbb5f6
verified

gsaltintas commited on