Hugging Face's logo

flexitok
/
bpe_ces_Latn_8000

Czech
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
Community
bpe_ces_Latn_8000

Commit History

Upload fineweb2_hq/flexitok--bpe_ces_Latn_8000_overlap.json with huggingface_hub
341f3bd
verified

gsaltintas commited on

Upload fineweb2_hq/participating_tokenizers.json with huggingface_hub
2953b0b
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_ces_Latn_8000.yaml with huggingface_hub
52c2a48
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_ces_Latn_8000_info.json with huggingface_hub
3fb5144
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_ces_Latn_8000_vocab.json with huggingface_hub
225b712
verified

gsaltintas commited on

Upload fineweb2_hq/flexitok--bpe_ces_Latn_8000_super_mapping.json with huggingface_hub
ce66cad
verified

gsaltintas commited on

Upload folder using huggingface_hub
cf88a28
verified

gsaltintas commited on

Upload folder using huggingface_hub
62f3bf2
verified

gsaltintas commited on

initial commit
8145afb
verified

gsaltintas commited on