Hugging Face's logo

flexitok
/
maddition_kor_Hang_360

Korean
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
maddition_kor_Hang_360

Commit History

Upload maddition_360_held_out/flexitok--maddition_kor_Hang_360_overlap.json with huggingface_hub
c8d3964
verified

gsaltintas commited on

Upload maddition_360_held_out/participating_tokenizers.json with huggingface_hub
f667752
verified

gsaltintas commited on

Upload maddition_360_held_out/flexitok--maddition_kor_Hang_360.yaml with huggingface_hub
1d0f4ff
verified

gsaltintas commited on

Upload maddition_360_held_out/flexitok--maddition_kor_Hang_360_info.json with huggingface_hub
ca1985b
verified

gsaltintas commited on

Upload maddition_360_held_out/flexitok--maddition_kor_Hang_360_vocab.json with huggingface_hub
09d251b
verified

gsaltintas commited on

Upload maddition_360_held_out/flexitok--maddition_kor_Hang_360_super_mapping.json with huggingface_hub
0e7297d
verified

gsaltintas commited on

Upload folder using huggingface_hub
a9e530d
verified

gsaltintas commited on

initial commit
8c5ea9b
verified

gsaltintas commited on