Hugging Face's logo

flexitok
/
bpe_script_SEAS_16000

Indonesian
Vietnamese
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_SEAS_16000 / script_1 /flexitok--bpe_script_SEAS_16000_info.json
gsaltintas's picture
gsaltintas
Upload script_1/flexitok--bpe_script_SEAS_16000_info.json with huggingface_hub
e7c0617 verified
raw
history blame contribute delete
90 Bytes
{"data": {"tokenizer": {"name": "huggingface", "path": "flexitok/bpe_script_SEAS_16000"}}}