Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
flexitok
/
bpe_script_SEAS_16000
like
0
Follow
Moto
3
Indonesian
Vietnamese
tokenizer
bpe
flexitok
fineweb2
License:
mit
Model card
Files
Files and versions
xet
Community
main
bpe_script_SEAS_16000
File size: 90 Bytes
e7c0617
1
{
"data"
:
{
"tokenizer"
:
{
"name"
:
"huggingface"
,
"path"
:
"flexitok/bpe_script_SEAS_16000"
}
}
}