Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
levuloihust
/
vien-unigram-tokenizer
like
0
Vietnamese
English
arxiv:
1804.10959
Model card
Files
Files and versions
xet
Community
main
vien-unigram-tokenizer
9.93 MB
2 contributors
History:
3 commits
Le Vu Loi
add necessary assets
8a91069
over 2 years ago
.gitattributes
Safe
1.63 kB
add necessary assets
over 2 years ago
README.md
Safe
2.65 kB
Create README.md
over 2 years ago
added_tokens.json
Safe
99 Bytes
add necessary assets
over 2 years ago
nmt_nfkc_vidiacritic.tsv
8.56 MB
xet
add necessary assets
over 2 years ago
required_chars.txt
Safe
680 Bytes
add necessary assets
over 2 years ago
special_tokens_map.json
Safe
170 Bytes
add necessary assets
over 2 years ago
spm.model
1.36 MB
xet
add necessary assets
over 2 years ago
tokenizer_config.json
Safe
1.62 kB
add necessary assets
over 2 years ago
user_defined_symbols.txt
Safe
6.05 kB
add necessary assets
over 2 years ago
