Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mxode
/
Bilingual-Tokenizer
like
0
Mxode/IndustryCorpus-Subset-zh-en
License:
gpl-3.0
Model card
Files
Files and versions
xet
Community
main
Bilingual-Tokenizer
1.31 MB
1 contributor
History:
6 commits
Mxode
Update README.md
706a898
verified
over 1 year ago
BilingualTokenizer-16K
upload tokenizer
over 1 year ago
BilingualTokenizer-1K
upload tokenizer
over 1 year ago
BilingualTokenizer-2K
upload tokenizer
over 1 year ago
BilingualTokenizer-4K
upload tokenizer
over 1 year ago
BilingualTokenizer-8K
upload tokenizer
over 1 year ago
.gitattributes
1.52 kB
initial commit
over 1 year ago
README.md
2.51 kB
Update README.md
over 1 year ago
train.py
2.94 kB
Upload train.py
over 1 year ago
