Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
CausalNLP
/
gpt2-tokenizer-ar-zh-ko-ja
like
0
Follow
CausalNLP
10
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
gpt2-tokenizer-ar-zh-ko-ja
15.9 MB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
abir-hr196
Add balanced Arabic Chinese Korean Japanese tokenizer
316e80b
verified
27 days ago
.gitattributes
Safe
1.57 kB
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
merges.txt
2.19 MB
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
special_tokens_map.json
154 Bytes
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
tokenizer.json
10.7 MB
xet
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
tokenizer_config.json
Safe
1.17 kB
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
training_config.json
532 Bytes
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
vocab.json
3.03 MB
Add balanced Arabic Chinese Korean Japanese tokenizer
27 days ago
