Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
OiQ
/
daa-tokenizers
like
0
Follow
OiQ Labs
Arabic
Latin
tokenizer
moroccan-darija
arabic
bpe
unigram
wordpiece
bbpe
benchmark
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
daa-tokenizers
/
transformers_tokenizers
/
shared_bbpe_32000
/
tokenizer.json
Ouaill
Upload transformers_tokenizers/shared_bbpe_32000/tokenizer.json with huggingface_hub
47ae49b
verified
22 days ago
Raw
Download with hf CLI
Copy download link
History
Contribute
Delete
2.78 MB
File too large to display, you can
check the raw version
instead.
