Hugging Face
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Samai-sa
/
SamAI-Tokenizer
Like
0
Arabic
English
tokenizers
tokenizer
arabic
arabic-nlp
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
main
SamAI-Tokenizer
6.41 MB
Ctrl+K
Ctrl+K
1 contributor
History:
24 commits
Samai-sa
Update README.md
4918135
verified
about 2 months ago
assets
Publish updated SamAI Tokenizer repository
about 2 months ago
benchmark
Publish updated SamAI Tokenizer repository
about 2 months ago
results
Publish updated SamAI Tokenizer repository
about 2 months ago
.gitattributes
Safe
1.59 kB
Publish updated SamAI Tokenizer repository
about 2 months ago
.gitignore
Safe
45 Bytes
Publish SamAI Tokenizer
about 2 months ago
CITATION.cff
359 Bytes
Publish updated SamAI Tokenizer repository
about 2 months ago
LICENSE
Safe
11.4 kB
Publish SamAI Tokenizer
about 2 months ago
NOTICE
312 Bytes
Publish updated SamAI Tokenizer repository
about 2 months ago
README.md
Safe
5.49 kB
Update README.md
about 2 months ago
example.py
507 Bytes
Publish updated SamAI Tokenizer repository
about 2 months ago
meta.json
Safe
318 Bytes
Publish updated SamAI Tokenizer repository
about 2 months ago
requirements.txt
Safe
58 Bytes
Publish SamAI Tokenizer
about 2 months ago
special_tokens_map.json
Safe
185 Bytes
Publish SamAI Tokenizer
about 2 months ago
tokenizer.json
Safe
5.85 MB
Publish SamAI Tokenizer
about 2 months ago
tokenizer_config.json
Safe
274 Bytes
Publish SamAI Tokenizer
about 2 months ago
validate_tokenizer.py
Safe
886 Bytes
Publish updated SamAI Tokenizer repository
about 2 months ago
