Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
junaid008
/
hindko-tokenizer
Like
2
Northern Hindko
Southern Hindko
tokenizers
tokenizer
sentencepiece
unigram
hindko
low-resource
urdu-script
perso-arabic
License:
cc-by-4.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
hindko-tokenizer
/
eval
546 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
junaid008
Add evaluation tables and charts
cc35156
verified
3 days ago
chart_bytes_per_token_test.png
113 kB
xet
Add evaluation tables and charts
3 days ago
chart_data.json
Safe
3.51 kB
Add evaluation tables and charts
3 days ago
chart_lm_bpb_dev_test.png
123 kB
xet
Add evaluation tables and charts
3 days ago
competitors_summary.json
Safe
38.1 kB
Add evaluation tables and charts
3 days ago
competitors_test_strict.csv
Safe
79.5 kB
Add evaluation tables and charts
3 days ago
dev_lm_confirm_ranking.csv
Safe
5.12 kB
Add evaluation tables and charts
3 days ago
dev_lm_large.csv
Safe
1.29 kB
Add evaluation tables and charts
3 days ago
examples_segmentations.json
Safe
19.4 kB
Add evaluation tables and charts
3 days ago
health_gates_and_support.csv
Safe
1.27 kB
Add evaluation tables and charts
3 days ago
lm_key_contrasts.json
Safe
8.95 kB
Add evaluation tables and charts
3 days ago
robustness_summary.json
Safe
147 kB
Add evaluation tables and charts
3 days ago
test_lm_confirm.csv
Safe
3.4 kB
Add evaluation tables and charts
3 days ago
test_lm_large.csv
Safe
930 Bytes
Add evaluation tables and charts
3 days ago
vocab_audit_summary.json
Safe
1.06 kB
Add evaluation tables and charts
3 days ago
