Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
OiQ
/
daa-tokenizers
like
0
Follow
OiQ Labs
Arabic
Latin
tokenizer
moroccan-darija
arabic
bpe
unigram
wordpiece
bbpe
benchmark
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
daa-tokenizers
/
plots
9.43 MB
Ctrl+K
Ctrl+K
1 contributor
History:
56 commits
Ouaill
Upload plots/external_comparison.png with huggingface_hub
7b89ea4
verified
12 days ago
bootstrap_ci_forest.png
420 kB
xet
Upload plots/bootstrap_ci_forest.png with huggingface_hub
14 days ago
cpt_overall_comparison_v2.png
483 kB
xet
Upload plots/cpt_overall_comparison_v2.png with huggingface_hub
14 days ago
cpt_overall_faceted.png
354 kB
xet
Upload plots/cpt_overall_faceted.png with huggingface_hub
14 days ago
cpt_overall_heatmap_v2.png
233 kB
xet
Upload plots/cpt_overall_heatmap_v2.png with huggingface_hub
14 days ago
cpt_overall_trends.png
437 kB
xet
Upload plots/cpt_overall_trends.png with huggingface_hub
14 days ago
exact_match_rate_comparison_v2.png
478 kB
xet
Upload plots/exact_match_rate_comparison_v2.png with huggingface_hub
14 days ago
exact_match_rate_heatmap_v2.png
207 kB
xet
Upload plots/exact_match_rate_heatmap_v2.png with huggingface_hub
14 days ago
exact_match_rate_trends.png
191 kB
xet
Upload plots/exact_match_rate_trends.png with huggingface_hub
14 days ago
external_comparison.png
645 kB
xet
Upload plots/external_comparison.png with huggingface_hub
12 days ago
fertility_disparity_comparison_v2.png
282 kB
xet
Upload plots/fertility_disparity_comparison_v2.png with huggingface_hub
12 days ago
fertility_disparity_faceted.png
231 kB
xet
Upload plots/fertility_disparity_faceted.png with huggingface_hub
14 days ago
fertility_disparity_heatmap_v2.png
321 kB
xet
Upload plots/fertility_disparity_heatmap_v2.png with huggingface_hub
12 days ago
fertility_disparity_trends.png
378 kB
xet
Upload plots/fertility_disparity_trends.png with huggingface_hub
14 days ago
fertility_overall_comparison_v2.png
285 kB
xet
Upload plots/fertility_overall_comparison_v2.png with huggingface_hub
12 days ago
fertility_overall_faceted.png
346 kB
xet
Upload plots/fertility_overall_faceted.png with huggingface_hub
14 days ago
fertility_overall_heatmap_v2.png
213 kB
xet
Upload plots/fertility_overall_heatmap_v2.png with huggingface_hub
14 days ago
fertility_overall_trends.png
560 kB
xet
Upload plots/fertility_overall_trends.png with huggingface_hub
12 days ago
morph_consistency_f1_comparison_v2.png
451 kB
xet
Upload plots/morph_consistency_f1_comparison_v2.png with huggingface_hub
14 days ago
morph_consistency_f1_heatmap_v2.png
241 kB
xet
Upload plots/morph_consistency_f1_heatmap_v2.png with huggingface_hub
14 days ago
morph_consistency_f1_trends.png
478 kB
xet
Upload plots/morph_consistency_f1_trends.png with huggingface_hub
14 days ago
morph_edit_distance_ar_comparison_v2.png
518 kB
xet
Upload plots/morph_edit_distance_ar_comparison_v2.png with huggingface_hub
14 days ago
morph_edit_distance_ar_heatmap_v2.png
231 kB
xet
Upload plots/morph_edit_distance_ar_heatmap_v2.png with huggingface_hub
14 days ago
morph_edit_distance_ar_trends.png
525 kB
xet
Upload plots/morph_edit_distance_ar_trends.png with huggingface_hub
14 days ago
oov_disparity_comparison_v2.png
171 kB
xet
Upload plots/oov_disparity_comparison_v2.png with huggingface_hub
14 days ago
script_comparison_v2.png
751 kB
xet
Upload plots/script_comparison_v2.png with huggingface_hub
14 days ago
