Hugging Face's logo

baobabtech
/
millid

Text Classification
PyTorch
language-identification
leaderboard
🇪🇺 Region: EU
Model card Files
xet
 Community
2
byamasupatrick commited on
Commit
558ecc5
·
verified ·
1 Parent(s): 95a4f81

MillID leaderboard against GlotLID and fastText

Browse files
Files changed (5) hide show
  1. README.md +347 -0
  2. leaderboard_overall.csv +36 -0
  3. leaderboard_test-common.csv +214 -0
  4. leaderboard_test.csv +0 -0
  5. leaderboard_udhr.csv +359 -0
README.md ADDED
@@ -0,0 +1,347 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: pytorch
3
+ pipeline_tag: text-classification
4
+ tags:
5
+ - language-identification
6
+ - leaderboard
7
+ datasets:
8
+ - baobabtech/millid-dataset
9
+ ---
10
+
11
+ # MillID leaderboard
12
+
13
+ **MillID** (MultiLingual Language IDentifier) against [GlotLID](https://huggingface.co/cis-lmu/glotlid) and Meta's
14
+ [fastText language identifier](https://huggingface.co/facebook/fasttext-language-identification) (NLLB), on
15
+ [baobabtech/millid-dataset](https://huggingface.co/datasets/baobabtech/millid-dataset). F1 is per language, then
16
+ averaged with every language weighted equally (macro).
17
+
18
+ - MillID knows 1,641 labels, GlotLID over 2,000, fastText 218. Each external model is shown *restricted to
19
+ MillID's labels* (its best answer among them), the like-for-like comparison; its as-is scores are below.
20
+ - On `test` and `udhr`, fastText is mostly scored on languages it cannot answer. `test-common` and
21
+ `udhr-common` keep the passages whose language all three know (about 210 languages): the head-to-head on
22
+ equal terms.
23
+ - Read GlotLID's scores with their bias in mind: the dataset's FinePDFs and FineWeb-2 passages were labelled
24
+ by GlotLID, and GlotLID was trained on UDHR, so both favour it.
25
+ - fastText's labels are mapped onto MillID's spelling: Simplified and Traditional Han as `Hani`, `pes`/`prs`
26
+ as `fas`, `est` as `ekk`, `tgl` as `fil`.
27
+
28
+ ## Macro F1, every set
29
+
30
+ | Set | Languages | MillID tiny | MillID medium | MillID large | GlotLID | fastText |
31
+ |---|---|---|---|---|---|---|
32
+ | `test`: every language, passages from documents never seen in training | 1621 | 0.9524 | 0.9576 | 0.9566 | **0.9755** | 0.0659 |
33
+ | `test-common`: the languages all three systems know | 213 | 0.9458 | 0.9527 | 0.9501 | **0.9846** | 0.9173 |
34
+ | `udhr`: the Declaration of Human Rights, languages MillID knows | 358 | 0.8698 | 0.8780 | 0.8755 | **0.8873** | 0.3499 |
35
+ | `udhr-common`: the Declaration, languages all three know | 170 | 0.9489 | 0.9480 | 0.9443 | **0.9659** | 0.9329 |
36
+ | `udhr-all`: the Declaration, every language in it | 429 | 0.7099 | 0.7184 | 0.7153 | **0.7245** | 0.2797 |
37
+
38
+ The best score on each set is in bold.
39
+
40
+ ## test
41
+
42
+ Every language, passages from documents never seen in training.
43
+
44
+ | Model | Size | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages F1 ≥ 0.9 |
45
+ |---|---|---|---|---|---|---|---|---|---|
46
+ | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9783 | 0.9978 | 0.9985 | 0.9778 | 0.9765 | 0.9755 | 1.0000 | 1490 of 1621 |
47
+ | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9776 | 0.9977 | 0.9984 | 0.9783 | 0.9752 | 0.9748 | 1.0000 | 1488 of 1621 |
48
+ | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9616 | 0.9910 | 0.9945 | 0.9564 | 0.9614 | 0.9576 | 0.9841 | 1451 of 1621 |
49
+ | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9602 | 0.9913 | 0.9948 | 0.9559 | 0.9601 | 0.9566 | 0.9844 | 1444 of 1621 |
50
+ | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9555 | 0.9884 | 0.9929 | 0.9527 | 0.9553 | 0.9524 | 0.9802 | 1428 of 1621 |
51
+ | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.2515 | 0.2611 | 0.2625 | 0.0521 | 0.1209 | 0.0659 | 0.0000 | 26 of 1621 |
52
+ | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.2511 | 0.2610 | 0.2625 | 0.0520 | 0.1205 | 0.0657 | 0.0000 | 25 of 1621 |
53
+
54
+ ## test-common
55
+
56
+ The languages all three systems know.
57
+
58
+ | Model | Size | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages F1 ≥ 0.9 |
59
+ |---|---|---|---|---|---|---|---|---|---|
60
+ | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9749 | 0.9927 | 0.9948 | 0.9923 | 0.9790 | 0.9846 | 0.9983 | 203 of 213 |
61
+ | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9738 | 0.9925 | 0.9946 | 0.9924 | 0.9771 | 0.9835 | 0.9983 | 201 of 213 |
62
+ | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9425 | 0.9882 | 0.9924 | 0.9732 | 0.9361 | 0.9527 | 0.9738 | 191 of 213 |
63
+ | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9401 | 0.9885 | 0.9929 | 0.9706 | 0.9337 | 0.9501 | 0.9735 | 185 of 213 |
64
+ | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9354 | 0.9848 | 0.9904 | 0.9661 | 0.9296 | 0.9458 | 0.9694 | 185 of 213 |
65
+ | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9352 | 0.9710 | 0.9763 | 0.9354 | 0.9201 | 0.9173 | 0.9680 | 166 of 213 |
66
+ | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9339 | 0.9707 | 0.9762 | 0.9357 | 0.9169 | 0.9149 | 0.9680 | 165 of 213 |
67
+
68
+ ## udhr
69
+
70
+ The Declaration of Human Rights, languages MillID knows.
71
+
72
+ | Model | Size | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages F1 ≥ 0.9 |
73
+ |---|---|---|---|---|---|---|---|---|---|
74
+ | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.8614 | 0.9294 | 0.9433 | 0.9258 | 0.8844 | 0.8873 | 0.9915 | 291 of 358 |
75
+ | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.8598 | 0.9280 | 0.9421 | 0.9261 | 0.8826 | 0.8865 | 0.9915 | 287 of 358 |
76
+ | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.8524 | 0.9194 | 0.9340 | 0.9187 | 0.8769 | 0.8780 | 0.9910 | 282 of 358 |
77
+ | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.8502 | 0.9168 | 0.9287 | 0.9120 | 0.8757 | 0.8755 | 0.9912 | 273 of 358 |
78
+ | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.8423 | 0.9134 | 0.9274 | 0.9043 | 0.8685 | 0.8698 | 0.9846 | 274 of 358 |
79
+ | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.4629 | 0.4857 | 0.4904 | 0.3152 | 0.4483 | 0.3499 | 0.0000 | 61 of 358 |
80
+ | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.4625 | 0.4857 | 0.4903 | 0.3152 | 0.4479 | 0.3497 | 0.0000 | 60 of 358 |
81
+
82
+ ## udhr-common
83
+
84
+ The Declaration, languages all three know.
85
+
86
+ | Model | Size | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages F1 ≥ 0.9 |
87
+ |---|---|---|---|---|---|---|---|---|---|
88
+ | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9338 | 0.9683 | 0.9736 | 0.9888 | 0.9579 | 0.9659 | 1.0000 | 156 of 170 |
89
+ | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.9336 | 0.9678 | 0.9732 | 0.9888 | 0.9576 | 0.9657 | 1.0000 | 155 of 170 |
90
+ | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.9082 | 0.9581 | 0.9641 | 0.9777 | 0.9371 | 0.9489 | 0.9917 | 151 of 170 |
91
+ | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.9121 | 0.9633 | 0.9688 | 0.9770 | 0.9382 | 0.9480 | 0.9955 | 153 of 170 |
92
+ | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.9075 | 0.9615 | 0.9666 | 0.9735 | 0.9340 | 0.9443 | 0.9924 | 148 of 170 |
93
+ | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9195 | 0.9647 | 0.9742 | 0.9474 | 0.9441 | 0.9329 | 1.0000 | 142 of 170 |
94
+ | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.9187 | 0.9647 | 0.9741 | 0.9474 | 0.9431 | 0.9323 | 1.0000 | 141 of 170 |
95
+
96
+ ## udhr-all
97
+
98
+ The Declaration, every language in it.
99
+
100
+ | Model | Size | Top-1 | Top-3 | Top-5 | Macro P | Macro R | Macro F1 | Median F1 | Languages F1 ≥ 0.9 |
101
+ |---|---|---|---|---|---|---|---|---|---|
102
+ | [GlotLID](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.7502 | 0.8145 | 0.8282 | 0.7695 | 0.7529 | 0.7454 | 0.9796 | 277 of 429 |
103
+ | [GlotLID, restricted to MillID's labels](https://huggingface.co/cis-lmu/glotlid) | fastText, 1.7 GB | 0.7378 | 0.7960 | 0.8079 | 0.7425 | 0.7381 | 0.7245 | 0.9748 | 272 of 429 |
104
+ | [MillID medium](https://huggingface.co/baobabtech/millid-medium) | 115.0M | 0.7301 | 0.7875 | 0.8000 | 0.7415 | 0.7318 | 0.7184 | 0.9672 | 266 of 429 |
105
+ | [MillID large](https://huggingface.co/baobabtech/millid-large) | 192.6M | 0.7282 | 0.7853 | 0.7954 | 0.7344 | 0.7307 | 0.7153 | 0.9640 | 254 of 429 |
106
+ | [MillID tiny](https://huggingface.co/baobabtech/millid-tiny) | 2.9M | 0.7214 | 0.7823 | 0.7943 | 0.7256 | 0.7247 | 0.7099 | 0.9583 | 255 of 429 |
107
+ | [fastText, restricted to MillID's labels](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.3964 | 0.4160 | 0.4200 | 0.2479 | 0.3741 | 0.2797 | 0.0000 | 55 of 429 |
108
+ | [fastText (Meta, NLLB)](https://huggingface.co/facebook/fasttext-language-identification) | fastText, 1.2 GB | 0.3961 | 0.4160 | 0.4200 | 0.2479 | 0.3737 | 0.2795 | 0.0000 | 54 of 429 |
109
+
110
+ ## Per language, test
111
+
112
+ Against GlotLID restricted, the best MillID is better on **151** languages and worse on **564**; against fastText restricted, the best MillID is better on **1616** languages and worse on **0** (F1 differing by more than 0.01), of 1621. Every language is in `leaderboard_test.csv`.
113
+
114
+ The 30 languages with the most passages:
115
+
116
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
117
+ |---|---|---|---|---|---|---|---|---|---|
118
+ | `fra_Latn` | French | 1652 | 0.928 | 0.928 | 0.808 | 0.808 | 0.939 | 0.952 | 0.946 |
119
+ | `eng_Latn` | English | 1444 | 0.858 | 0.859 | 0.653 | 0.648 | 0.914 | 0.916 | 0.910 |
120
+ | `spa_Latn` | Spanish | 1136 | 0.951 | 0.951 | 0.574 | 0.574 | 0.928 | 0.942 | 0.944 |
121
+ | `tam_Taml` | Tamil | 754 | 0.993 | 0.993 | 0.965 | 0.965 | 0.999 | 0.997 | 0.998 |
122
+ | `arb_Arab` | Arabic (Modern Standard) | 745 | 0.785 | 0.785 | 0.513 | 0.512 | 0.812 | 0.829 | 0.807 |
123
+ | `por_Latn` | Portuguese | 657 | 0.947 | 0.949 | 0.756 | 0.755 | 0.949 | 0.955 | 0.953 |
124
+ | `kan_Knda` | Kannada | 601 | 0.993 | 0.993 | 0.922 | 0.922 | 0.978 | 0.982 | 0.985 |
125
+ | `zul_Latn` | Zulu | 594 | 0.896 | 0.896 | 0.539 | 0.539 | 0.806 | 0.833 | 0.801 |
126
+ | `swh_Latn` | Swahili | 592 | 0.917 | 0.916 | 0.346 | 0.346 | 0.855 | 0.858 | 0.848 |
127
+ | `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.926 | 0.926 | 0.967 | 0.981 | 0.974 |
128
+ | `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.425 | 0.425 | 0.969 | 0.970 | 0.967 |
129
+ | `hun_Latn` | Hungarian | 576 | 0.999 | 0.999 | 0.232 | 0.232 | 0.978 | 0.990 | 0.991 |
130
+ | `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.861 | 0.860 | 0.974 | 0.974 | 0.976 |
131
+ | `tel_Telu` | Telugu | 555 | 0.994 | 0.994 | 0.951 | 0.951 | 0.991 | 0.994 | 0.995 |
132
+ | `nbl_Latn` | South Ndebele | 528 | 0.948 | 0.949 | 0.000 | 0.000 | 0.885 | 0.895 | 0.903 |
133
+ | `rus_Cyrl` | Russian | 528 | 0.949 | 0.949 | 0.462 | 0.462 | 0.913 | 0.925 | 0.945 |
134
+ | `ory_Orya` | Odia (individual language) | 511 | 0.991 | 0.994 | 0.976 | 0.976 | 0.990 | 0.993 | 0.993 |
135
+ | `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.660 | 0.660 | 0.966 | 0.966 | 0.965 |
136
+ | `nso_Latn` | Northern Sotho | 479 | 0.969 | 0.969 | 0.915 | 0.914 | 0.945 | 0.960 | 0.951 |
137
+ | `kua_Latn` | Kuanyama | 476 | 0.986 | 0.986 | 0.000 | 0.000 | 0.959 | 0.979 | 0.960 |
138
+ | `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.990 | 0.990 | 0.993 | 0.994 | 0.994 |
139
+ | `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.718 | 0.718 | 0.963 | 0.980 | 0.972 |
140
+ | `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 |
141
+ | `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.807 | 0.807 | 0.983 | 0.984 | 0.975 |
142
+ | `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.652 | 0.652 | 0.930 | 0.939 | 0.934 |
143
+ | `vro_Latn` | Võro | 448 | 0.990 | 0.990 | 0.000 | 0.000 | 0.960 | 0.958 | 0.965 |
144
+ | `gaz_Latn` | Oromo (West Central) | 441 | 0.938 | 0.938 | 0.407 | 0.407 | 0.914 | 0.943 | 0.931 |
145
+ | `som_Latn` | Somali | 439 | 0.994 | 0.994 | 0.487 | 0.487 | 0.985 | 0.988 | 0.990 |
146
+ | `uzn_Latn` | Northern Uzbek | 436 | 0.994 | 0.994 | 0.449 | 0.449 | 0.972 | 0.978 | 0.979 |
147
+ | `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.650 | 0.650 | 0.978 | 0.970 | 0.979 |
148
+
149
+ Where MillID gains most over GlotLID:
150
+
151
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
152
+ |---|---|---|---|---|---|---|---|---|---|
153
+ | `lbj_Tibt` | Ladakhi | 66 | 0.000 | 0.000 | 0.000 | 0.000 | 0.898 | 0.943 | 0.880 |
154
+ | `ain_Latn` | Ainu | 1 | 0.000 | 0.000 | 0.000 | 0.000 | 0.400 | 0.667 | 0.667 |
155
+ | `ajp_Arab` | South Levantine Arabic | 28 | 0.581 | 0.581 | 0.000 | 0.000 | 0.963 | 0.902 | 0.906 |
156
+ | `und_Laoo` | und | 20 | 0.621 | 0.621 | 0.000 | 0.000 | 0.750 | 0.857 | 0.927 |
157
+ | `und_Deva` | und | 5 | 0.727 | 0.615 | 0.000 | 0.000 | 0.889 | 0.667 | 0.750 |
158
+ | `sgh_Cyrl` | Shughni | 9 | 0.667 | 0.667 | 0.000 | 0.000 | 0.842 | 0.900 | 0.818 |
159
+ | `und_Thaa` | und | 29 | 0.651 | 0.651 | 0.000 | 0.000 | 0.792 | 0.873 | 0.750 |
160
+ | `icr_Latn` | Islander Creole English | 24 | 0.649 | 0.684 | 0.000 | 0.000 | 0.783 | 0.870 | 0.744 |
161
+ | `cek_Latn` | Eastern Khumi Chin | 67 | 0.680 | 0.684 | 0.000 | 0.000 | 0.718 | 0.853 | 0.688 |
162
+ | `neb_Latn` | Toura (Côte d'Ivoire) | 11 | 0.625 | 0.842 | 0.000 | 0.000 | 1.000 | 0.957 | 0.952 |
163
+ | `dag_Latn` | Dagbani | 149 | 0.662 | 0.660 | 0.000 | 0.000 | 0.801 | 0.817 | 0.791 |
164
+ | `und_Syrc` | und | 43 | 0.822 | 0.822 | 0.000 | 0.000 | 0.956 | 0.977 | 0.966 |
165
+ | `tuk_Arab` | Turkmen | 135 | 0.761 | 0.761 | 0.000 | 0.000 | 0.893 | 0.903 | 0.906 |
166
+ | `kby_Latn` | Manga Kanuri | 7 | 0.326 | 0.326 | 0.000 | 0.000 | 0.414 | 0.452 | 0.467 |
167
+ | `orv_Cyrl` | Old Russian | 239 | 0.800 | 0.800 | 0.000 | 0.000 | 0.921 | 0.935 | 0.928 |
168
+
169
+ Where MillID loses most to GlotLID:
170
+
171
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
172
+ |---|---|---|---|---|---|---|---|---|---|
173
+ | `biu_Latn` | Biete | 7 | 1.000 | 1.000 | 0.000 | 0.000 | 0.500 | 0.667 | 0.667 |
174
+ | `ttj_Latn` | Tooro | 28 | 0.946 | 0.946 | 0.000 | 0.000 | 0.597 | 0.490 | 0.618 |
175
+ | `knc_Arab` | Central Kanuri | 68 | 0.823 | 0.825 | 0.007 | 0.007 | 0.514 | 0.509 | 0.488 |
176
+ | `esi_Latn` | North Alaskan Inupiatun | 9 | 0.783 | 0.783 | 0.000 | 0.000 | 0.222 | 0.500 | 0.400 |
177
+ | `hrv_Latn` | Croatian | 168 | 0.944 | 0.944 | 0.178 | 0.178 | 0.615 | 0.687 | 0.630 |
178
+ | `dks_Latn` | Southeastern Dinka | 3 | 1.000 | 1.000 | 0.000 | 0.000 | 0.667 | 0.750 | 0.600 |
179
+ | `bos_Latn` | Bosnian | 198 | 0.902 | 0.902 | 0.181 | 0.181 | 0.603 | 0.673 | 0.680 |
180
+ | `zsm_Latn` | Standard Malay | 244 | 0.957 | 0.957 | 0.321 | 0.319 | 0.677 | 0.746 | 0.729 |
181
+ | `hak_Hani` | Hakka Chinese | 29 | 0.824 | 0.824 | 0.000 | 0.000 | 0.618 | 0.415 | 0.458 |
182
+ | `nse_Latn` | Nsenga | 12 | 0.750 | 0.750 | 0.000 | 0.000 | 0.545 | 0.500 | 0.500 |
183
+ | `plw_Latn` | Brooke's Point Palawano | 8 | 1.000 | 1.000 | 0.000 | 0.000 | 0.696 | 0.800 | 0.667 |
184
+ | `ccp_Latn` | Chakma | 3 | 1.000 | 1.000 | 0.000 | 0.000 | 0.800 | 0.333 | 0.333 |
185
+ | `tui_Latn` | Tupuri | 4 | 0.667 | 1.000 | 0.000 | 0.000 | 0.800 | 0.750 | 0.600 |
186
+ | `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.816 | 0.816 | 0.569 | 0.569 | 0.572 | 0.620 | 0.611 |
187
+ | `taq_Tfng` | Tamasheq | 104 | 0.718 | 0.718 | 0.000 | 0.000 | 0.524 | 0.535 | 0.523 |
188
+
189
+ ## Per language, test-common
190
+
191
+ Against GlotLID restricted, the best MillID is better on **8** languages and worse on **127**; against fastText restricted, the best MillID is better on **99** languages and worse on **37** (F1 differing by more than 0.01), of 213. Every language is in `leaderboard_test-common.csv`.
192
+
193
+ The 30 languages with the most passages:
194
+
195
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
196
+ |---|---|---|---|---|---|---|---|---|---|
197
+ | `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 |
198
+ | `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 |
199
+ | `spa_Latn` | Spanish | 1136 | 0.958 | 0.958 | 0.941 | 0.941 | 0.943 | 0.953 | 0.958 |
200
+ | `tam_Taml` | Tamil | 754 | 1.000 | 1.000 | 0.997 | 0.997 | 0.999 | 0.998 | 0.998 |
201
+ | `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 |
202
+ | `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 |
203
+ | `kan_Knda` | Kannada | 601 | 0.994 | 0.994 | 0.999 | 0.999 | 0.982 | 0.987 | 0.991 |
204
+ | `zul_Latn` | Zulu | 594 | 0.904 | 0.904 | 0.970 | 0.970 | 0.845 | 0.871 | 0.830 |
205
+ | `swh_Latn` | Swahili | 592 | 0.954 | 0.953 | 0.945 | 0.945 | 0.902 | 0.897 | 0.902 |
206
+ | `mar_Deva` | Marathi | 589 | 0.989 | 0.990 | 0.987 | 0.987 | 0.971 | 0.981 | 0.974 |
207
+ | `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 |
208
+ | `hun_Latn` | Hungarian | 576 | 1.000 | 1.000 | 0.980 | 0.980 | 0.983 | 0.991 | 0.991 |
209
+ | `afr_Latn` | Afrikaans | 569 | 0.985 | 0.985 | 0.986 | 0.986 | 0.978 | 0.976 | 0.982 |
210
+ | `tel_Telu` | Telugu | 555 | 0.998 | 0.998 | 0.999 | 0.999 | 0.999 | 1.000 | 1.000 |
211
+ | `rus_Cyrl` | Russian | 528 | 0.985 | 0.985 | 0.927 | 0.927 | 0.924 | 0.929 | 0.956 |
212
+ | `ory_Orya` | Odia (individual language) | 511 | 0.997 | 1.000 | 0.996 | 0.996 | 0.996 | 0.996 | 0.996 |
213
+ | `sot_Latn` | Southern Sotho | 491 | 0.977 | 0.978 | 0.856 | 0.856 | 0.970 | 0.967 | 0.967 |
214
+ | `nso_Latn` | Northern Sotho | 479 | 0.970 | 0.970 | 0.967 | 0.967 | 0.947 | 0.961 | 0.952 |
215
+ | `asm_Beng` | Assamese | 467 | 0.999 | 0.999 | 0.997 | 0.997 | 0.993 | 0.995 | 0.994 |
216
+ | `ben_Beng` | Bangla | 466 | 0.997 | 0.997 | 0.989 | 0.989 | 0.974 | 0.987 | 0.982 |
217
+ | `pan_Guru` | Punjabi | 460 | 1.000 | 1.000 | 0.990 | 0.990 | 1.000 | 1.000 | 1.000 |
218
+ | `amh_Ethi` | Amharic | 458 | 1.000 | 1.000 | 0.998 | 0.998 | 0.986 | 0.987 | 0.978 |
219
+ | `tsn_Latn` | Tswana | 456 | 0.961 | 0.961 | 0.870 | 0.870 | 0.934 | 0.940 | 0.936 |
220
+ | `gaz_Latn` | Oromo (West Central) | 441 | 0.974 | 0.974 | 0.973 | 0.973 | 0.935 | 0.955 | 0.954 |
221
+ | `som_Latn` | Somali | 439 | 0.995 | 0.995 | 0.991 | 0.991 | 0.989 | 0.992 | 0.992 |
222
+ | `uzn_Latn` | Northern Uzbek | 436 | 0.999 | 0.999 | 0.985 | 0.985 | 0.978 | 0.984 | 0.983 |
223
+ | `tha_Thai` | Thai | 431 | 0.980 | 0.980 | 0.981 | 0.981 | 0.978 | 0.970 | 0.979 |
224
+ | `ydd_Hebr` | Eastern Yiddish | 430 | 1.000 | 1.000 | 0.999 | 0.999 | 0.994 | 0.998 | 0.992 |
225
+ | `tur_Latn` | Turkish | 430 | 0.999 | 0.999 | 0.980 | 0.980 | 0.969 | 0.974 | 0.977 |
226
+ | `nno_Latn` | Norwegian Nynorsk | 427 | 0.985 | 0.985 | 0.954 | 0.954 | 0.894 | 0.919 | 0.915 |
227
+
228
+ Where MillID gains most over GlotLID:
229
+
230
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
231
+ |---|---|---|---|---|---|---|---|---|---|
232
+ | `ewo_Latn` | Ewondo | 134 | 0.879 | 0.883 | 0.860 | 0.860 | 0.962 | 0.965 | 0.970 |
233
+ | `eng_Latn` | English | 1444 | 0.876 | 0.877 | 0.857 | 0.857 | 0.936 | 0.941 | 0.932 |
234
+ | `arb_Latn` | Standard Arabic | 163 | 0.906 | 0.913 | 0.852 | 0.852 | 0.957 | 0.944 | 0.933 |
235
+ | `tso_Latn` | Tsonga | 581 | 0.956 | 0.956 | 0.986 | 0.986 | 0.983 | 0.984 | 0.983 |
236
+ | `fra_Latn` | French | 1652 | 0.955 | 0.955 | 0.963 | 0.963 | 0.958 | 0.974 | 0.964 |
237
+ | `arb_Arab` | Arabic (Modern Standard) | 745 | 0.886 | 0.886 | 0.957 | 0.954 | 0.877 | 0.905 | 0.892 |
238
+ | `knc_Latn` | Central Kanuri | 293 | 0.952 | 0.952 | 0.981 | 0.981 | 0.954 | 0.959 | 0.965 |
239
+ | `bjn_Arab` | Banjar | 116 | 0.834 | 0.987 | 0.453 | 0.960 | 0.987 | 0.983 | 1.000 |
240
+ | `kmb_Latn` | Kimbundu | 119 | 0.992 | 0.992 | 0.963 | 0.963 | 0.983 | 0.983 | 1.000 |
241
+ | `kam_Latn` | Kamba | 272 | 0.972 | 0.974 | 0.863 | 0.863 | 0.982 | 0.980 | 0.974 |
242
+ | `por_Latn` | Portuguese | 657 | 0.954 | 0.956 | 0.950 | 0.949 | 0.958 | 0.963 | 0.960 |
243
+ | `san_Deva` | Sanskrit | 239 | 0.990 | 0.990 | 0.971 | 0.971 | 0.990 | 0.996 | 0.992 |
244
+ | `bug_Latn` | Buginese | 78 | 0.981 | 0.981 | 0.938 | 0.938 | 0.987 | 0.987 | 0.987 |
245
+ | `mlt_Latn` | Maltese | 291 | 0.993 | 0.993 | 0.961 | 0.961 | 0.995 | 0.997 | 0.993 |
246
+ | `tel_Telu` | Telugu | 555 | 0.998 | 0.998 | 0.999 | 0.999 | 0.999 | 1.000 | 1.000 |
247
+
248
+ Where MillID loses most to GlotLID:
249
+
250
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
251
+ |---|---|---|---|---|---|---|---|---|---|
252
+ | `tzm_Tfng` | Central Atlas Tamazight | 157 | 0.934 | 0.934 | 0.751 | 0.751 | 0.633 | 0.645 | 0.643 |
253
+ | `hrv_Latn` | Croatian | 168 | 0.994 | 0.994 | 0.856 | 0.856 | 0.667 | 0.717 | 0.657 |
254
+ | `bos_Latn` | Bosnian | 198 | 1.000 | 1.000 | 0.897 | 0.897 | 0.655 | 0.727 | 0.711 |
255
+ | `knc_Arab` | Central Kanuri | 68 | 0.857 | 0.860 | 0.029 | 0.029 | 0.583 | 0.562 | 0.626 |
256
+ | `zsm_Latn` | Standard Malay | 244 | 0.998 | 0.998 | 0.908 | 0.908 | 0.700 | 0.773 | 0.749 |
257
+ | `taq_Tfng` | Tamasheq | 104 | 0.805 | 0.805 | 0.000 | 0.000 | 0.600 | 0.613 | 0.600 |
258
+ | `ind_Latn` | Indonesian | 335 | 0.991 | 0.991 | 0.887 | 0.887 | 0.768 | 0.807 | 0.806 |
259
+ | `kin_Latn` | Kinyarwanda | 210 | 0.981 | 0.981 | 0.854 | 0.854 | 0.828 | 0.818 | 0.812 |
260
+ | `nob_Latn` | Norwegian Bokmål | 265 | 0.961 | 0.959 | 0.894 | 0.894 | 0.791 | 0.820 | 0.799 |
261
+ | `run_Latn` | Rundi | 291 | 0.985 | 0.985 | 0.855 | 0.855 | 0.837 | 0.843 | 0.845 |
262
+ | `mag_Deva` | Magahi | 97 | 1.000 | 1.000 | 0.772 | 0.772 | 0.856 | 0.905 | 0.897 |
263
+ | `vec_Latn` | Venetian | 49 | 0.861 | 0.861 | 0.620 | 0.620 | 0.745 | 0.766 | 0.696 |
264
+ | `cjk_Latn` | Chokwe | 24 | 1.000 | 1.000 | 0.807 | 0.807 | 0.769 | 0.909 | 0.800 |
265
+ | `min_Latn` | Minangkabau | 55 | 0.991 | 0.991 | 0.333 | 0.333 | 0.901 | 0.904 | 0.860 |
266
+ | `xho_Latn` | Xhosa | 367 | 0.948 | 0.948 | 0.951 | 0.951 | 0.835 | 0.862 | 0.858 |
267
+
268
+ ## Per language, udhr
269
+
270
+ Against GlotLID restricted, the best MillID is better on **77** languages and worse on **64**; against fastText restricted, the best MillID is better on **310** languages and worse on **9** (F1 differing by more than 0.01), of 358. Every language is in `leaderboard_udhr.csv`.
271
+
272
+ The 30 languages with the most passages:
273
+
274
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
275
+ |---|---|---|---|---|---|---|---|---|---|
276
+ | `roh_Latn` | Romansh | 399 | 0.999 | 0.999 | 0.946 | 0.946 | 0.989 | 0.991 | 0.994 |
277
+ | `oci_Latn` | Occitan | 398 | 0.376 | 0.376 | 0.435 | 0.435 | 0.291 | 0.331 | 0.314 |
278
+ | `cmn_Hani` | Chinese (Mandarin) | 319 | 0.868 | 0.868 | 0.468 | 0.468 | 0.875 | 0.886 | 0.857 |
279
+ | `krl_Latn` | Karelian | 183 | 0.011 | 0.011 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
280
+ | `qug_Latn` | Chimborazo Highland Quichua | 182 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 |
281
+ | `acu_Latn` | Achuar-Shiwiar | 180 | 0.854 | 0.854 | 0.000 | 0.000 | 0.850 | 0.743 | 0.732 |
282
+ | `hus_Latn` | Huastec | 175 | 0.986 | 0.986 | 0.000 | 0.000 | 0.958 | 0.991 | 0.991 |
283
+ | `hau_Latn` | Hausa | 155 | 1.000 | 1.000 | 0.876 | 0.876 | 0.997 | 0.997 | 0.997 |
284
+ | `auc_Latn` | Waorani | 154 | 0.000 | 0.000 | 0.000 | 0.000 | 0.000 | 0.050 | 0.000 |
285
+ | `kwi_Latn` | Awa-Cuaiquer | 145 | 0.877 | 0.877 | 0.000 | 0.000 | 0.771 | 0.775 | 0.797 |
286
+ | `jpn_Jpan` | Japanese | 140 | 1.000 | 1.000 | 0.944 | 0.944 | 1.000 | 1.000 | 1.000 |
287
+ | `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 |
288
+ | `ktu_Latn` | Kituba (Democratic Republic of Congo) | 118 | 0.680 | 0.680 | 0.000 | 0.000 | 0.755 | 0.769 | 0.753 |
289
+ | `lat_Latn` | Latin | 118 | 0.992 | 0.992 | 0.000 | 0.000 | 0.996 | 0.996 | 0.996 |
290
+ | `hat_Latn` | Haitian Creole | 117 | 0.979 | 0.979 | 0.699 | 0.699 | 0.987 | 0.991 | 0.987 |
291
+ | `twi_Latn` | Twi | 116 | 0.996 | 0.996 | 0.399 | 0.396 | 0.996 | 0.987 | 0.983 |
292
+ | `rmn_Latn` | Balkan Romani | 116 | 0.857 | 0.857 | 0.000 | 0.000 | 0.721 | 0.667 | 0.735 |
293
+ | `kmb_Latn` | Kimbundu | 116 | 1.000 | 1.000 | 0.877 | 0.877 | 0.991 | 0.979 | 0.991 |
294
+ | `nya_Latn` | Nyanja | 116 | 1.000 | 1.000 | 0.806 | 0.806 | 0.978 | 0.987 | 0.966 |
295
+ | `chr_Cher` | Cherokee | 115 | 0.663 | 0.663 | 0.000 | 0.000 | 0.670 | 0.715 | 0.729 |
296
+ | `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 |
297
+ | `lvs_Latn` | Standard Latvian | 115 | 1.000 | 1.000 | 0.991 | 0.991 | 0.996 | 0.996 | 0.996 |
298
+ | `kng_Latn` | Koongo | 115 | 0.193 | 0.193 | 0.457 | 0.457 | 0.101 | 0.047 | 0.101 |
299
+ | `pov_Latn` | Upper Guinea Crioulo | 115 | 0.833 | 0.833 | 0.000 | 0.000 | 0.844 | 0.838 | 0.838 |
300
+ | `por_Latn` | Portuguese | 115 | 0.996 | 0.996 | 0.793 | 0.793 | 0.978 | 0.996 | 0.983 |
301
+ | `cjk_Latn` | Chokwe | 114 | 1.000 | 1.000 | 0.533 | 0.533 | 0.888 | 0.949 | 0.949 |
302
+ | `tha_Thai` | Thai | 114 | 1.000 | 1.000 | 0.996 | 0.996 | 1.000 | 1.000 | 1.000 |
303
+ | `tso_Latn` | Tsonga | 114 | 0.781 | 0.781 | 0.691 | 0.691 | 0.743 | 0.882 | 0.843 |
304
+ | `fas_Arab` | Persian | 114 | 1.000 | 1.000 | 0.934 | 0.934 | 0.982 | 0.991 | 0.973 |
305
+ | `lin_Latn` | Lingala | 110 | 1.000 | 1.000 | 0.986 | 0.986 | 0.974 | 1.000 | 0.969 |
306
+
307
+ Where MillID gains most over GlotLID:
308
+
309
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
310
+ |---|---|---|---|---|---|---|---|---|---|
311
+ | `mic_Latn` | Mi'kmaw | 59 | 0.427 | 0.427 | 0.000 | 0.000 | 0.983 | 1.000 | 1.000 |
312
+ | `tet_Latn` | Tetum | 58 | 0.167 | 0.167 | 0.000 | 0.000 | 0.623 | 0.699 | 0.726 |
313
+ | `fuf_Latn` | Pular | 58 | 0.483 | 0.483 | 0.000 | 0.000 | 0.897 | 0.816 | 0.916 |
314
+ | `skr_Arab` | Saraiki | 63 | 0.500 | 0.500 | 0.000 | 0.000 | 0.800 | 0.923 | 0.855 |
315
+ | `sag_Latn` | Sango | 59 | 0.578 | 0.578 | 0.189 | 0.189 | 0.992 | 0.992 | 0.992 |
316
+ | `bum_Latn` | Bulu | 58 | 0.098 | 0.098 | 0.000 | 0.000 | 0.242 | 0.319 | 0.474 |
317
+ | `zgh_Tfng` | Standard Moroccan Tamazight | 60 | 0.462 | 0.462 | 0.000 | 0.000 | 0.518 | 0.824 | 0.737 |
318
+ | `tzm_Tfng` | Central Atlas Tamazight | 1 | 0.065 | 0.065 | 0.033 | 0.033 | 0.100 | 0.333 | 0.143 |
319
+ | `snn_Latn` | Siona | 136 | 0.514 | 0.514 | 0.000 | 0.000 | 0.393 | 0.773 | 0.621 |
320
+ | `mxv_Latn` | Metlatónoc Mixtec | 58 | 0.000 | 0.000 | 0.000 | 0.000 | 0.098 | 0.215 | 0.034 |
321
+ | `lld_Latn` | Ladin | 59 | 0.731 | 0.731 | 0.000 | 0.000 | 0.946 | 0.899 | 0.816 |
322
+ | `pnb_Arab` | Western Panjabi | 61 | 0.739 | 0.739 | 0.000 | 0.000 | 0.845 | 0.931 | 0.884 |
323
+ | `fkv_Latn` | Kven Finnish | 58 | 0.667 | 0.667 | 0.000 | 0.000 | 0.792 | 0.697 | 0.852 |
324
+ | `tah_Latn` | Tahitian | 57 | 0.812 | 0.812 | 0.966 | 0.966 | 0.944 | 0.973 | 0.982 |
325
+ | `yue_Hani` | Cantonese | 49 | 0.580 | 0.580 | 0.111 | 0.111 | 0.747 | 0.652 | 0.571 |
326
+
327
+ Where MillID loses most to GlotLID:
328
+
329
+ | Label | Language | Passages | GlotLID | GlotLID restricted | fastText | fastText restricted | MillID tiny | MillID medium | MillID large |
330
+ |---|---|---|---|---|---|---|---|---|---|
331
+ | `dyu_Latn` | Dyula | 58 | 0.434 | 0.434 | 0.015 | 0.015 | 0.000 | 0.000 | 0.000 |
332
+ | `gyr_Latn` | Guarayu | 49 | 0.990 | 0.990 | 0.000 | 0.000 | 0.580 | 0.339 | 0.182 |
333
+ | `ell_Grek` | Greek | 115 | 1.000 | 1.000 | 1.000 | 1.000 | 0.670 | 0.655 | 0.670 |
334
+ | `qvm_Latn` | Margos-Yarowilca-Lauricocha Quechua | 60 | 0.500 | 0.500 | 0.000 | 0.000 | 0.125 | 0.094 | 0.182 |
335
+ | `hin_Deva` | Hindi | 59 | 0.957 | 0.957 | 0.975 | 0.975 | 0.644 | 0.607 | 0.450 |
336
+ | `cpu_Latn` | Pichis Ashéninka | 60 | 0.974 | 0.974 | 0.000 | 0.000 | 0.659 | 0.571 | 0.667 |
337
+ | `ind_Latn` | Indonesian | 60 | 0.903 | 0.903 | 0.565 | 0.565 | 0.614 | 0.674 | 0.644 |
338
+ | `cni_Latn` | Asháninka | 52 | 0.963 | 0.963 | 0.000 | 0.000 | 0.750 | 0.708 | 0.748 |
339
+ | `cbu_Latn` | Candoshi-Shapra | 57 | 0.882 | 0.874 | 0.000 | 0.000 | 0.667 | 0.371 | 0.185 |
340
+ | `qvn_Latn` | North Junín Quechua | 57 | 0.460 | 0.460 | 0.000 | 0.000 | 0.261 | 0.219 | 0.095 |
341
+ | `fuv_Latn` | Nigerian Fulfulde | 108 | 0.681 | 0.689 | 0.475 | 0.475 | 0.510 | 0.405 | 0.519 |
342
+ | `koi_Cyrl` | Komi-Permyak | 57 | 1.000 | 1.000 | 0.000 | 0.000 | 0.719 | 0.837 | 0.849 |
343
+ | `bho_Deva` | Bhojpuri | 56 | 0.933 | 0.933 | 0.832 | 0.832 | 0.787 | 0.643 | 0.697 |
344
+ | `hrv_Latn` | Croatian | 58 | 0.727 | 0.727 | 0.474 | 0.474 | 0.497 | 0.537 | 0.583 |
345
+ | `kea_Latn` | Kabuverdianu | 58 | 0.935 | 0.935 | 0.125 | 0.124 | 0.811 | 0.794 | 0.800 |
346
+
347
+ The models: [MillID tiny](https://huggingface.co/baobabtech/millid-tiny), [MillID medium](https://huggingface.co/baobabtech/millid-medium), [MillID large](https://huggingface.co/baobabtech/millid-large).
leaderboard_overall.csv ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ set,model,repo,size,top1_accuracy,top3_accuracy,top5_accuracy,macro_precision,macro_recall,macro_f1,median_f1,languages_f1_at_least_0_9,languages
2
+ test,MillID tiny,baobabtech/millid-tiny,2.9M,0.9555030157217128,0.9884449365428882,0.9929362598390783,0.9526668942822866,0.9552731489219365,0.9523793552235162,0.9801980198019801,1428,1621
3
+ test,GlotLID,cis-lmu/glotlid,"fastText, 1.7 GB",0.977614145795264,0.9977189572137978,0.9983766301339072,0.9782517709855841,0.9751782136320077,0.9748179587217549,1.0,1488,1621
4
+ test,"GlotLID, restricted to MillID's labels",cis-lmu/glotlid,"fastText, 1.7 GB",0.978292631149554,0.9977897194900122,0.9984557173837938,0.9778492893480586,0.9764998669631992,0.9754780061637239,1.0,1490,1621
5
+ test,"fastText (Meta, NLLB)",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.25110201838986684,0.2610045745730329,0.262482257399861,0.05202750834127428,0.12048375928156996,0.06567764337804372,0.0,25,1621
6
+ test,"fastText, restricted to MillID's labels",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.2514599922577745,0.2610753368492472,0.2625197197813862,0.05205991842533006,0.12089826722608317,0.06593662879256669,0.0,26,1621
7
+ test-common,MillID tiny,baobabtech/millid-tiny,2.9M,0.9353685155657383,0.9848135362323328,0.9904175116491478,0.9660575837196331,0.9296483535685888,0.9457638050058335,0.9693593314763231,185,213
8
+ test-common,GlotLID,cis-lmu/glotlid,"fastText, 1.7 GB",0.9738223137297398,0.9924609501989257,0.9946437141043701,0.9924377815827973,0.9770740040297234,0.9835053354686013,0.9982788296041308,201,213
9
+ test-common,"GlotLID, restricted to MillID's labels",cis-lmu/glotlid,"fastText, 1.7 GB",0.9749369165750732,0.9926931591250368,0.994829481245259,0.9922871273519716,0.9790381188248578,0.9845885184031669,0.9983471074380166,203,213
10
+ test-common,"fastText (Meta, NLLB)",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.9338668978435531,0.9706952335247767,0.9761908447760732,0.9356570616737796,0.9169210037343893,0.9148824189777787,0.9680365296803652,165,213
11
+ test-common,"fastText, restricted to MillID's labels",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.9351982290199236,0.9709584036410359,0.9763301701317398,0.9353710554982398,0.9200755454154029,0.9173068426975766,0.9680365296803652,166,213
12
+ udhr,MillID tiny,baobabtech/millid-tiny,2.9M,0.8422587598799611,0.9133944799019401,0.9274271947250518,0.9042851534127834,0.8684660374682479,0.8697706233854194,0.9845569018769303,274,358
13
+ udhr,GlotLID,cis-lmu/glotlid,"fastText, 1.7 GB",0.8598419206221734,0.9279766684982459,0.9420516505346802,0.9261030959501081,0.8825915640670888,0.8864649884094992,0.9915248150542268,287,358
14
+ udhr,"GlotLID, restricted to MillID's labels",cis-lmu/glotlid,"fastText, 1.7 GB",0.8614480747284331,0.9294137537512152,0.943319666934359,0.9257695969546421,0.8844312457708232,0.8873151713293488,0.9915248150542268,291,358
15
+ udhr,"fastText (Meta, NLLB)",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.4624878481761697,0.4856502810769686,0.49034194175578005,0.31521227915727285,0.4478627321056064,0.3496561644788506,0.0,60,358
16
+ udhr,"fastText, restricted to MillID's labels",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.4628682530960734,0.4856502810769686,0.4904264761824253,0.3151627394343268,0.4483116546914005,0.34986047374808604,0.0,61,358
17
+ udhr-common,MillID tiny,baobabtech/millid-tiny,2.9M,0.9082283795130143,0.9581024349286315,0.964063811922754,0.9777246258536298,0.9371042669433332,0.9488557553664688,0.9916660879227723,151,170
18
+ udhr-common,GlotLID,cis-lmu/glotlid,"fastText, 1.7 GB",0.9335852225020991,0.9677581863979848,0.973215785054576,0.9887806114106193,0.9575995164374027,0.9657221446088623,1.0,155,170
19
+ udhr-common,"GlotLID, restricted to MillID's labels",cis-lmu/glotlid,"fastText, 1.7 GB",0.9338371116708648,0.9682619647355164,0.9735516372795969,0.9887806114106193,0.9578604445634422,0.9658801542070193,1.0,156,170
20
+ udhr-common,"fastText (Meta, NLLB)",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.9187237615449202,0.964735516372796,0.9740554156171285,0.9473808585265043,0.9431462240812183,0.9323102708833079,1.0,141,170
21
+ udhr-common,"fastText, restricted to MillID's labels",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.9194794290512175,0.964735516372796,0.974223341729639,0.9473808585265043,0.9440916022324787,0.9328542536140149,1.0,142,170
22
+ udhr-all,MillID tiny,baobabtech/millid-tiny,2.9M,0.7213915939615537,0.7823190819244832,0.794338051623647,0.7256409354705163,0.724733896069074,0.7099014209433365,0.9583333333333334,255,429
23
+ udhr-all,GlotLID,cis-lmu/glotlid,"fastText, 1.7 GB",0.750244361582739,0.8144662056981501,0.8281866560474966,0.7694575973118034,0.7529055089081532,0.7454327849166208,0.9795918367346939,277,429
24
+ udhr-all,"GlotLID, restricted to MillID's labels",cis-lmu/glotlid,"fastText, 1.7 GB",0.7378271730080006,0.7960395322738297,0.8079498968251095,0.7425329775774382,0.7380568437901042,0.724506747472521,0.9747899159663865,272,429
25
+ udhr-all,"fastText (Meta, NLLB)",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.3961191760489447,0.4159577163957572,0.4199761068674655,0.24791077144530446,0.3737409279575923,0.279501714390051,0.0,54,429
26
+ udhr-all,"fastText, restricted to MillID's labels",facebook/fasttext-language-identification,"fastText, 1.2 GB",0.39644499149259677,0.4159577163957572,0.42004851029938817,0.2478791005299098,0.3741155533322177,0.27967804305179117,0.0,55,429
27
+ test,MillID medium,baobabtech/millid-medium,115.0M,0.9616468462918486,0.9910007034602754,0.9945180048368097,0.9564228576676835,0.9614016943550959,0.9575764452347921,0.9841269841269842,1451,1621
28
+ test-common,MillID medium,baobabtech/millid-medium,115.0M,0.9424741087047386,0.988172825363407,0.9923525860334071,0.9732280825173869,0.9360723187927141,0.9527046866271709,0.9738219895287958,191,213
29
+ udhr,MillID medium,baobabtech/millid-medium,115.0M,0.8524028910773913,0.9194386914070756,0.9340208800033813,0.9186545076419138,0.8769388469921001,0.8779986710808113,0.9909909909909909,282,358
30
+ udhr-common,MillID medium,baobabtech/millid-medium,115.0M,0.9120906801007557,0.9633081444164567,0.9688497061293031,0.9770201360820081,0.9382111759192128,0.947989665742032,0.9955099164401491,153,170
31
+ udhr-all,MillID medium,baobabtech/millid-medium,115.0M,0.7300800057922745,0.7874959273069544,0.7999855193136155,0.7415286668963516,0.731804445741659,0.718364827833673,0.9672131147540983,266,429
32
+ test,MillID large,baobabtech/millid-large,192.6M,0.9602482507149072,0.9912587776441157,0.9947511040996333,0.9559036355479716,0.9600643840879677,0.9565531272722871,0.9844097995545658,1444,1621
33
+ test-common,MillID large,baobabtech/millid-large,192.6M,0.9401365388485533,0.9884824372648885,0.9928789262659257,0.9705884030398076,0.9336637416047967,0.9501275801789851,0.9734513274336283,185,213
34
+ udhr,MillID large,baobabtech/millid-large,192.6M,0.8501627287712921,0.9168181241810728,0.928652943911408,0.9119599467677029,0.8756693668405147,0.8755434870560866,0.9912273951519814,273,358
35
+ udhr-common,MillID large,baobabtech/millid-large,192.6M,0.9074727120067171,0.9614609571788413,0.9665827036104114,0.9734869274166918,0.9340443413049637,0.9443039665233331,0.9924238076106295,148,170
36
+ udhr-all,MillID large,baobabtech/millid-large,192.6M,0.7281613148463237,0.7852514209173515,0.7953879013865257,0.7343781921576387,0.7307450660347418,0.7152922540753559,0.9640287769784173,254,429
leaderboard_test-common.csv ADDED
@@ -0,0 +1,214 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
2
+ fra_Latn,French,1652,0.9548,0.9548,0.9632,0.9632,0.9583,0.9737,0.9636,0.9737,MillID medium,0.0189,0.0105
3
+ eng_Latn,English,1444,0.876,0.8768,0.8574,0.8571,0.9357,0.9414,0.9321,0.9414,MillID medium,0.0646,0.0843
4
+ spa_Latn,Spanish,1136,0.9583,0.9583,0.9407,0.9407,0.9434,0.953,0.9575,0.9575,MillID large,-0.0008,0.0168
5
+ tam_Taml,Tamil,754,1.0,1.0,0.9973,0.9973,0.9993,0.998,0.998,0.9993,MillID tiny,-0.0007,0.002
6
+ arb_Arab,Arabic (Modern Standard),745,0.8864,0.8864,0.9573,0.9542,0.8774,0.905,0.8919,0.905,MillID medium,0.0186,-0.0492
7
+ por_Latn,Portuguese,657,0.9538,0.9562,0.95,0.9493,0.9581,0.9628,0.9601,0.9628,MillID medium,0.0066,0.0135
8
+ kan_Knda,Kannada,601,0.9941,0.9941,0.9992,0.9992,0.9822,0.9865,0.9908,0.9908,MillID large,-0.0033,-0.0084
9
+ zul_Latn,Zulu,594,0.9042,0.9042,0.9704,0.9704,0.8449,0.8713,0.8295,0.8713,MillID medium,-0.0329,-0.0991
10
+ swh_Latn,Swahili,592,0.9536,0.9528,0.9454,0.9454,0.9021,0.8967,0.9019,0.9021,MillID tiny,-0.0507,-0.0433
11
+ mar_Deva,Marathi,589,0.9888,0.9897,0.9871,0.9871,0.9705,0.9811,0.9744,0.9811,MillID medium,-0.0086,-0.006
12
+ tso_Latn,Tsonga,581,0.956,0.956,0.9861,0.9861,0.9834,0.9843,0.9834,0.9843,MillID medium,0.0283,-0.0018
13
+ hun_Latn,Hungarian,576,1.0,1.0,0.9804,0.9804,0.9826,0.9913,0.9913,0.9913,MillID medium,-0.0087,0.0109
14
+ afr_Latn,Afrikaans,569,0.9849,0.9849,0.9858,0.9858,0.9781,0.976,0.9816,0.9816,MillID large,-0.0033,-0.0042
15
+ tel_Telu,Telugu,555,0.9982,0.9982,0.9991,0.9991,0.9991,1.0,1.0,1.0,MillID medium,0.0018,0.0009
16
+ rus_Cyrl,Russian,528,0.9846,0.9846,0.9271,0.9271,0.9242,0.9291,0.9557,0.9557,MillID large,-0.0289,0.0286
17
+ ory_Orya,Odia (individual language),511,0.9971,1.0,0.9961,0.9961,0.9961,0.9961,0.9961,0.9961,MillID tiny,-0.0039,0.0
18
+ sot_Latn,Southern Sotho,491,0.9774,0.9784,0.8562,0.8562,0.9703,0.9665,0.9671,0.9703,MillID tiny,-0.0081,0.1141
19
+ nso_Latn,Northern Sotho,479,0.9695,0.9695,0.9673,0.9673,0.9471,0.9614,0.9521,0.9614,MillID medium,-0.0081,-0.0059
20
+ asm_Beng,Assamese,467,0.9989,0.9989,0.9968,0.9968,0.9925,0.9946,0.9936,0.9946,MillID medium,-0.0043,-0.0022
21
+ ben_Beng,Bangla,466,0.9968,0.9968,0.9894,0.9894,0.9737,0.9871,0.9817,0.9871,MillID medium,-0.0097,-0.0023
22
+ pan_Guru,Punjabi,460,1.0,1.0,0.9901,0.9901,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0099
23
+ amh_Ethi,Amharic,458,1.0,1.0,0.9978,0.9978,0.9857,0.9869,0.9781,0.9869,MillID medium,-0.0131,-0.0109
24
+ tsn_Latn,Tswana,456,0.9605,0.9605,0.8698,0.8698,0.9336,0.9397,0.9365,0.9397,MillID medium,-0.0208,0.0699
25
+ gaz_Latn,Oromo (West Central),441,0.9744,0.9744,0.9733,0.9733,0.9349,0.9552,0.9541,0.9552,MillID medium,-0.0192,-0.0181
26
+ som_Latn,Somali,439,0.9954,0.9954,0.9909,0.9909,0.9885,0.992,0.992,0.992,MillID medium,-0.0034,0.0011
27
+ uzn_Latn,Northern Uzbek,436,0.9989,0.9989,0.9849,0.9849,0.9779,0.9838,0.9825,0.9838,MillID medium,-0.0151,-0.0011
28
+ tha_Thai,Thai,431,0.9799,0.9799,0.9811,0.9811,0.9775,0.9701,0.9787,0.9787,MillID large,-0.0012,-0.0024
29
+ ydd_Hebr,Eastern Yiddish,430,1.0,1.0,0.9988,0.9988,0.9942,0.9977,0.9918,0.9977,MillID medium,-0.0023,-0.0011
30
+ tur_Latn,Turkish,430,0.9988,0.9988,0.9803,0.9803,0.9685,0.9742,0.9766,0.9766,MillID large,-0.0222,-0.0037
31
+ nno_Latn,Norwegian Nynorsk,427,0.9845,0.9845,0.9542,0.9542,0.8945,0.9189,0.9147,0.9189,MillID medium,-0.0656,-0.0353
32
+ smo_Latn,Samoan,426,0.9988,0.9988,0.9372,0.9372,0.9929,0.9917,0.9976,0.9976,MillID large,-0.0012,0.0604
33
+ pap_Latn,Papiamento,423,0.9988,0.9988,0.9742,0.9731,0.9623,0.9709,0.9712,0.9712,MillID large,-0.0276,-0.0019
34
+ ckb_Arab,Central Kurdish,421,0.9769,0.9769,0.9952,0.9952,0.9695,0.9619,0.9316,0.9695,MillID tiny,-0.0074,-0.0257
35
+ pbt_Arab,Southern Pashto,419,0.9988,0.9988,0.9782,0.977,0.9844,0.994,0.9892,0.994,MillID medium,-0.0048,0.017
36
+ ekk_Latn,Estonian,419,0.9929,0.9929,0.9857,0.9857,0.9721,0.9806,0.9732,0.9806,MillID medium,-0.0123,-0.0051
37
+ sna_Latn,Shona,415,1.0,1.0,0.9831,0.9831,0.9766,0.9779,0.9716,0.9779,MillID medium,-0.0221,-0.0052
38
+ luo_Latn,Luo (Kenya and Tanzania),415,1.0,1.0,0.9564,0.9564,0.9791,0.9841,0.9853,0.9853,MillID large,-0.0147,0.0289
39
+ tgk_Cyrl,Tajik,413,1.0,1.0,0.983,0.983,0.9927,0.9927,0.9927,0.9927,MillID tiny,-0.0073,0.0097
40
+ bod_Tibt,Tibetan,406,0.9988,0.9988,0.8191,0.8191,0.932,0.9503,0.9403,0.9503,MillID medium,-0.0485,0.1312
41
+ lug_Latn,Ganda,405,0.9863,0.9876,0.979,0.979,0.9684,0.9748,0.9735,0.9748,MillID medium,-0.0128,-0.0042
42
+ fas_Arab,Persian,396,0.9859,0.9859,0.9439,0.9439,0.9301,0.9342,0.9516,0.9516,MillID large,-0.0343,0.0077
43
+ ell_Grek,Greek,394,0.9987,0.9987,0.97,0.97,0.9493,0.9086,0.9423,0.9493,MillID tiny,-0.0494,-0.0207
44
+ hin_Deva,Hindi,392,0.8768,0.8768,0.863,0.863,0.8179,0.8171,0.8358,0.8358,MillID large,-0.041,-0.0272
45
+ lus_Latn,Mizo,391,0.9974,0.9974,0.9897,0.9897,0.9739,0.9738,0.9764,0.9764,MillID large,-0.021,-0.0133
46
+ dyu_Latn,Dyula,390,1.0,1.0,0.8223,0.8223,0.9564,0.9729,0.9703,0.9729,MillID medium,-0.0271,0.1506
47
+ slk_Latn,Slovak,374,0.9987,0.9987,0.9714,0.9714,0.9418,0.9486,0.9404,0.9486,MillID medium,-0.0501,-0.0228
48
+ ron_Latn,Romanian,369,0.9959,0.9959,0.9759,0.9759,0.9712,0.9755,0.9632,0.9755,MillID medium,-0.0204,-0.0004
49
+ kal_Latn,Kalaallisut,369,0.9986,0.9986,0.9932,0.9932,0.9946,0.9986,0.9986,0.9986,MillID medium,0.0,0.0054
50
+ azb_Arab,South Azerbaijani,369,0.9959,0.9959,0.9711,0.9711,0.9583,0.9622,0.9565,0.9622,MillID medium,-0.0337,-0.0089
51
+ fin_Latn,Finnish,368,1.0,1.0,0.9946,0.9946,0.9358,0.9548,0.8949,0.9548,MillID medium,-0.0452,-0.0398
52
+ hau_Latn,Hausa,367,0.9932,0.9932,0.9851,0.9837,0.9694,0.9753,0.9767,0.9767,MillID large,-0.0165,-0.007
53
+ xho_Latn,Xhosa,367,0.9481,0.9481,0.9511,0.9511,0.8352,0.8617,0.8584,0.8617,MillID medium,-0.0864,-0.0894
54
+ kng_Latn,Koongo,362,1.0,1.0,0.9718,0.9718,0.9432,0.9322,0.9525,0.9525,MillID large,-0.0475,-0.0193
55
+ twi_Latn,Twi,359,0.9916,0.9902,0.9684,0.9684,0.9759,0.9744,0.9688,0.9759,MillID tiny,-0.0143,0.0075
56
+ deu_Latn,German,356,0.9972,0.9972,0.9889,0.9889,0.9688,0.9597,0.9434,0.9688,MillID tiny,-0.0284,-0.0201
57
+ guj_Gujr,Gujarati,354,1.0,1.0,0.9842,0.9842,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0158
58
+ dik_Latn,Southwestern Dinka,350,1.0,1.0,0.99,0.99,0.9826,0.9957,0.9884,0.9957,MillID medium,-0.0043,0.0057
59
+ lua_Latn,Luba-Lulua,346,0.9971,0.9971,0.9633,0.9633,0.9719,0.9809,0.9898,0.9898,MillID large,-0.0073,0.0265
60
+ dzo_Tibt,Dzongkha,346,0.9986,0.9986,0.6958,0.6958,0.8946,0.9265,0.8964,0.9265,MillID medium,-0.0721,0.2307
61
+ che_Cyrl,Chechen,345,1.0,1.0,0.984,0.984,0.9734,0.9898,0.9942,0.9942,MillID large,-0.0058,0.0102
62
+ fij_Latn,Fijian,344,1.0,1.0,0.9884,0.9884,0.9971,0.9942,0.9927,0.9971,MillID tiny,-0.0029,0.0087
63
+ ita_Latn,Italian,342,0.9838,0.9838,0.949,0.949,0.9278,0.9259,0.9517,0.9517,MillID large,-0.0321,0.0027
64
+ mya_Mymr,Burmese,342,1.0,1.0,0.9897,0.9897,0.9792,0.9912,0.9838,0.9912,MillID medium,-0.0088,0.0015
65
+ kaz_Cyrl,Kazakh,340,1.0,1.0,0.9926,0.9926,0.9807,0.9852,0.9881,0.9881,MillID large,-0.0119,-0.0045
66
+ tir_Ethi,Tigrinya,339,0.9881,0.9985,0.9956,0.9956,0.9853,0.9745,0.976,0.9853,MillID tiny,-0.0132,-0.0103
67
+ mal_Mlym,Malayalam,338,1.0,1.0,0.994,0.994,1.0,0.9985,1.0,1.0,MillID tiny,0.0,0.006
68
+ hat_Latn,Haitian Creole,338,0.997,0.997,0.9774,0.9774,0.9851,0.982,0.9956,0.9956,MillID large,-0.0014,0.0182
69
+ ceb_Latn,Cebuano,338,1.0,1.0,0.9926,0.9926,0.9758,0.9851,0.9713,0.9851,MillID medium,-0.0149,-0.0075
70
+ vie_Latn,Vietnamese,338,1.0,1.0,0.9836,0.9836,0.9521,0.9521,0.9711,0.9711,MillID large,-0.0289,-0.0125
71
+ slv_Latn,Slovenian,338,0.9927,0.9927,0.9653,0.9653,0.9501,0.9669,0.9577,0.9669,MillID medium,-0.0258,0.0016
72
+ lao_Laoo,Lao,335,1.0,1.0,0.991,0.991,0.9955,0.9985,0.9955,0.9985,MillID medium,-0.0015,0.0075
73
+ chv_Cyrl,Chuvash,335,1.0,1.0,0.9926,0.9926,0.994,0.9955,0.997,0.997,MillID large,-0.003,0.0044
74
+ ind_Latn,Indonesian,335,0.9911,0.9911,0.8873,0.8873,0.7677,0.8067,0.8058,0.8067,MillID medium,-0.1844,-0.0806
75
+ uig_Arab,Uyghur,334,1.0,1.0,0.9911,0.9911,0.994,0.9925,0.9955,0.9955,MillID large,-0.0045,0.0044
76
+ oci_Latn,Occitan,333,0.9911,0.9911,0.9619,0.9619,0.9515,0.954,0.9552,0.9552,MillID large,-0.0359,-0.0067
77
+ mkd_Cyrl,Macedonian,331,1.0,1.0,0.9924,0.9924,0.9686,0.9685,0.9607,0.9686,MillID tiny,-0.0314,-0.0238
78
+ lit_Latn,Lithuanian,330,0.9955,0.9955,0.974,0.974,0.9755,0.9848,0.9909,0.9909,MillID large,-0.0046,0.0169
79
+ swe_Latn,Swedish,328,0.9717,0.9717,0.9767,0.9767,0.9288,0.9538,0.963,0.963,MillID large,-0.0087,-0.0137
80
+ snd_Arab,Sindhi,325,1.0,1.0,0.9848,0.9833,0.9845,0.9938,0.9954,0.9954,MillID large,-0.0046,0.0121
81
+ kat_Geor,Georgian,324,1.0,1.0,0.9859,0.9859,0.9829,0.9892,0.9876,0.9892,MillID medium,-0.0108,0.0033
82
+ jpn_Jpan,Japanese,323,0.9969,0.9969,0.8684,0.8684,0.9713,0.9746,0.9763,0.9763,MillID large,-0.0206,0.1079
83
+ ssw_Latn,Swati,322,0.9684,0.97,0.9721,0.9721,0.9382,0.9525,0.9492,0.9525,MillID medium,-0.0175,-0.0196
84
+ ukr_Cyrl,Ukrainian,322,1.0,1.0,0.9783,0.9783,0.9583,0.9762,0.9664,0.9762,MillID medium,-0.0238,-0.0021
85
+ szl_Latn,Silesian,320,0.9969,0.9969,0.9254,0.9254,0.9615,0.9688,0.9668,0.9688,MillID medium,-0.0281,0.0434
86
+ cat_Latn,Catalan,318,0.9845,0.9845,0.9528,0.9528,0.9551,0.9662,0.9554,0.9662,MillID medium,-0.0183,0.0134
87
+ ayr_Latn,Central Aymara,309,1.0,1.0,0.9752,0.9752,0.9935,0.9935,0.9935,0.9935,MillID tiny,-0.0065,0.0183
88
+ yor_Latn,Yoruba,308,0.9984,0.9984,0.9683,0.9683,0.9886,0.9885,0.9885,0.9886,MillID tiny,-0.0098,0.0203
89
+ ewe_Latn,Ewe,308,1.0,1.0,0.9852,0.9852,0.9885,0.9869,0.9935,0.9935,MillID large,-0.0065,0.0083
90
+ roh_Latn,Romansh,307,1.0,1.0,0.9742,0.9742,0.9854,0.9854,0.9869,0.9869,MillID large,-0.0131,0.0127
91
+ mni_Beng,Manipuri,304,1.0,1.0,0.9499,0.9499,0.941,0.9573,0.9535,0.9573,MillID medium,-0.0427,0.0074
92
+ tpi_Latn,Tok Pisin,302,0.9983,0.9983,0.9867,0.9867,0.9933,0.9967,0.9934,0.9967,MillID medium,-0.0016,0.01
93
+ lvs_Latn,Standard Latvian,298,0.995,0.995,0.9472,0.9472,0.9626,0.9696,0.9746,0.9746,MillID large,-0.0204,0.0274
94
+ ton_Latn,Tongan,298,1.0,1.0,0.0,0.0,0.9966,0.9915,0.9949,0.9966,MillID tiny,-0.0034,0.9966
95
+ epo_Latn,Esperanto,294,0.9983,0.9983,0.9882,0.9882,0.9759,0.9724,0.988,0.988,MillID large,-0.0103,-0.0002
96
+ knc_Latn,Central Kanuri,293,0.9517,0.9517,0.9811,0.9811,0.9541,0.9594,0.9648,0.9648,MillID large,0.0131,-0.0163
97
+ run_Latn,Rundi,291,0.9848,0.9848,0.8545,0.8545,0.8372,0.8425,0.8454,0.8454,MillID large,-0.1394,-0.0091
98
+ mlt_Latn,Maltese,291,0.9932,0.9932,0.9614,0.9614,0.9948,0.9966,0.9931,0.9966,MillID medium,0.0034,0.0352
99
+ bho_Deva,Bhojpuri,290,0.9983,0.9983,0.8732,0.8732,0.9387,0.9453,0.9302,0.9453,MillID medium,-0.053,0.0721
100
+ bak_Cyrl,Bashkir,289,1.0,1.0,0.9846,0.9846,0.9879,0.9842,0.9861,0.9879,MillID tiny,-0.0121,0.0033
101
+ kmr_Latn,Northern Kurdish,289,1.0,1.0,0.9747,0.9747,0.942,0.9718,0.942,0.9718,MillID medium,-0.0282,-0.0029
102
+ bul_Cyrl,Bulgarian,289,1.0,1.0,0.9827,0.9827,0.941,0.9532,0.9666,0.9666,MillID large,-0.0334,-0.0161
103
+ cmn_Hani,Chinese (Mandarin),288,0.9663,0.9663,0.4884,0.4884,0.8978,0.8913,0.8889,0.8978,MillID tiny,-0.0685,0.4094
104
+ bam_Latn,Bambara,287,0.9983,0.9983,0.7923,0.7923,0.9535,0.9615,0.955,0.9615,MillID medium,-0.0368,0.1692
105
+ abk_Cyrl,Abkhazian,285,1.0,1.0,1.0,1.0,1.0,0.9982,1.0,1.0,MillID tiny,0.0,0.0
106
+ bxr_Cyrl,Russia Buriat,277,1.0,1.0,0.9387,0.9387,0.9798,0.9726,0.9835,0.9835,MillID large,-0.0165,0.0448
107
+ isl_Latn,Icelandic,276,1.0,1.0,0.7886,0.7886,0.9616,0.9683,0.9567,0.9683,MillID medium,-0.0317,0.1797
108
+ lmo_Latn,Lombard,276,0.9875,0.9875,0.9097,0.9081,0.9011,0.9199,0.8998,0.9199,MillID medium,-0.0676,0.0118
109
+ npi_Deva,Nepali,273,0.9908,0.9927,0.9745,0.9745,0.9594,0.9703,0.9551,0.9703,MillID medium,-0.0224,-0.0042
110
+ kam_Latn,Kamba,272,0.9716,0.9736,0.8625,0.8625,0.9815,0.9795,0.9741,0.9815,MillID tiny,0.0079,0.119
111
+ quy_Latn,Ayacucho Quechua,271,0.9246,0.9331,0.9794,0.9794,0.9203,0.9289,0.9267,0.9289,MillID medium,-0.0042,-0.0505
112
+ srp_Cyrl,Serbian,269,1.0,1.0,0.9834,0.9834,0.9681,0.9774,0.9725,0.9774,MillID medium,-0.0226,-0.006
113
+ nob_Latn,Norwegian Bokmål,265,0.9612,0.9594,0.8942,0.8942,0.7906,0.8195,0.7992,0.8195,MillID medium,-0.1399,-0.0747
114
+ kor_Hang,Korean,265,1.0,1.0,0.8237,0.8237,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1763
115
+ tum_Latn,Tumbuka,265,0.9962,0.9962,0.9662,0.9662,0.955,0.9569,0.9691,0.9691,MillID large,-0.0271,0.0029
116
+ khk_Cyrl,Halh Mongolian,262,1.0,1.0,0.9205,0.9205,0.9751,0.9735,0.9886,0.9886,MillID large,-0.0114,0.0681
117
+ nya_Latn,Nyanja,262,0.9786,0.9786,0.9259,0.9259,0.9364,0.9553,0.9502,0.9553,MillID medium,-0.0233,0.0294
118
+ nld_Latn,Dutch,259,0.9719,0.9719,0.9597,0.9597,0.9428,0.9435,0.9558,0.9558,MillID large,-0.0161,-0.0039
119
+ ltg_Latn,Latgalian,259,0.9981,0.9981,0.9647,0.9647,0.9572,0.9674,0.9608,0.9674,MillID medium,-0.0307,0.0027
120
+ ibo_Latn,Igbo,257,0.9981,0.9981,0.9922,0.9922,0.9843,0.9922,0.9942,0.9942,MillID large,-0.0039,0.002
121
+ bis_Latn,Bislama,257,1.0,1.0,0.9681,0.9681,0.9941,0.9882,0.9862,0.9941,MillID tiny,-0.0059,0.026
122
+ urd_Arab,Urdu,257,1.0,1.0,0.9345,0.9345,0.9625,0.9704,0.9747,0.9747,MillID large,-0.0253,0.0402
123
+ pol_Latn,Polish,254,0.9844,0.9844,0.92,0.92,0.9569,0.9644,0.957,0.9644,MillID medium,-0.02,0.0444
124
+ eus_Latn,Basque,254,0.9922,0.9922,0.9862,0.9862,0.9821,0.9841,0.984,0.9841,MillID medium,-0.0081,-0.0021
125
+ ilo_Latn,Iloko,252,1.0,1.0,0.9735,0.9735,0.99,0.986,0.9921,0.9921,MillID large,-0.0079,0.0186
126
+ ltz_Latn,Luxembourgish,251,1.0,1.0,0.9544,0.9544,0.9757,0.9839,0.9817,0.9839,MillID medium,-0.0161,0.0295
127
+ pcm_Latn,Nigerian Pidgin,251,0.838,0.8559,0.5015,0.5407,0.8228,0.8344,0.7974,0.8344,MillID medium,-0.0215,0.2937
128
+ arn_Latn,Mapuche,250,1.0,1.0,0.9585,0.9585,0.996,0.994,1.0,1.0,MillID large,0.0,0.0415
129
+ plt_Latn,Malagasy (Plateau),248,0.998,0.998,0.9818,0.9818,0.9773,0.9836,0.9795,0.9836,MillID medium,-0.0144,0.0018
130
+ lij_Latn,Ligurian,245,0.998,0.998,0.8571,0.8571,0.9454,0.9552,0.9362,0.9552,MillID medium,-0.0428,0.0981
131
+ ast_Latn,Asturian,244,0.9702,0.9702,0.9333,0.9333,0.9231,0.9189,0.9389,0.9389,MillID large,-0.0313,0.0056
132
+ zsm_Latn,Standard Malay,244,0.998,0.998,0.9079,0.9079,0.7002,0.7726,0.7485,0.7726,MillID medium,-0.2254,-0.1353
133
+ nia_Latn,Nias,242,1.0,1.0,0.9876,0.9876,0.9855,0.9938,0.9897,0.9938,MillID medium,-0.0062,0.0062
134
+ dan_Latn,Danish,242,0.9499,0.9499,0.9623,0.9623,0.8589,0.8766,0.8884,0.8884,MillID large,-0.0615,-0.0739
135
+ kir_Cyrl,Kyrgyz,242,1.0,1.0,0.9279,0.9279,0.9772,0.9835,0.9854,0.9854,MillID large,-0.0146,0.0575
136
+ tah_Latn,Tahitian,242,1.0,1.0,0.9917,0.9917,0.9854,0.9855,0.9979,0.9979,MillID large,-0.0021,0.0062
137
+ san_Deva,Sanskrit,239,0.9895,0.9895,0.9705,0.9705,0.9895,0.9958,0.9916,0.9958,MillID medium,0.0063,0.0253
138
+ fao_Latn,Faroese,237,1.0,1.0,0.4808,0.4808,0.9615,0.9727,0.9524,0.9727,MillID medium,-0.0273,0.4919
139
+ sag_Latn,Sango,237,1.0,1.0,0.985,0.985,0.9915,0.9958,1.0,1.0,MillID large,0.0,0.015
140
+ mai_Deva,Maithili,234,0.9957,0.9957,0.9196,0.9196,0.9476,0.9386,0.9382,0.9476,MillID tiny,-0.0481,0.028
141
+ sin_Sinh,Sinhala,232,1.0,1.0,0.9978,0.9978,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0022
142
+ gug_Latn,Paraguayan Guaraní,228,0.9956,0.9956,0.933,0.933,0.9822,0.9648,0.9663,0.9822,MillID tiny,-0.0134,0.0492
143
+ tuk_Latn,Turkmen,227,0.9978,0.9978,0.9821,0.9821,0.9821,0.98,0.9867,0.9867,MillID large,-0.0111,0.0046
144
+ gla_Latn,Scottish Gaelic,223,0.9955,0.9955,0.9818,0.9818,0.9888,0.9911,0.9821,0.9911,MillID medium,-0.0044,0.0093
145
+ bem_Latn,Bemba,222,0.9841,0.9818,0.9643,0.9643,0.9679,0.9725,0.9652,0.9725,MillID medium,-0.0093,0.0082
146
+ fur_Latn,Friulian,221,0.9955,0.9955,0.9138,0.9074,0.939,0.9528,0.9488,0.9528,MillID medium,-0.0427,0.0454
147
+ kac_Latn,Kachin,216,1.0,1.0,0.986,0.986,0.9977,1.0,1.0,1.0,MillID medium,0.0,0.014
148
+ glg_Latn,Galician,215,0.9663,0.9663,0.9316,0.9316,0.9262,0.9406,0.9147,0.9406,MillID medium,-0.0257,0.009
149
+ lin_Latn,Lingala,215,0.9953,0.9953,0.9838,0.9838,0.9604,0.9624,0.9561,0.9624,MillID medium,-0.0329,-0.0214
150
+ wol_Latn,Wolof,214,0.9953,0.9953,0.9555,0.9579,0.9691,0.9762,0.9763,0.9763,MillID large,-0.019,0.0184
151
+ als_Latn,Albanian (Tosk),213,1.0,1.0,0.9812,0.9812,0.9687,0.9561,0.9637,0.9687,MillID tiny,-0.0313,-0.0125
152
+ kin_Latn,Kinyarwanda,210,0.9807,0.9807,0.8535,0.8535,0.8282,0.8178,0.8124,0.8282,MillID tiny,-0.1525,-0.0253
153
+ alt_Cyrl,Southern Altai,208,1.0,1.0,0.8966,0.8966,0.955,0.9655,0.9781,0.9781,MillID large,-0.0219,0.0815
154
+ kea_Latn,Kabuverdianu,205,0.9976,0.9976,0.8736,0.8736,0.963,0.9662,0.9602,0.9662,MillID medium,-0.0314,0.0926
155
+ heb_Hebr,Hebrew,203,1.0,1.0,0.9975,0.9975,0.9727,0.9901,0.9854,0.9901,MillID medium,-0.0099,-0.0074
156
+ gle_Latn,Irish,203,1.0,1.0,0.9826,0.9826,0.9851,0.9926,0.9826,0.9926,MillID medium,-0.0074,0.01
157
+ ban_Latn,Balinese,202,1.0,1.0,0.9223,0.9223,0.9671,0.9596,0.959,0.9671,MillID tiny,-0.0329,0.0448
158
+ tat_Cyrl,Tatar,201,1.0,1.0,0.9685,0.9685,0.9724,0.9755,0.9726,0.9755,MillID medium,-0.0245,0.007
159
+ nus_Latn,Nuer,199,1.0,1.0,0.9898,0.9898,0.9924,0.995,0.9924,0.995,MillID medium,-0.005,0.0052
160
+ bos_Latn,Bosnian,198,1.0,1.0,0.8967,0.8967,0.6552,0.7268,0.7112,0.7268,MillID medium,-0.2732,-0.1699
161
+ hne_Deva,Chhattisgarhi,198,0.9851,0.9851,0.9016,0.9016,0.9391,0.9618,0.9482,0.9618,MillID medium,-0.0233,0.0602
162
+ lim_Latn,Limburgish,196,1.0,1.0,0.9556,0.9556,0.8895,0.9155,0.9036,0.9155,MillID medium,-0.0845,-0.0401
163
+ yue_Hani,Cantonese,194,0.8983,0.9014,0.2588,0.2588,0.8917,0.8791,0.8587,0.8917,MillID tiny,-0.0097,0.6329
164
+ war_Latn,Waray,193,1.0,1.0,0.9511,0.9511,0.9431,0.9488,0.9511,0.9511,MillID large,-0.0489,0.0
165
+ kik_Latn,Kikuyu,193,1.0,1.0,0.8478,0.8478,0.9713,0.9738,0.9735,0.9738,MillID medium,-0.0262,0.126
166
+ crh_Latn,Crimean Tatar,189,1.0,1.0,0.9786,0.9786,0.9785,0.9842,0.9759,0.9842,MillID medium,-0.0158,0.0056
167
+ cym_Latn,Welsh,189,1.0,1.0,0.9867,0.9867,0.9947,0.992,0.9867,0.9947,MillID tiny,-0.0053,0.008
168
+ khm_Khmr,Khmer,187,1.0,1.0,1.0,1.0,0.9947,0.974,0.9947,0.9947,MillID tiny,-0.0053,-0.0053
169
+ azj_Latn,North Azerbaijani,187,0.9973,0.9973,0.9787,0.9787,0.9811,0.9756,0.9786,0.9811,MillID tiny,-0.0162,0.0024
170
+ ces_Latn,Czech,183,1.0,1.0,0.9683,0.9683,0.9201,0.9201,0.911,0.9201,MillID tiny,-0.0799,-0.0482
171
+ fon_Latn,Fon,180,1.0,1.0,0.9535,0.9535,0.9916,0.9888,0.9888,0.9916,MillID tiny,-0.0084,0.0381
172
+ hye_Armn,Armenian,178,1.0,1.0,0.977,0.977,1.0,1.0,0.9972,1.0,MillID tiny,0.0,0.023
173
+ shn_Mymr,Shan,174,1.0,1.0,0.9854,0.9854,0.9942,1.0,0.9913,1.0,MillID medium,0.0,0.0146
174
+ scn_Latn,Sicilian,172,1.0,1.0,0.9243,0.9243,0.9739,0.9825,0.9795,0.9825,MillID medium,-0.0175,0.0582
175
+ gom_Deva,Goan Konkani,170,0.9798,0.9798,0.9524,0.9524,0.9459,0.9741,0.948,0.9741,MillID medium,-0.0057,0.0217
176
+ hrv_Latn,Croatian,168,0.9941,0.9941,0.8563,0.8563,0.6667,0.7172,0.6566,0.7172,MillID medium,-0.2769,-0.1391
177
+ kab_Latn,Kabyle,165,1.0,1.0,0.9558,0.9558,0.9426,0.9515,0.9693,0.9693,MillID large,-0.0307,0.0135
178
+ fuv_Latn,Nigerian Fulfulde,164,0.8767,0.8919,0.8587,0.8587,0.8043,0.7971,0.8493,0.8493,MillID large,-0.0426,-0.0094
179
+ arb_Latn,Standard Arabic,163,0.906,0.9133,0.8522,0.8522,0.9568,0.9441,0.9333,0.9568,MillID tiny,0.0435,0.1046
180
+ mri_Latn,Māori,162,1.0,1.0,0.6639,0.6639,0.972,0.9969,0.9938,0.9969,MillID medium,-0.0031,0.333
181
+ udm_Cyrl,Udmurt,159,1.0,1.0,0.8244,0.8244,0.9662,0.9843,0.9745,0.9843,MillID medium,-0.0157,0.1599
182
+ krc_Cyrl,Karachay-Balkar,159,1.0,1.0,0.8778,0.8778,0.9779,0.9841,0.9779,0.9841,MillID medium,-0.0159,0.1063
183
+ jav_Latn,Javanese,158,0.9937,0.9937,0.9313,0.9313,0.9574,0.9267,0.9412,0.9574,MillID tiny,-0.0363,0.0261
184
+ tzm_Tfng,Central Atlas Tamazight,157,0.9345,0.9345,0.7512,0.7512,0.6328,0.6452,0.6426,0.6452,MillID medium,-0.2893,-0.106
185
+ bel_Cyrl,Belarusian,157,1.0,1.0,0.9937,0.9937,0.9809,0.9904,0.9806,0.9904,MillID medium,-0.0096,-0.0033
186
+ bjn_Latn,Banjar,153,0.9967,0.9967,0.8688,0.8688,0.9385,0.9377,0.9463,0.9463,MillID large,-0.0504,0.0775
187
+ oss_Cyrl,Ossetic,152,1.0,1.0,1.0,1.0,0.9834,0.9867,0.9735,0.9867,MillID medium,-0.0133,-0.0133
188
+ sun_Latn,Sundanese,143,1.0,1.0,0.9467,0.9467,0.9577,0.979,0.9754,0.979,MillID medium,-0.021,0.0323
189
+ srd_Latn,Sardinian,139,1.0,1.0,0.9363,0.9363,0.9712,0.9893,0.9749,0.9893,MillID medium,-0.0107,0.053
190
+ fil_Latn,Filipino,137,0.9815,0.9815,0.9926,0.9926,0.947,0.9354,0.9363,0.947,MillID tiny,-0.0345,-0.0456
191
+ ady_Cyrl,Adyghe,135,1.0,1.0,0.9814,0.9814,0.9925,0.9925,0.985,0.9925,MillID tiny,-0.0075,0.0111
192
+ diq_Latn,Dimli (individual language),134,1.0,1.0,0.9333,0.9333,0.9042,0.9502,0.9318,0.9502,MillID medium,-0.0498,0.0169
193
+ ewo_Latn,Ewondo,134,0.8787,0.8833,0.8596,0.8596,0.9624,0.9653,0.9699,0.9699,MillID large,0.0866,0.1103
194
+ mos_Latn,Mossi,133,1.0,1.0,0.9811,0.9811,0.9773,0.9771,0.9771,0.9773,MillID tiny,-0.0227,-0.0038
195
+ xmf_Geor,Mingrelian,132,1.0,1.0,0.963,0.963,0.9624,0.9732,0.9736,0.9736,MillID large,-0.0264,0.0106
196
+ kbp_Latn,Kabiyè,130,1.0,1.0,0.9766,0.9766,0.9811,0.9923,1.0,1.0,MillID large,0.0,0.0234
197
+ pag_Latn,Pangasinan,122,0.9959,0.9959,0.959,0.959,0.95,0.9437,0.9528,0.9528,MillID large,-0.0431,-0.0062
198
+ sat_Olck,Santali,122,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
199
+ kmb_Latn,Kimbundu,119,0.9917,0.9917,0.9633,0.9633,0.9833,0.9833,1.0,1.0,MillID large,0.0083,0.0367
200
+ kas_Arab,Kashmiri,118,1.0,1.0,0.9784,0.9784,1.0,0.9915,0.9958,1.0,MillID tiny,0.0,0.0216
201
+ bjn_Arab,Banjar,116,0.8342,0.9869,0.4533,0.9596,0.9872,0.9831,1.0,1.0,MillID large,0.0131,0.0404
202
+ ace_Latn,Acehnese,113,1.0,1.0,0.8943,0.88,0.9778,0.9867,0.9865,0.9867,MillID medium,-0.0133,0.1067
203
+ nav_Latn,Navajo,113,1.0,1.0,0.968,0.968,0.9911,0.9867,0.9911,0.9911,MillID tiny,-0.0089,0.0231
204
+ taq_Latn,Tamasheq,106,1.0,1.0,0.8377,0.8377,0.8958,0.9091,0.9289,0.9289,MillID large,-0.0711,0.0912
205
+ taq_Tfng,Tamasheq,104,0.8046,0.8046,0.0,0.0,0.6,0.6129,0.6,0.6129,MillID medium,-0.1917,0.6129
206
+ umb_Latn,Umbundu,100,0.995,0.995,0.8972,0.8972,0.9849,0.9798,0.9798,0.9849,MillID tiny,-0.0101,0.0877
207
+ mag_Deva,Magahi,97,1.0,1.0,0.7723,0.7723,0.8557,0.9053,0.8969,0.9053,MillID medium,-0.0947,0.133
208
+ awa_Deva,Awadhi,91,0.963,0.963,0.7571,0.7571,0.8827,0.8764,0.895,0.895,MillID large,-0.068,0.1379
209
+ bug_Latn,Buginese,78,0.9811,0.9811,0.9375,0.9375,0.987,0.987,0.987,0.987,MillID tiny,0.0059,0.0495
210
+ knc_Arab,Central Kanuri,68,0.8571,0.8595,0.029,0.029,0.5833,0.5625,0.6263,0.6263,MillID large,-0.2332,0.5973
211
+ min_Latn,Minangkabau,55,0.991,0.991,0.3333,0.3333,0.9009,0.9038,0.86,0.9038,MillID medium,-0.0872,0.5705
212
+ vec_Latn,Venetian,49,0.8605,0.8605,0.6202,0.6202,0.7451,0.7664,0.6957,0.7664,MillID medium,-0.0941,0.1462
213
+ kas_Deva,Kashmiri,47,0.7027,0.7027,0.5867,0.5867,0.6173,0.6905,0.6923,0.6923,MillID large,-0.0104,0.1056
214
+ cjk_Latn,Chokwe,24,1.0,1.0,0.807,0.807,0.7692,0.9091,0.8,0.9091,MillID medium,-0.0909,0.1021
leaderboard_test.csv ADDED
The diff for this file is too large to render. See raw diff
 
leaderboard_udhr.csv ADDED
@@ -0,0 +1,359 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ label,language,support,GlotLID,GlotLID restricted,fastText,fastText restricted,MillID tiny,MillID medium,MillID large,best MillID,best MillID model,gain over GlotLID restricted,gain over fastText restricted
2
+ roh_Latn,Romansh,399,0.9987,0.9987,0.9455,0.9455,0.9887,0.9912,0.9937,0.9937,MillID large,-0.005,0.0482
3
+ oci_Latn,Occitan,398,0.3755,0.3755,0.4355,0.4355,0.2912,0.3312,0.3136,0.3312,MillID medium,-0.0443,-0.1043
4
+ cmn_Hani,Chinese (Mandarin),319,0.8681,0.8681,0.4676,0.4676,0.8748,0.886,0.8571,0.886,MillID medium,0.0179,0.4184
5
+ krl_Latn,Karelian,183,0.0109,0.0109,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0109,0.0
6
+ qug_Latn,Chimborazo Highland Quichua,182,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
7
+ acu_Latn,Achuar-Shiwiar,180,0.8535,0.8535,0.0,0.0,0.85,0.7431,0.7324,0.85,MillID tiny,-0.0035,0.85
8
+ hus_Latn,Huastec,175,0.9855,0.9855,0.0,0.0,0.9583,0.9914,0.9914,0.9914,MillID medium,0.0059,0.9914
9
+ hau_Latn,Hausa,155,1.0,1.0,0.8757,0.8757,0.9968,0.9968,0.9968,0.9968,MillID tiny,-0.0032,0.1211
10
+ auc_Latn,Waorani,154,0.0,0.0,0.0,0.0,0.0,0.0503,0.0,0.0503,MillID medium,0.0503,0.0503
11
+ kwi_Latn,Awa-Cuaiquer,145,0.8769,0.8769,0.0,0.0,0.7712,0.775,0.7967,0.7967,MillID large,-0.0802,0.7967
12
+ jpn_Jpan,Japanese,140,1.0,1.0,0.9437,0.9437,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0563
13
+ snn_Latn,Siona,136,0.5137,0.5137,0.0,0.0,0.3931,0.7731,0.6207,0.7731,MillID medium,0.2594,0.7731
14
+ ktu_Latn,Kituba (Democratic Republic of Congo),118,0.6803,0.6803,0.0,0.0,0.7546,0.7687,0.7528,0.7687,MillID medium,0.0884,0.7687
15
+ lat_Latn,Latin,118,0.9915,0.9915,0.0,0.0,0.9957,0.9958,0.9958,0.9958,MillID medium,0.0043,0.9958
16
+ hat_Latn,Haitian Creole,117,0.9785,0.9785,0.6988,0.6988,0.9872,0.9914,0.9871,0.9914,MillID medium,0.0129,0.2926
17
+ twi_Latn,Twi,116,0.9957,0.9957,0.3993,0.3959,0.9957,0.9871,0.9829,0.9957,MillID tiny,0.0,0.5998
18
+ rmn_Latn,Balkan Romani,116,0.8571,0.8571,0.0,0.0,0.7213,0.6667,0.7351,0.7351,MillID large,-0.122,0.7351
19
+ kmb_Latn,Kimbundu,116,1.0,1.0,0.8775,0.8775,0.9914,0.9787,0.9914,0.9914,MillID tiny,-0.0086,0.1139
20
+ nya_Latn,Nyanja,116,1.0,1.0,0.8056,0.8056,0.9784,0.9871,0.9655,0.9871,MillID medium,-0.0129,0.1815
21
+ chr_Cher,Cherokee,115,0.6628,0.6628,0.0,0.0,0.6705,0.7151,0.7293,0.7293,MillID large,0.0665,0.7293
22
+ ell_Grek,Greek,115,1.0,1.0,1.0,1.0,0.6705,0.655,0.6705,0.6705,MillID tiny,-0.3295,-0.3295
23
+ lvs_Latn,Standard Latvian,115,1.0,1.0,0.9914,0.9914,0.9957,0.9957,0.9957,0.9957,MillID tiny,-0.0043,0.0043
24
+ kng_Latn,Koongo,115,0.1928,0.1928,0.4571,0.4571,0.1014,0.0469,0.1014,0.1014,MillID tiny,-0.0914,-0.3557
25
+ pov_Latn,Upper Guinea Crioulo,115,0.8325,0.8325,0.0,0.0,0.8442,0.8384,0.8384,0.8442,MillID tiny,0.0117,0.8442
26
+ por_Latn,Portuguese,115,0.9957,0.9957,0.7931,0.7931,0.9784,0.9957,0.9826,0.9957,MillID medium,0.0,0.2026
27
+ cjk_Latn,Chokwe,114,1.0,1.0,0.5327,0.5327,0.8878,0.9493,0.9493,0.9493,MillID medium,-0.0507,0.4166
28
+ tha_Thai,Thai,114,1.0,1.0,0.9956,0.9956,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0044
29
+ tso_Latn,Tsonga,114,0.7807,0.7807,0.6909,0.6909,0.7432,0.8824,0.8426,0.8824,MillID medium,0.1017,0.1915
30
+ fas_Arab,Persian,114,1.0,1.0,0.9344,0.9344,0.9821,0.9912,0.973,0.9912,MillID medium,-0.0088,0.0568
31
+ lin_Latn,Lingala,110,1.0,1.0,0.9864,0.9864,0.9735,1.0,0.9692,1.0,MillID medium,0.0,0.0136
32
+ fuv_Latn,Nigerian Fulfulde,108,0.6813,0.6885,0.4747,0.4747,0.5096,0.4051,0.519,0.519,MillID large,-0.1695,0.0443
33
+ urd_Arab,Urdu,108,0.986,0.986,0.6353,0.6353,0.9907,0.9953,0.9953,0.9953,MillID medium,0.0093,0.36
34
+ umb_Latn,Umbundu,107,0.9906,0.9906,0.9083,0.9083,0.9091,0.8737,0.8854,0.9091,MillID tiny,-0.0815,0.0008
35
+ mal_Mlym,Malayalam,100,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
36
+ ron_Latn,Romanian,97,1.0,1.0,0.8727,0.8727,1.0,0.9949,0.9949,1.0,MillID tiny,0.0,0.1273
37
+ ven_Latn,Venda,89,1.0,1.0,0.0,0.0,1.0,1.0,0.9944,1.0,MillID tiny,0.0,1.0
38
+ spa_Latn,Spanish,78,0.9872,0.9872,0.5571,0.5571,0.956,0.9872,0.987,0.9872,MillID medium,0.0,0.4301
39
+ hye_Armn,Armenian,70,1.0,1.0,0.9855,0.9855,0.9855,0.9928,0.9855,0.9928,MillID medium,-0.0072,0.0073
40
+ tam_Taml,Tamil,68,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
41
+ deu_Latn,German,67,1.0,1.0,0.9571,0.9571,1.0,1.0,0.9925,1.0,MillID tiny,0.0,0.0429
42
+ tiv_Latn,Tiv,67,1.0,1.0,0.0,0.0,1.0,0.9926,1.0,1.0,MillID tiny,0.0,1.0
43
+ pam_Latn,Pampanga,66,1.0,1.0,0.0,0.0,0.9925,1.0,1.0,1.0,MillID medium,0.0,1.0
44
+ sun_Latn,Sundanese,66,0.9924,0.9924,0.7692,0.7692,0.9606,0.9767,0.9924,0.9924,MillID large,0.0,0.2232
45
+ knc_Latn,Central Kanuri,64,1.0,1.0,0.4384,0.4384,0.9921,1.0,1.0,1.0,MillID medium,0.0,0.5616
46
+ njo_Latn,Ao Naga,64,0.9921,0.9921,0.0,0.0,0.9922,0.9922,1.0,1.0,MillID large,0.0079,1.0
47
+ skr_Arab,Saraiki,63,0.5,0.5,0.0,0.0,0.8,0.9231,0.8545,0.9231,MillID medium,0.4231,0.9231
48
+ smo_Latn,Samoan,63,1.0,1.0,0.7922,0.7922,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2078
49
+ mcf_Latn,Matsés,62,0.992,0.992,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.008,1.0
50
+ shp_Latn,Shipibo-Conibo,62,0.9123,0.9123,0.0,0.0,0.5581,0.4103,0.8077,0.8077,MillID large,-0.1046,0.8077
51
+ cbi_Latn,Chachi,62,0.9919,0.9919,0.0,0.0,0.976,1.0,0.9919,1.0,MillID medium,0.0081,1.0
52
+ gla_Latn,Scottish Gaelic,62,0.9836,0.9836,0.9587,0.9587,0.992,0.976,0.9919,0.992,MillID tiny,0.0084,0.0333
53
+ nob_Latn,Norwegian Bokmål,62,0.9764,0.9764,0.992,0.992,0.9606,0.9516,0.9365,0.9606,MillID tiny,-0.0158,-0.0314
54
+ ace_Latn,Acehnese,61,0.9917,0.9917,0.5357,0.5357,0.9756,0.9833,0.9917,0.9917,MillID large,0.0,0.456
55
+ swe_Latn,Swedish,61,1.0,1.0,1.0,1.0,0.9917,1.0,1.0,1.0,MillID medium,0.0,0.0
56
+ amr_Latn,Amarakaeri,61,0.976,0.976,0.0,0.0,0.9833,1.0,1.0,1.0,MillID medium,0.024,1.0
57
+ pnb_Arab,Western Panjabi,61,0.7394,0.7394,0.0,0.0,0.8451,0.9313,0.8841,0.9313,MillID medium,0.1919,0.9313
58
+ boa_Latn,Bora,61,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
59
+ sey_Latn,Secoya,61,0.5744,0.5888,0.0,0.0,0.3959,0.5839,0.5714,0.5839,MillID medium,-0.0049,0.5839
60
+ dan_Latn,Danish,61,0.9833,0.9833,0.9677,0.9677,0.9587,0.9587,0.9516,0.9587,MillID tiny,-0.0246,-0.009
61
+ fin_Latn,Finnish,61,1.0,1.0,0.2998,0.2998,0.9919,0.9836,0.9661,0.9919,MillID tiny,-0.0081,0.6921
62
+ udu_Latn,Uduk,60,1.0,1.0,0.0,0.0,0.9917,1.0,1.0,1.0,MillID medium,0.0,1.0
63
+ cbr_Latn,Cashibo-Cacataibo,60,1.0,1.0,0.0,0.0,1.0,0.9917,0.9917,1.0,MillID tiny,0.0,1.0
64
+ cab_Latn,Garifuna,60,0.9831,0.9831,0.0,0.0,0.9917,1.0,1.0,1.0,MillID medium,0.0169,1.0
65
+ zgh_Tfng,Standard Moroccan Tamazight,60,0.4615,0.4615,0.0,0.0,0.5185,0.8235,0.7368,0.8235,MillID medium,0.362,0.8235
66
+ ban_Latn,Balinese,60,1.0,1.0,0.5607,0.5607,0.9916,0.9831,0.9744,0.9916,MillID tiny,-0.0084,0.4309
67
+ arl_Latn,Arabela,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
68
+ afr_Latn,Afrikaans,60,1.0,1.0,0.944,0.944,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.056
69
+ war_Latn,Waray,60,0.9917,0.9917,0.944,0.944,0.9748,1.0,1.0,1.0,MillID medium,0.0083,0.056
70
+ mad_Latn,Madurese,60,0.9748,0.9748,0.0,0.0,0.9752,0.9655,0.9752,0.9752,MillID tiny,0.0004,0.9752
71
+ mcd_Latn,Sharanahua,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
72
+ ind_Latn,Indonesian,60,0.9027,0.9027,0.5652,0.5652,0.6136,0.6739,0.6444,0.6739,MillID medium,-0.2288,0.1087
73
+ jav_Latn,Javanese,60,0.9916,0.9916,0.513,0.513,0.9833,0.9672,0.9593,0.9833,MillID tiny,-0.0083,0.4703
74
+ jiv_Latn,Shuar,60,0.8027,0.8027,0.0,0.0,0.7703,0.7066,0.7317,0.7703,MillID tiny,-0.0324,0.7703
75
+ wol_Latn,Wolof,60,1.0,1.0,0.2362,0.2362,0.9836,0.9836,0.9916,0.9916,MillID large,-0.0084,0.7554
76
+ gjn_Latn,Gonja,60,0.9831,0.9831,0.0,0.0,0.9831,0.9916,0.9831,0.9916,MillID medium,0.0085,0.9916
77
+ quy_Latn,Ayacucho Quechua,60,0.7763,0.7763,0.1039,0.1039,0.7117,0.6747,0.76,0.76,MillID large,-0.0163,0.6561
78
+ ekk_Latn,Estonian,60,1.0,1.0,0.3448,0.3448,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.6552
79
+ ctd_Latn,Tedim Chin,60,0.6957,0.7234,0.0,0.0,0.5185,0.7879,0.8,0.8,MillID large,0.0766,0.8
80
+ ton_Latn,Tongan,60,0.9917,0.9917,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0083,1.0
81
+ bug_Latn,Buginese,60,1.0,1.0,0.5742,0.5742,0.9916,0.9655,0.9565,0.9916,MillID tiny,-0.0084,0.4174
82
+ bod_Tibt,Tibetan,60,0.9009,0.9009,0.8992,0.8992,0.9661,0.9748,0.9672,0.9748,MillID medium,0.0739,0.0756
83
+ vie_Latn,Vietnamese,60,1.0,1.0,0.9524,0.9524,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0476
84
+ zam_Latn,Miahuatlán Zapotec,60,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
85
+ gaz_Latn,Oromo (West Central),60,0.9752,0.9752,0.5381,0.5381,0.9831,0.9916,0.9744,0.9916,MillID medium,0.0164,0.4535
86
+ cpu_Latn,Pichis Ashéninka,60,0.9744,0.9744,0.0,0.0,0.6593,0.5714,0.6667,0.6667,MillID large,-0.3077,0.6667
87
+ sna_Latn,Shona,60,0.9917,0.9917,0.5729,0.5729,0.9833,0.9836,1.0,1.0,MillID large,0.0083,0.4271
88
+ cym_Latn,Welsh,60,1.0,1.0,0.8108,0.8108,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1892
89
+ qvm_Latn,Margos-Yarowilca-Lauricocha Quechua,60,0.5,0.5,0.0,0.0,0.125,0.0938,0.1818,0.1818,MillID large,-0.3182,0.1818
90
+ fil_Latn,Filipino,60,1.0,1.0,0.553,0.553,0.9831,0.9916,0.9916,0.9916,MillID medium,-0.0084,0.4386
91
+ tbz_Latn,Ditammari,60,0.3784,0.3784,0.0,0.0,0.0,0.3333,0.2609,0.3333,MillID medium,-0.0451,0.3333
92
+ cot_Latn,Caquinte,60,0.9916,0.9916,0.0,0.0,0.9916,0.9831,1.0,1.0,MillID large,0.0084,1.0
93
+ tca_Latn,Ticuna,60,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
94
+ ayr_Latn,Central Aymara,59,1.0,1.0,0.716,0.716,0.8992,1.0,0.9916,1.0,MillID medium,0.0,0.284
95
+ tur_Latn,Turkish,59,0.9916,0.9916,0.59,0.59,0.9421,0.9833,0.9916,0.9916,MillID large,0.0,0.4016
96
+ uig_Latn,Uyghur,59,0.9833,0.9752,0.0,0.0,1.0,0.9916,1.0,1.0,MillID tiny,0.0248,1.0
97
+ bis_Latn,Bislama,59,1.0,1.0,0.7516,0.7516,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2484
98
+ bcl_Latn,Central Bikol,59,0.9916,0.9916,0.0,0.0,0.9916,0.9916,1.0,1.0,MillID large,0.0084,1.0
99
+ bos_Latn,Bosnian,59,0.3121,0.3121,0.1979,0.1979,0.1803,0.2281,0.237,0.237,MillID large,-0.0751,0.0391
100
+ bre_Latn,Breton,59,0.9915,0.9915,0.0,0.0,0.9916,1.0,0.9833,1.0,MillID medium,0.0085,1.0
101
+ tly_Latn,Talysh,59,0.9915,0.9915,0.0,0.0,0.9915,0.9915,1.0,1.0,MillID large,0.0085,1.0
102
+ ceb_Latn,Cebuano,59,1.0,1.0,0.6146,0.6146,0.9916,0.9833,0.9833,0.9916,MillID tiny,-0.0084,0.377
103
+ tob_Latn,Toba,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
104
+ top_Latn,Papantla Totonac,59,0.9916,0.9916,0.0,0.0,0.9828,0.9833,0.9831,0.9833,MillID medium,-0.0083,0.9833
105
+ tuk_Latn,Turkmen,59,1.0,1.0,0.9672,0.9672,0.9739,0.9916,1.0,1.0,MillID large,0.0,0.0328
106
+ tsz_Latn,Purepecha,59,0.9655,0.9744,0.0,0.0,0.9739,0.9915,0.9915,0.9915,MillID medium,0.0171,0.9915
107
+ fur_Latn,Friulian,59,1.0,1.0,0.6082,0.6051,0.9748,1.0,0.9748,1.0,MillID medium,0.0,0.3949
108
+ gaa_Latn,Ga,59,0.9916,0.9833,0.0,0.0,0.9916,0.9916,0.9752,0.9916,MillID tiny,0.0083,0.9916
109
+ gag_Latn,Gagauz,59,0.9915,0.9915,0.0,0.0,0.9565,0.9828,0.9915,0.9915,MillID large,0.0,0.9915
110
+ gsw_Latn,Swiss German,59,0.9915,0.9915,0.0,0.0,0.7097,0.8081,0.9649,0.9649,MillID large,-0.0266,0.9649
111
+ pol_Latn,Polish,59,1.0,1.0,0.7296,0.7296,0.9831,0.9655,0.9915,0.9915,MillID large,-0.0085,0.2619
112
+ qva_Latn,Ambo-Pasco Quechua,59,0.0328,0.0328,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0328,0.0
113
+ eus_Latn,Basque,59,1.0,1.0,0.8923,0.8923,0.9219,0.9672,0.9752,0.9752,MillID large,-0.0248,0.0829
114
+ qwh_Latn,Huaylas Ancash Quechua,59,0.6545,0.6545,0.0,0.0,0.3982,0.4955,0.5698,0.5698,MillID large,-0.0847,0.5698
115
+ srp_Latn,Serbian,59,0.45,0.45,0.0,0.0,0.3689,0.4754,0.4167,0.4754,MillID medium,0.0254,0.4754
116
+ ssw_Latn,Swati,59,1.0,1.0,0.9516,0.9516,0.9916,1.0,1.0,1.0,MillID medium,0.0,0.0484
117
+ cnr_Latn,Serbian (Montenegro),59,0.0303,0.0303,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,-0.0303,0.0
118
+ srp_Cyrl,Serbian,59,0.9915,0.9915,0.9915,0.9915,0.9828,0.9828,0.9915,0.9915,MillID large,0.0,0.0
119
+ slv_Latn,Slovenian,59,0.9752,0.9752,0.8027,0.8027,0.9474,0.9483,0.9587,0.9587,MillID large,-0.0165,0.156
120
+ cof_Latn,Colorado,59,0.9273,0.9369,0.0,0.0,0.9655,1.0,0.9915,1.0,MillID medium,0.0631,1.0
121
+ cos_Latn,Corsican,59,0.9915,0.9915,0.0,0.0,0.9915,0.9916,0.9831,0.9916,MillID medium,0.0001,0.9916
122
+ cjs_Cyrl,Shor,59,0.9369,0.9369,0.0,0.0,0.9464,0.9649,0.9649,0.9649,MillID medium,0.028,0.9649
123
+ fij_Latn,Fijian,59,1.0,1.0,0.9752,0.9752,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0248
124
+ rar_Latn,Rarotongan,59,1.0,1.0,0.0,0.0,0.9916,1.0,1.0,1.0,MillID medium,0.0,1.0
125
+ sin_Sinh,Sinhala,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
126
+ sag_Latn,Sango,59,0.5783,0.5783,0.1892,0.1892,0.9915,0.9915,0.9915,0.9915,MillID tiny,0.4132,0.8023
127
+ ewe_Latn,Ewe,59,1.0,1.0,0.6517,0.6517,1.0,1.0,0.9833,1.0,MillID tiny,0.0,0.3483
128
+ dzo_Tibt,Dzongkha,59,0.9134,0.9134,0.8571,0.8571,0.9667,0.9748,0.9655,0.9748,MillID medium,0.0614,0.1177
129
+ dga_Latn,Southern Dagaare,59,0.9915,1.0,0.0,0.0,0.9365,0.9915,0.9667,0.9915,MillID medium,-0.0085,0.9915
130
+ crh_Latn,Crimean Tatar,59,1.0,1.0,0.8551,0.8551,0.9833,0.9916,0.9672,0.9916,MillID medium,-0.0084,0.1365
131
+ mar_Deva,Marathi,59,1.0,1.0,1.0,1.0,1.0,0.9916,0.9916,1.0,MillID tiny,0.0,0.0
132
+ maz_Latn,Central Mazahua,59,0.9391,0.9391,0.0,0.0,0.725,0.7421,0.8227,0.8227,MillID large,-0.1164,0.8227
133
+ nav_Latn,Navajo,59,1.0,1.0,0.7024,0.7024,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2976
134
+ mor_Latn,Moro,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
135
+ min_Latn,Minangkabau,59,0.9916,0.9916,0.127,0.127,1.0,0.9915,1.0,1.0,MillID tiny,0.0084,0.873
136
+ mlt_Latn,Maltese,59,1.0,1.0,0.8939,0.8939,0.9916,1.0,1.0,1.0,MillID medium,0.0,0.1061
137
+ men_Latn,Mende,59,0.9916,0.9916,0.0,0.0,0.9516,0.9916,0.9752,0.9916,MillID medium,0.0,0.9916
138
+ mic_Latn,Mi'kmaw,59,0.4267,0.4267,0.0,0.0,0.9828,1.0,1.0,1.0,MillID medium,0.5733,1.0
139
+ hns_Latn,Caribbean Hindustani,59,0.9369,0.9369,0.0,0.0,0.9649,0.9739,0.9915,0.9915,MillID large,0.0546,0.9915
140
+ hsb_Latn,Upper Sorbian,59,1.0,1.0,0.0,0.0,0.9828,1.0,0.9739,1.0,MillID medium,0.0,1.0
141
+ hun_Latn,Hungarian,59,1.0,1.0,0.3224,0.3224,1.0,0.9916,1.0,1.0,MillID tiny,0.0,0.6776
142
+ nzi_Latn,Nzima,59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
143
+ ote_Latn,Mezquital Otomi,59,0.0,0.0,0.0,0.0,0.0,0.0656,0.0656,0.0656,MillID medium,0.0656,0.0656
144
+ hin_Deva,Hindi,59,0.9573,0.9573,0.9752,0.9752,0.6444,0.6067,0.45,0.6444,MillID tiny,-0.3129,-0.3308
145
+ not_Latn,Nomatsiguenga,59,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0085,1.0
146
+ nba_Latn,Nyemba,59,0.0,0.0,0.0,0.0,0.0323,0.0,0.0,0.0323,MillID tiny,0.0323,0.0323
147
+ kqn_Latn,Kaonde,59,1.0,1.0,0.0,0.0,0.9915,0.9916,0.9833,0.9916,MillID medium,-0.0084,0.9916
148
+ kbr_Latn,Kafa,59,0.9915,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
149
+ kbp_Latn,Kabiyè,59,1.0,1.0,0.3893,0.3893,0.9291,0.9593,0.9752,0.9752,MillID large,-0.0248,0.5859
150
+ ltz_Latn,Luxembourgish,59,0.9915,0.9915,0.648,0.648,0.9916,0.9916,1.0,1.0,MillID large,0.0085,0.352
151
+ lld_Latn,Ladin,59,0.7312,0.7312,0.0,0.0,0.9464,0.8991,0.8155,0.9464,MillID tiny,0.2152,0.9464
152
+ kin_Latn,Kinyarwanda,59,0.8868,0.8868,0.8571,0.8571,0.8889,0.9412,0.8929,0.9412,MillID medium,0.0544,0.0841
153
+ khm_Khmr,Khmer,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
154
+ kdh_Latn,Tem,59,0.8654,0.9915,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0085,1.0
155
+ wln_Latn,Walloon,59,0.655,0.655,0.0,0.0,0.6552,0.6667,0.6705,0.6705,MillID large,0.0155,0.6705
156
+ xsm_Latn,Kasem,59,0.9915,0.9915,0.0,0.0,0.8544,0.9268,0.9649,0.9649,MillID large,-0.0266,0.9649
157
+ yua_Latn,Yucateco,59,1.0,1.0,0.0,0.0,0.9593,1.0,1.0,1.0,MillID medium,0.0,1.0
158
+ ydd_Hebr,Eastern Yiddish,59,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
159
+ als_Latn,Albanian (Tosk),59,1.0,1.0,0.7329,0.7329,1.0,0.9828,0.9828,1.0,MillID tiny,0.0,0.2671
160
+ ame_Latn,Yanesha',59,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
161
+ ajg_Latn,Aja (Benin),59,0.9916,0.9916,0.0,0.0,0.8741,0.9593,0.9219,0.9593,MillID medium,-0.0323,0.9593
162
+ ada_Latn,Adangme,59,0.9365,0.9365,0.0,0.0,1.0,0.9752,0.9752,1.0,MillID tiny,0.0635,1.0
163
+ xho_Latn,Xhosa,58,1.0,1.0,0.8529,0.8529,0.9381,0.9204,0.8972,0.9381,MillID tiny,-0.0619,0.0852
164
+ vmw_Latn,Makhuwa,58,0.9825,0.9913,0.0,0.0,0.9825,0.9825,0.9735,0.9825,MillID tiny,-0.0088,0.9825
165
+ arn_Latn,Mapuche,58,0.8952,0.9057,0.8175,0.8175,0.9483,0.9744,0.958,0.9744,MillID medium,0.0687,0.1569
166
+ arb_Arab,Arabic (Modern Standard),58,1.0,1.0,1.0,1.0,0.9259,0.9259,0.9455,0.9455,MillID large,-0.0545,-0.0545
167
+ ami_Latn,Amis,58,0.0,0.0,0.0,0.0,0.0,0.0339,0.129,0.129,MillID large,0.129,0.129
168
+ nbl_Latn,South Ndebele,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0333,0.0333,MillID large,0.0333,0.0333
169
+ mkd_Cyrl,Macedonian,58,1.0,1.0,1.0,1.0,0.9831,0.9748,1.0,1.0,MillID large,0.0,0.0
170
+ ndo_Latn,Ndonga,58,0.958,0.958,0.0,0.0,0.9661,0.9431,0.9748,0.9748,MillID large,0.0168,0.9748
171
+ mxv_Latn,Metlatónoc Mixtec,58,0.0,0.0,0.0,0.0,0.0984,0.2154,0.0339,0.2154,MillID medium,0.2154,0.2154
172
+ kal_Latn,Kalaallisut,58,1.0,1.0,0.76,0.76,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.24
173
+ kor_Hang,Korean,58,1.0,1.0,0.8923,0.8923,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1077
174
+ kri_Latn,Krio,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
175
+ yap_Latn,Yapese,58,1.0,1.0,0.0,0.0,0.9825,0.9915,1.0,1.0,MillID large,0.0,1.0
176
+ kha_Latn,Khasi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
177
+ kir_Cyrl,Kyrgyz,58,1.0,1.0,0.6237,0.6237,0.9915,1.0,1.0,1.0,MillID medium,0.0,0.3763
178
+ loz_Latn,Lozi,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
179
+ kmr_Latn,Northern Kurdish,58,1.0,1.0,0.7582,0.7582,0.955,0.9825,0.9735,0.9825,MillID medium,-0.0175,0.2243
180
+ lit_Latn,Lithuanian,58,1.0,1.0,0.8112,0.8112,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1888
181
+ kea_Latn,Kabuverdianu,58,0.9355,0.9355,0.125,0.1244,0.8112,0.7945,0.8,0.8112,MillID tiny,-0.1243,0.6868
182
+ lij_Latn,Ligurian,58,0.8593,0.8593,0.4872,0.4872,0.9431,0.9587,0.8227,0.9587,MillID medium,0.0994,0.4715
183
+ lad_Latn,Ladino,58,1.0,1.0,0.0,0.0,0.9558,0.9913,0.9828,0.9913,MillID medium,-0.0087,0.9913
184
+ lua_Latn,Luba-Lulua,58,0.7391,0.7391,0.6386,0.6386,0.7708,0.55,0.5316,0.7708,MillID tiny,0.0317,0.1322
185
+ kan_Knda,Kannada,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
186
+ kat_Geor,Georgian,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
187
+ kaz_Cyrl,Kazakh,58,1.0,1.0,0.4444,0.4444,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.5556
188
+ mfq_Latn,Moba,58,1.0,1.0,0.0,0.0,1.0,1.0,0.9744,1.0,MillID tiny,0.0,1.0
189
+ isl_Latn,Icelandic,58,1.0,1.0,0.8345,0.8345,0.9913,0.9455,0.9455,0.9913,MillID tiny,-0.0087,0.1568
190
+ kab_Latn,Kabyle,58,0.9913,0.9913,0.9831,0.9748,0.9825,0.9915,0.9913,0.9915,MillID medium,0.0002,0.0167
191
+ kaa_Cyrl,Kara-Kalpak,58,1.0,1.0,0.0,0.0,1.0,0.9915,1.0,1.0,MillID tiny,0.0,1.0
192
+ ina_Latn,Interlingua,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
193
+ ilo_Latn,Iloko,58,0.9913,0.9913,0.8593,0.8593,1.0,1.0,1.0,1.0,MillID tiny,0.0087,0.1407
194
+ ita_Latn,Italian,58,1.0,1.0,0.6629,0.6629,1.0,0.9825,0.9828,1.0,MillID tiny,0.0,0.3371
195
+ mam_Latn,Mam,58,0.9455,0.9455,0.0,0.0,0.9174,1.0,0.955,1.0,MillID medium,0.0545,1.0
196
+ mah_Latn,Marshallese,58,1.0,1.0,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0,1.0
197
+ mai_Deva,Maithili,58,1.0,1.0,1.0,1.0,0.9587,0.8593,0.8923,0.9587,MillID tiny,-0.0413,-0.0413
198
+ lus_Latn,Mizo,58,1.0,0.9915,0.3986,0.3986,0.9915,1.0,1.0,1.0,MillID medium,0.0085,0.6014
199
+ lue_Latn,Luvale,58,0.9913,0.9913,0.0,0.0,0.9587,0.9831,0.9508,0.9831,MillID medium,-0.0082,0.9831
200
+ quc_Latn,Kʼicheʼ,58,0.9174,0.9174,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0826,1.0
201
+ qvc_Latn,Cajamarca Quechua,58,0.9062,0.9062,0.0,0.0,0.8444,0.7891,0.6824,0.8444,MillID tiny,-0.0618,0.8444
202
+ qvh_Latn,Huamalíes-Dos de Mayo Huánuco Quechua,58,0.1538,0.1538,0.0,0.0,0.1587,0.2154,0.0984,0.2154,MillID medium,0.0616,0.2154
203
+ epo_Latn,Esperanto,58,1.0,1.0,0.4234,0.4234,0.9913,0.9825,0.9825,0.9913,MillID tiny,-0.0087,0.5679
204
+ fon_Latn,Fon,58,0.9913,0.9913,0.4979,0.4979,0.782,0.9649,0.8929,0.9649,MillID medium,-0.0264,0.467
205
+ fkv_Latn,Kven Finnish,58,0.6667,0.6667,0.0,0.0,0.7917,0.6966,0.8515,0.8515,MillID large,0.1848,0.8515
206
+ fry_Latn,Western Frisian,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
207
+ fra_Latn,French,58,0.9915,0.9915,0.9134,0.9134,0.958,0.9655,0.9655,0.9655,MillID medium,-0.026,0.0521
208
+ run_Latn,Rundi,58,0.8992,0.8992,0.8,0.8,0.906,0.9391,0.9016,0.9391,MillID medium,0.0399,0.1391
209
+ crs_Latn,Seselwa Creole French,58,1.0,1.0,0.0,0.0,0.9739,0.9744,0.9655,0.9744,MillID medium,-0.0256,0.9744
210
+ sco_Latn,Scots,58,0.9735,0.9735,0.0,0.0,0.9739,0.9825,0.9735,0.9825,MillID medium,0.009,0.9825
211
+ rus_Cyrl,Russian,58,0.9667,0.9667,0.7838,0.7838,0.9831,0.9573,0.9661,0.9831,MillID tiny,0.0164,0.1993
212
+ fuf_Latn,Pular,58,0.4828,0.4828,0.0,0.0,0.8972,0.8163,0.9159,0.9159,MillID large,0.4331,0.9159
213
+ glg_Latn,Galician,58,1.0,1.0,0.8286,0.8286,0.9744,0.9913,0.9667,0.9913,MillID medium,-0.0087,0.1627
214
+ guj_Gujr,Gujarati,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
215
+ guc_Latn,Wayuu,58,1.0,1.0,0.0,0.0,0.9748,0.9667,1.0,1.0,MillID large,0.0,1.0
216
+ pan_Guru,Punjabi,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
217
+ pap_Latn,Papiamento,58,0.9915,0.9915,0.725,0.725,0.9825,1.0,1.0,1.0,MillID medium,0.0085,0.275
218
+ pcd_Latn,Picard,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
219
+ glv_Latn,Manx,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
220
+ huu_Latn,Murui Huitoto,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
221
+ hrv_Latn,Croatian,58,0.7273,0.7273,0.4737,0.4737,0.4974,0.5371,0.5828,0.5828,MillID large,-0.1445,0.1091
222
+ hnj_Latn,Hmong Njua,58,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
223
+ ibo_Latn,Igbo,58,1.0,1.0,0.8227,0.8227,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.1773
224
+ hil_Latn,Hiligaynon,58,1.0,1.0,0.0,0.0,1.0,0.9739,0.9825,1.0,MillID tiny,0.0,1.0
225
+ heb_Hebr,Hebrew,58,1.0,1.0,1.0,1.0,1.0,0.9913,0.9913,1.0,MillID tiny,0.0,0.0
226
+ haw_Latn,Hawaiian,58,0.9735,0.9735,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0265,1.0
227
+ nso_Latn,Northern Sotho,58,1.0,1.0,0.9508,0.9508,1.0,1.0,0.9915,1.0,MillID tiny,0.0,0.0492
228
+ nno_Latn,Norwegian Nynorsk,58,1.0,1.0,0.9748,0.9748,0.9739,0.9744,0.9643,0.9744,MillID medium,-0.0256,-0.0004
229
+ nld_Latn,Dutch,58,1.0,1.0,0.703,0.703,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.297
230
+ niu_Latn,Niuean,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
231
+ nds_Latn,Low German,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
232
+ uzn_Cyrl,Northern Uzbek,58,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
233
+ ast_Latn,Asturian,58,1.0,1.0,0.7484,0.7484,0.955,0.9825,0.9735,0.9825,MillID medium,-0.0175,0.2341
234
+ tyv_Cyrl,Tuvinian,58,0.9915,0.9915,0.0,0.0,1.0,0.9915,0.9915,1.0,MillID tiny,0.0085,1.0
235
+ tsn_Latn,Tswana,58,0.9915,0.9915,0.9134,0.9134,1.0,1.0,0.9915,1.0,MillID tiny,0.0085,0.0866
236
+ bci_Latn,Baoulé,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
237
+ bel_Cyrl,Belarusian,58,1.0,1.0,0.8345,0.8345,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.1655
238
+ bba_Latn,Baatonum,58,0.9913,1.0,0.0,0.0,0.9744,0.9913,0.9828,0.9913,MillID medium,-0.0087,0.9913
239
+ azj_Latn,North Azerbaijani,58,0.9915,0.9915,0.5949,0.5949,0.9915,0.9915,1.0,1.0,MillID large,0.0085,0.4051
240
+ ben_Beng,Bangla,58,1.0,1.0,1.0,1.0,1.0,1.0,0.9913,1.0,MillID tiny,0.0,0.0
241
+ uzn_Latn,Northern Uzbek,58,0.9915,0.9915,0.4056,0.4056,0.9587,0.928,0.8992,0.9587,MillID tiny,-0.0328,0.5531
242
+ vec_Latn,Venetian,58,1.0,1.0,0.8056,0.8056,0.9915,0.9828,0.9667,0.9915,MillID tiny,-0.0085,0.1859
243
+ vep_Latn,Veps,58,1.0,1.0,0.0,0.0,0.9744,0.9913,1.0,1.0,MillID large,0.0,1.0
244
+ zul_Latn,Zulu,58,0.9744,0.9744,0.6073,0.6073,0.8909,0.9107,0.8119,0.9107,MillID medium,-0.0637,0.3034
245
+ tzo_Latn,Tzotzil,58,0.9913,0.9913,0.0,0.0,0.9735,0.9735,0.9735,0.9735,MillID tiny,-0.0178,0.9735
246
+ ukr_Cyrl,Ukrainian,58,1.0,1.0,0.9667,0.9667,0.9913,1.0,0.9735,1.0,MillID medium,0.0,0.0333
247
+ uig_Arab,Uyghur,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
248
+ swh_Latn,Swahili,58,0.9825,0.9825,0.5088,0.5088,0.8491,0.9455,0.8785,0.9455,MillID medium,-0.037,0.4367
249
+ tel_Telu,Telugu,58,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
250
+ tet_Latn,Tetum,58,0.1667,0.1667,0.0,0.0,0.6234,0.6986,0.726,0.726,MillID large,0.5593,0.726
251
+ tir_Ethi,Tigrinya,58,1.0,1.0,0.9915,0.9915,1.0,0.9915,1.0,1.0,MillID tiny,0.0,0.0085
252
+ cat_Latn,Catalan,58,1.0,1.0,0.6905,0.6905,0.9828,0.9667,0.9831,0.9831,MillID large,-0.0169,0.2926
253
+ bum_Latn,Bulu,58,0.0984,0.0984,0.0,0.0,0.2424,0.3188,0.4737,0.4737,MillID large,0.3753,0.4737
254
+ bul_Cyrl,Bulgarian,58,1.0,1.0,1.0,1.0,0.9744,0.9913,0.9915,0.9915,MillID large,-0.0085,-0.0085
255
+ cnh_Latn,Hakha Chin,58,0.9915,0.9915,0.0,0.0,0.9344,0.9828,1.0,1.0,MillID large,0.0085,1.0
256
+ ces_Latn,Czech,58,1.0,1.0,0.9508,0.9508,1.0,0.9915,0.9828,1.0,MillID tiny,0.0,0.0492
257
+ chk_Latn,Chuukese,58,1.0,1.0,0.0,0.0,0.9915,1.0,1.0,1.0,MillID medium,0.0,1.0
258
+ sus_Latn,Susu,58,0.9748,0.9748,0.0,0.0,0.9369,0.9643,0.9474,0.9643,MillID medium,-0.0105,0.9643
259
+ srr_Latn,Serer,58,0.9831,0.9831,0.0,0.0,0.9825,1.0,0.9825,1.0,MillID medium,0.0169,1.0
260
+ suk_Latn,Sukuma,58,0.9828,0.9828,0.0,0.0,0.9828,0.9825,0.9913,0.9913,MillID large,0.0085,0.9913
261
+ sme_Latn,Northern Sami,58,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
262
+ eng_Latn,English,58,1.0,1.0,0.5979,0.5979,0.9123,0.9744,0.9573,0.9744,MillID medium,-0.0256,0.3765
263
+ dyu_Latn,Dyula,58,0.4337,0.4337,0.0154,0.0154,0.0,0.0,0.0,0.0,MillID tiny,-0.4337,-0.0154
264
+ tpi_Latn,Tok Pisin,58,1.0,1.0,0.9831,0.9831,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0169
265
+ zyb_Latn,Yongbei Zhuang,57,0.9828,0.9744,0.0,0.0,1.0,0.9744,0.9913,1.0,MillID tiny,0.0256,1.0
266
+ bam_Latn,Bambara,57,0.7519,0.7519,0.1992,0.1969,0.7786,0.6267,0.6145,0.7786,MillID tiny,0.0267,0.5817
267
+ bem_Latn,Bemba,57,1.0,1.0,0.4385,0.4385,0.9912,0.9828,0.9649,0.9912,MillID tiny,-0.0088,0.5527
268
+ toj_Latn,Tojolabal,57,1.0,1.0,0.0,0.0,0.9912,0.9913,1.0,1.0,MillID large,0.0,1.0
269
+ toi_Latn,Tonga (Zambia),57,1.0,1.0,0.0,0.0,0.9828,0.9636,0.9913,0.9913,MillID large,-0.0087,0.9913
270
+ tdt_Latn,Tetun Dili,57,0.6115,0.6115,0.0,0.0,0.2532,0.4884,0.5176,0.5176,MillID large,-0.0939,0.5176
271
+ cbt_Latn,Chayahuita,57,0.9913,0.9913,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0087,1.0
272
+ tah_Latn,Tahitian,57,0.8125,0.8125,0.9661,0.9661,0.9444,0.973,0.9821,0.9821,MillID large,0.1696,0.016
273
+ cha_Latn,Chamorro,57,0.9245,0.9245,0.0,0.0,1.0,0.9825,1.0,1.0,MillID tiny,0.0755,1.0
274
+ sot_Latn,Southern Sotho,57,1.0,1.0,0.7863,0.7863,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.2137
275
+ som_Latn,Somali,57,1.0,1.0,0.6994,0.6994,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.3006
276
+ cfm_Latn,Falam Chin,57,0.9821,0.9821,0.0,0.0,0.9913,0.9828,1.0,1.0,MillID large,0.0179,1.0
277
+ tat_Cyrl,Tatar,57,1.0,1.0,0.5938,0.5938,1.0,0.9912,0.9912,1.0,MillID tiny,0.0,0.4062
278
+ cak_Latn,Kaqchikel,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
279
+ tgk_Cyrl,Tajik,57,1.0,1.0,0.623,0.623,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.377
280
+ abk_Cyrl,Abkhazian,57,1.0,1.0,0.9913,0.9913,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0087
281
+ tuk_Cyrl,Turkmen,57,1.0,1.0,0.0,0.0,1.0,0.973,0.9912,1.0,MillID tiny,0.0,1.0
282
+ pon_Latn,Pohnpeian,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
283
+ pau_Latn,Palauan,57,1.0,1.0,0.0,0.0,0.9913,1.0,1.0,1.0,MillID medium,0.0,1.0
284
+ pis_Latn,Pijin,57,0.9913,0.9913,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0087,1.0
285
+ quz_Latn,Cusco Quechua,57,0.8947,0.906,0.0,0.0,0.8174,0.8829,0.887,0.887,MillID large,-0.019,0.887
286
+ fat_Latn,Fanti,57,0.9913,0.9913,0.0,0.0,1.0,0.9744,0.9828,1.0,MillID tiny,0.0087,1.0
287
+ kjh_Cyrl,Khakas,57,0.9913,0.9913,0.0,0.0,0.9828,1.0,0.9913,1.0,MillID medium,0.0087,1.0
288
+ khk_Cyrl,Halh Mongolian,57,0.9912,0.9912,0.8976,0.8976,1.0,1.0,1.0,1.0,MillID tiny,0.0088,0.1024
289
+ kek_Latn,Kekchí,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
290
+ mri_Latn,Māori,57,1.0,1.0,0.3826,0.3813,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.6187
291
+ agr_Latn,Aguaruna,57,0.9739,0.9739,0.0,0.0,0.9913,0.9655,0.9492,0.9913,MillID tiny,0.0174,0.9913
292
+ aii_Syrc,Assyrian Neo-Aramaic,57,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
293
+ koi_Cyrl,Komi-Permyak,57,1.0,1.0,0.0,0.0,0.7191,0.8367,0.8485,0.8485,MillID large,-0.1515,0.8485
294
+ yor_Latn,Yoruba,57,0.9913,0.9913,0.7808,0.7808,1.0,0.9913,1.0,1.0,MillID tiny,0.0087,0.2192
295
+ lao_Laoo,Lao,57,1.0,1.0,1.0,1.0,1.0,1.0,0.9912,1.0,MillID tiny,0.0,0.0
296
+ cbu_Latn,Candoshi-Shapra,57,0.8824,0.8738,0.0,0.0,0.6667,0.3714,0.1846,0.6667,MillID tiny,-0.2071,0.6667
297
+ qvn_Latn,North Junín Quechua,57,0.4595,0.4595,0.0,0.0,0.2609,0.2188,0.0952,0.2609,MillID tiny,-0.1986,0.2609
298
+ quh_Latn,South Bolivian Quechua,57,0.9369,0.9649,0.0,0.0,0.9655,0.9828,0.9661,0.9828,MillID medium,0.0179,0.9828
299
+ qxn_Latn,Northern Conchucos Ancash Quechua,57,0.0345,0.0345,0.0,0.0,0.0339,0.0345,0.0,0.0345,MillID medium,0.0,0.0345
300
+ fao_Latn,Faroese,57,1.0,1.0,0.7473,0.7473,1.0,0.9913,0.9913,1.0,MillID tiny,0.0,0.2527
301
+ sid_Latn,Sidamo,57,0.9268,0.9268,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0732,1.0
302
+ sah_Cyrl,Yakut,57,0.958,0.958,0.0,0.0,1.0,0.9913,1.0,1.0,MillID tiny,0.042,1.0
303
+ dag_Latn,Dagbani,57,0.9739,0.9739,0.0,0.0,0.9739,0.9825,0.9412,0.9825,MillID medium,0.0086,0.9825
304
+ rup_Latn,Aromanian,57,1.0,1.0,0.0,0.0,0.9913,0.9913,0.9913,0.9913,MillID tiny,-0.0087,0.9913
305
+ div_Thaa,Divehi,57,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
306
+ pbb_Latn,Páez,56,0.7126,0.7126,0.0,0.0,0.5455,0.8485,0.8454,0.8485,MillID medium,0.1359,0.8485
307
+ gle_Latn,Irish,56,0.9825,0.9825,1.0,1.0,1.0,0.9912,0.9912,1.0,MillID tiny,0.0175,0.0
308
+ bho_Deva,Bhojpuri,56,0.9333,0.9333,0.8317,0.8317,0.7872,0.6429,0.6966,0.7872,MillID tiny,-0.1461,-0.0445
309
+ slk_Latn,Slovak,56,1.0,1.0,0.9256,0.9256,0.9912,0.9821,0.9912,0.9912,MillID tiny,-0.0088,0.0656
310
+ ura_Latn,Urarina,56,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
311
+ azj_Cyrl,North Azerbaijani,56,1.0,1.0,0.0,0.0,1.0,0.9912,1.0,1.0,MillID tiny,0.0,1.0
312
+ shn_Mymr,Shan,56,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0
313
+ ady_Cyrl,Adyghe,56,0.9818,0.9818,0.6707,0.6707,0.9725,0.991,0.9818,0.991,MillID medium,0.0092,0.3203
314
+ mya_Mymr,Burmese,56,1.0,1.0,0.6707,0.6707,0.9818,0.991,1.0,1.0,MillID large,0.0,0.3293
315
+ mos_Latn,Mossi,56,1.0,1.0,0.855,0.855,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.145
316
+ lun_Latn,Lunda,56,0.991,0.991,0.0,0.0,1.0,1.0,0.9912,1.0,MillID tiny,0.009,1.0
317
+ pcm_Latn,Nigerian Pidgin,56,0.9402,0.9412,0.8627,0.955,0.9912,0.9825,1.0,1.0,MillID large,0.0588,0.045
318
+ yrk_Cyrl,Nenets,55,0.972,0.972,0.0,0.0,0.972,0.9815,0.9815,0.9815,MillID medium,0.0095,0.9815
319
+ mnw_Mymr,Mon,55,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
320
+ yad_Latn,Yagua,55,0.9815,0.9815,0.0,0.0,0.9908,1.0,1.0,1.0,MillID medium,0.0185,1.0
321
+ dyo_Latn,Jola-Fonyi,55,0.9908,1.0,0.0,0.0,0.9908,0.9815,0.9818,0.9908,MillID tiny,-0.0092,0.9908
322
+ san_Deva,Sanskrit,55,0.9908,0.9908,0.973,0.973,0.9908,0.9908,0.9815,0.9908,MillID tiny,0.0,0.0178
323
+ npi_Deva,Nepali,55,0.9908,0.9908,0.9565,0.9565,1.0,1.0,1.0,1.0,MillID tiny,0.0092,0.0435
324
+ ido_Latn,Ido,55,1.0,1.0,0.0,0.0,0.9908,0.9815,0.955,0.9908,MillID tiny,-0.0092,0.9908
325
+ tem_Latn,Timne,55,1.0,1.0,0.0,0.0,1.0,0.991,1.0,1.0,MillID tiny,0.0,1.0
326
+ kbd_Cyrl,Kabardian,55,0.9735,0.9735,0.0,0.0,0.9735,0.991,0.9821,0.991,MillID medium,0.0175,0.991
327
+ koo_Latn,Konzo,54,0.9615,0.9615,0.0,0.0,0.9515,0.9714,1.0,1.0,MillID large,0.0385,1.0
328
+ dje_Latn,Zarma,54,0.9412,0.9515,0.0,0.0,0.9412,0.8866,0.875,0.9412,MillID tiny,-0.0103,0.9412
329
+ mag_Deva,Magahi,53,0.9444,0.9444,0.6323,0.6323,0.8333,0.7963,0.7928,0.8333,MillID tiny,-0.1111,0.201
330
+ plt_Latn,Malagasy (Plateau),53,1.0,0.9907,0.955,0.955,1.0,1.0,1.0,1.0,MillID tiny,0.0093,0.045
331
+ cni_Latn,Asháninka,52,0.963,0.963,0.0,0.0,0.75,0.7075,0.7482,0.75,MillID tiny,-0.213,0.75
332
+ yao_Latn,Yao,52,0.9903,0.9903,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0097,1.0
333
+ idu_Latn,Idoma,51,0.8791,0.9375,0.0,0.0,0.7407,0.9278,0.7711,0.9278,MillID medium,-0.0097,0.9278
334
+ alt_Cyrl,Southern Altai,51,0.9623,0.9623,0.6986,0.6986,0.9714,0.9903,0.9903,0.9903,MillID medium,0.028,0.2917
335
+ amh_Ethi,Amharic,51,1.0,1.0,0.8409,0.8409,1.0,0.9901,1.0,1.0,MillID tiny,0.0,0.1591
336
+ kde_Latn,Makonde,51,0.9703,0.9703,0.0,0.0,0.8958,0.9184,0.8913,0.9184,MillID medium,-0.0519,0.9184
337
+ mto_Latn,Totontepec Mixe,51,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
338
+ miq_Latn,Mískito,51,1.0,1.0,0.0,0.0,1.0,1.0,0.9808,1.0,MillID tiny,0.0,1.0
339
+ zdj_Latn,Ngazidja Comorian,50,0.9796,0.9899,0.0,0.0,0.9901,1.0,1.0,1.0,MillID medium,0.0101,1.0
340
+ nyn_Latn,Nyankole,50,0.9796,0.9796,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0204,1.0
341
+ yue_Hani,Cantonese,49,0.5797,0.5797,0.1108,0.1108,0.7473,0.6522,0.5714,0.7473,MillID tiny,0.1676,0.6365
342
+ lug_Latn,Ganda,49,1.0,1.0,0.359,0.359,0.9796,0.9897,1.0,1.0,MillID large,0.0,0.641
343
+ eve_Cyrl,Even,49,0.8864,0.8864,0.0,0.0,1.0,0.9897,1.0,1.0,MillID tiny,0.1136,1.0
344
+ gyr_Latn,Guarayu,49,0.9897,0.9897,0.0,0.0,0.5797,0.339,0.1818,0.5797,MillID tiny,-0.41,0.5797
345
+ gug_Latn,Paraguayan Guaraní,49,1.0,1.0,0.2367,0.2367,0.98,0.9515,0.9899,0.9899,MillID large,-0.0101,0.7532
346
+ wuu_Hani,Wu Chinese,48,0.5562,0.5529,0.0,0.0,0.5875,0.6277,0.5874,0.6277,MillID medium,0.0748,0.6277
347
+ nan_Hani,Min Nan Chinese,48,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,MillID tiny,0.0,0.0
348
+ hak_Hani,Hakka Chinese,48,0.0408,0.0408,0.0,0.0,0.0714,0.0,0.0,0.0714,MillID tiny,0.0306,0.0714
349
+ bin_Latn,Bini,47,0.9318,0.9318,0.0,0.0,0.9438,0.9892,1.0,1.0,MillID large,0.0682,1.0
350
+ lia_Latn,West-Central Limba,45,1.0,1.0,0.0,0.0,0.9888,0.9888,1.0,1.0,MillID large,0.0,1.0
351
+ ike_Cans,Eastern Canadian Inuktitut,44,0.9778,0.9778,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0222,1.0
352
+ oss_Cyrl,Ossetic,44,1.0,1.0,0.9778,0.9778,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0222
353
+ ojb_Cans,Northwestern Ojibwa,43,0.9639,0.9639,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0361,1.0
354
+ cbs_Latn,Cashinahua,43,0.9647,0.9647,0.0,0.0,0.9882,0.9885,1.0,1.0,MillID large,0.0353,1.0
355
+ ese_Latn,Ese Ejja,35,0.9855,0.9855,0.0,0.0,1.0,0.9855,1.0,1.0,MillID tiny,0.0145,1.0
356
+ tzh_Latn,Tzeltal,25,0.9804,0.9804,0.0,0.0,0.9434,0.9434,0.9615,0.9615,MillID large,-0.0189,0.9615
357
+ chv_Cyrl,Chuvash,25,1.0,1.0,0.9434,0.9434,1.0,1.0,1.0,1.0,MillID tiny,0.0,0.0566
358
+ taj_Deva,Eastern Tamang,1,1.0,1.0,0.0,0.0,1.0,1.0,1.0,1.0,MillID tiny,0.0,1.0
359
+ tzm_Tfng,Central Atlas Tamazight,1,0.0645,0.0645,0.0328,0.0328,0.1,0.3333,0.1429,0.3333,MillID medium,0.2688,0.3005