Update README.md
Browse files
README.md
CHANGED
|
@@ -95,6 +95,12 @@ model-index:
|
|
| 95 |
<sub>Setup: `lm-evaluation-harness` (CETVEL tasks), H100 80GB, bf16, SDPA attention, batch size 128, full dataset (no `--limit`).</sub>
|
| 96 |
|
| 97 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 98 |
<tr><th style="text-align:left">CohereLabs__aya-expanse-32b</th>
|
| 99 |
<td style="background:#ffeb9c">52.47</td>
|
| 100 |
<td style="background:#f8cbad">20.48</td>
|
|
@@ -183,6 +189,7 @@ model-index:
|
|
| 183 |
</tbody>
|
| 184 |
</table>
|
| 185 |
|
|
|
|
| 186 |
> **Notes**
|
| 187 |
> • QA = mean F1 over **TQuAD (TR)** and **XQuAD (TR)** for this run.
|
| 188 |
|
|
|
|
| 95 |
<sub>Setup: `lm-evaluation-harness` (CETVEL tasks), H100 80GB, bf16, SDPA attention, batch size 128, full dataset (no `--limit`).</sub>
|
| 96 |
|
| 97 |
|
| 98 |
+
<table>
|
| 99 |
+
<thead>
|
| 100 |
+
<tr><th style="text-align:left">Model</th><th>MCQA</th><th>QA</th><th>TC</th></tr>
|
| 101 |
+
</thead>
|
| 102 |
+
<tbody>
|
| 103 |
+
|
| 104 |
<tr><th style="text-align:left">CohereLabs__aya-expanse-32b</th>
|
| 105 |
<td style="background:#ffeb9c">52.47</td>
|
| 106 |
<td style="background:#f8cbad">20.48</td>
|
|
|
|
| 189 |
</tbody>
|
| 190 |
</table>
|
| 191 |
|
| 192 |
+
|
| 193 |
> **Notes**
|
| 194 |
> • QA = mean F1 over **TQuAD (TR)** and **XQuAD (TR)** for this run.
|
| 195 |
|