Update README.md
Browse files
README.md
CHANGED
|
@@ -19,7 +19,7 @@ print(tok.decode(y[0], skip_special_tokens=True))
|
|
| 19 |
|
| 20 |
|
| 21 |
model-index:
|
| 22 |
-
- name: BEDAI-
|
| 23 |
results:
|
| 24 |
- task:
|
| 25 |
type: multiple-choice
|
|
@@ -72,7 +72,7 @@ model-index:
|
|
| 72 |
## Evaluation (CETVEL – Turkish subsets)
|
| 73 |
|
| 74 |
**BEDAI-2B:** MCQA **25.70**, QA **17.97**, TC **51.58**
|
| 75 |
-
**BEDAI-
|
| 76 |
|
| 77 |
<table>
|
| 78 |
<thead>
|
|
@@ -85,7 +85,7 @@ model-index:
|
|
| 85 |
<td style="background:#f8cbad">17.97</td>
|
| 86 |
<td style="background:#ffeb9c">51.58</td></tr>
|
| 87 |
|
| 88 |
-
<tr><th style="text-align:left">BEDAI-
|
| 89 |
<td style="background:#c6efce">34.00</td>
|
| 90 |
<td style="background:#c6efce">28.92</td>
|
| 91 |
<td style="background:#c6efce">52.00</td></tr>
|
|
|
|
| 19 |
|
| 20 |
|
| 21 |
model-index:
|
| 22 |
+
- name: BEDAI-2.4B
|
| 23 |
results:
|
| 24 |
- task:
|
| 25 |
type: multiple-choice
|
|
|
|
| 72 |
## Evaluation (CETVEL – Turkish subsets)
|
| 73 |
|
| 74 |
**BEDAI-2B:** MCQA **25.70**, QA **17.97**, TC **51.58**
|
| 75 |
+
**BEDAI-2.4B (this run, limit=50):** MCQA **34.00**, QA **28.92** (mean of TQuAD/XQuAD-TR F1), TC **52.00**
|
| 76 |
|
| 77 |
<table>
|
| 78 |
<thead>
|
|
|
|
| 85 |
<td style="background:#f8cbad">17.97</td>
|
| 86 |
<td style="background:#ffeb9c">51.58</td></tr>
|
| 87 |
|
| 88 |
+
<tr><th style="text-align:left">BEDAI-2.4B (this work) </th>
|
| 89 |
<td style="background:#c6efce">34.00</td>
|
| 90 |
<td style="background:#c6efce">28.92</td>
|
| 91 |
<td style="background:#c6efce">52.00</td></tr>
|