Update README.md
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ arco lite is a passthrough model based on danube outputs to keep generality, eve
|
|
| 17 |
|
| 18 |
zero-shot evaluations performed on current sota ~0.5b models.
|
| 19 |
|
| 20 |
-
| Parameters | Model | MMLU | ARC
|
| 21 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 22 |
| 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
|
| 23 |
| 488m | arco-lite | - | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
|
|
|
|
| 17 |
|
| 18 |
zero-shot evaluations performed on current sota ~0.5b models.
|
| 19 |
|
| 20 |
+
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 21 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 22 |
| 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
|
| 23 |
| 488m | arco-lite | - | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
|