Update README.md
Browse files
README.md
CHANGED
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
|
| 12 |
# arco lite
|
| 13 |
|
| 14 |
-
arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil
|
| 15 |
|
| 16 |
#### benchmarks
|
| 17 |
|
|
@@ -20,7 +20,7 @@ zero-shot evaluations performed on current sota ~0.5b models.
|
|
| 20 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 21 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 22 |
| 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
|
| 23 |
-
| 488m | arco-lite |
|
| 24 |
|
| 25 |
#### Configuration
|
| 26 |
|
|
|
|
| 11 |
|
| 12 |
# arco lite
|
| 13 |
|
| 14 |
+
arco lite is a passthrough arco model based on danube outputs to keep generality, even though its performance decreased, it's stil competitive to qwen2 at most benchmarks.
|
| 15 |
|
| 16 |
#### benchmarks
|
| 17 |
|
|
|
|
| 20 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 21 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
| 22 |
| 494m | qwen2 |**44.13**| 28.92| 49.05 | 69.31 | 56.99 | 49.68 |
|
| 23 |
+
| 488m | arco-lite | 23.22 | **33.45** | 0 | **69.70** | **59.19**| 49.66 |
|
| 24 |
|
| 25 |
#### Configuration
|
| 26 |
|