Update README.md
Browse files
README.md
CHANGED
|
@@ -7,7 +7,7 @@ tags:
|
|
| 7 |
---
|
| 8 |
# arco 2
|
| 9 |
|
| 10 |
-
This is a
|
| 11 |
|
| 12 |
| Parameters | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
| 13 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
|
|
|
| 7 |
---
|
| 8 |
# arco 2
|
| 9 |
|
| 10 |
+
This is a passthrough of arco with an experimental model. As you can see, it dramatically improved on arc challenge, only missing 2 points to get to the level of modern 3b baseline performance.
|
| 11 |
|
| 12 |
| Parameters | Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
| 13 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|