Fixed the benchmark scores. (#2)
Browse files- Fixed the benchmark scores. (37597da16e985049592a8fd90e95bb5610b09f57)
README.md
CHANGED
|
@@ -55,12 +55,12 @@ Pebble-10M-Chat was evaluated on several commonsense and arithmetic benchmarks.
|
|
| 55 |
|
| 56 |
| Benchmark | Accuracy | Random Baseline |
|
| 57 |
|-----------------|----------|-----------------|
|
| 58 |
-
| PIQA |
|
| 59 |
-
| ARC-Easy |
|
| 60 |
-
| ARC-Challenge |
|
| 61 |
-
| HellaSwag |
|
| 62 |
-
| ArithMark-2.0 | 27.
|
| 63 |
-
| ArithMark-3.0 |
|
| 64 |
|
| 65 |
### Evaluation Notes
|
| 66 |
|
|
|
|
| 55 |
|
| 56 |
| Benchmark | Accuracy | Random Baseline |
|
| 57 |
|-----------------|----------|-----------------|
|
| 58 |
+
| PIQA | 51.41% | 50.00% |
|
| 59 |
+
| ARC-Easy | 26.09% | 25.00% |
|
| 60 |
+
| ARC-Challenge | 20.22% | 25.00% |
|
| 61 |
+
| HellaSwag | 25.30% | 25.00% |
|
| 62 |
+
| ArithMark-2.0 | 27.28% | 25.00% |
|
| 63 |
+
| ArithMark-3.0 | 27.50% | 25.00% |
|
| 64 |
|
| 65 |
### Evaluation Notes
|
| 66 |
|