Update README.md
Browse files
README.md
CHANGED
|
@@ -84,4 +84,12 @@ The II is calculated based on these weights:
|
|
| 84 |
| ARC-Challenge | 0.5 | ARC-Challenge is consistently below chance at small scales, so we assign it a much lower weight. |
|
| 85 |
| HellaSwag | 1.00 | — |
|
| 86 |
| PIQA | 1.00 | — |
|
| 87 |
-
| BLiMP | 0.60 | BLiMP primarily measures grammatical correctness rather than broader reasoning ability. |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 84 |
| ARC-Challenge | 0.5 | ARC-Challenge is consistently below chance at small scales, so we assign it a much lower weight. |
|
| 85 |
| HellaSwag | 1.00 | — |
|
| 86 |
| PIQA | 1.00 | — |
|
| 87 |
+
| BLiMP | 0.60 | BLiMP primarily measures grammatical correctness rather than broader reasoning ability. |
|
| 88 |
+
|
| 89 |
+
## Notice
|
| 90 |
+
|
| 91 |
+
This is a work in progress and is currently not completed. By the end of this project, we aim to have tested over 50 datasets.
|
| 92 |
+
|
| 93 |
+
## License
|
| 94 |
+
|
| 95 |
+
Apache 2.0.
|