Update README.md
Browse files
README.md
CHANGED
|
@@ -66,13 +66,15 @@ Rather than training one model, we trained multiple models, each on a different
|
|
| 66 |
# Results
|
| 67 |
|
| 68 |
Accuracy is normalized by length and shown as a percentage.
|
| 69 |
-
| Dataset |
|
| 70 |
-
| :---------------- | -------: | ------------: | --------: | -----: | -----: | ---------: | ---------: |
|
| 71 |
-
| FineWeb |
|
| 72 |
-
| DCLM-1.0-Baseline |
|
| 73 |
-
| DOAB |
|
| 74 |
-
| Project Gutenberg |
|
| 75 |
-
| EOT-2004-Raw |
|
|
|
|
|
|
|
| 76 |
|
| 77 |
The II is calculated based on these weights:
|
| 78 |
|
|
|
|
| 66 |
# Results
|
| 67 |
|
| 68 |
Accuracy is normalized by length and shown as a percentage.
|
| 69 |
+
| Dataset | ARC-Easy | ARC-Challenge | HellaSwag | PIQA | BLiMP | **Avg ↑** | **II ↑** |
|
| 70 |
+
| :---------------- | ---------: | ------------: | ---------: | ---------: | ---------: | ---------: | ---------: |
|
| 71 |
+
| FineWeb | 27.82% | 22.01% | 26.89% | 52.83% | 65.21% | **38.95%** | **38.46%** |
|
| 72 |
+
| DCLM-1.0-Baseline | 29.08% | 22.41% | 27.06% | 52.23% | 66.16% | **39.39%** | **38.85%** |
|
| 73 |
+
| DOAB | 31.14% | 20.99% | 28.00% | 52.18% | 62.15% | **38.89%** | **38.81%** |
|
| 74 |
+
| Project Gutenberg | 25.84% | 23.04% | 24.63% | 50.21% | 64.07% | **37.56%** | **36.74%** |
|
| 75 |
+
| EOT-2004-Raw | 29.08% | 21.50% | 27.54% | 51.31% | 59.92% | **37.87%** | **37.72%** |
|
| 76 |
+
| Wikipedia | 28.28% | 21.16% | 27.61% | 51.14% | 61.06% | **37.83%** | **37.60%** |
|
| 77 |
+
|
| 78 |
|
| 79 |
The II is calculated based on these weights:
|
| 80 |
|