Harley-ml commited on
Commit
1c328d5
·
verified ·
1 Parent(s): 3fb2833

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -7
README.md CHANGED
@@ -66,13 +66,15 @@ Rather than training one model, we trained multiple models, each on a different
66
  # Results
67
 
68
  Accuracy is normalized by length and shown as a percentage.
69
- | Dataset | ARC-Easy | ARC-Challenge | HellaSwag | PIQA | BLiMP | **Avg ↑** | **II ↑** |
70
- | :---------------- | -------: | ------------: | --------: | -----: | -----: | ---------: | ---------: |
71
- | FineWeb | 27.82% | 22.01% | 26.89% | 52.83% | 65.21% | **38.95%** | **37.51%** |
72
- | DCLM-1.0-Baseline | 29.08% | 22.41% | 27.06% | 52.23% | 66.16% | **39.39%** | **37.95%** |
73
- | DOAB | 31.14% | 20.99% | 28.00% | 52.18% | 62.15% | **38.89%** | **37.59%** |
74
- | Project Gutenberg | 25.84% | 23.04% | 24.63% | 50.21% | 64.07% | **37.56%** | **36.35%** |
75
- | EOT-2004-Raw | 29.08% | 21.50% | 27.54% | 51.31% | 59.92% | **37.87%** | **36.91%** |
 
 
76
 
77
  The II is calculated based on these weights:
78
 
 
66
  # Results
67
 
68
  Accuracy is normalized by length and shown as a percentage.
69
+ | Dataset | ARC-Easy | ARC-Challenge | HellaSwag | PIQA | BLiMP | **Avg ↑** | **II ↑** |
70
+ | :---------------- | ---------: | ------------: | ---------: | ---------: | ---------: | ---------: | ---------: |
71
+ | FineWeb | 27.82% | 22.01% | 26.89% | 52.83% | 65.21% | **38.95%** | **38.46%** |
72
+ | DCLM-1.0-Baseline | 29.08% | 22.41% | 27.06% | 52.23% | 66.16% | **39.39%** | **38.85%** |
73
+ | DOAB | 31.14% | 20.99% | 28.00% | 52.18% | 62.15% | **38.89%** | **38.81%** |
74
+ | Project Gutenberg | 25.84% | 23.04% | 24.63% | 50.21% | 64.07% | **37.56%** | **36.74%** |
75
+ | EOT-2004-Raw | 29.08% | 21.50% | 27.54% | 51.31% | 59.92% | **37.87%** | **37.72%** |
76
+ | Wikipedia | 28.28% | 21.16% | 27.61% | 51.14% | 61.06% | **37.83%** | **37.60%** |
77
+
78
 
79
  The II is calculated based on these weights:
80