Update README.md

README.md

@@ -66,26 +66,16 @@ Rather than training one model, we trained multiple models, each on a different
 # Results
 
 Accuracy is normalized by length and shown as a percentage.
-| Dataset           |   ARC-Easy | ARC-Challenge |  HellaSwag |       PIQA |      BLiMP |  **Avg ↑** |   **II ↑** |
-| :---------------- | ---------: | ------------: | ---------: | ---------: | ---------: | ---------: | ---------: |
-| FineWeb           |     27.82% |        22.01% |     26.89% |     52.83% |     65.21% | **38.95%** | **38.46%** |
-| DCLM-1.0-Baseline |     29.08% |        22.41% |     27.06% |     52.23% |     66.16% | **39.39%** | **38.85%** |
-| DOAB              |     31.14% |        20.99% |     28.00% |     52.18% |     62.15% | **38.89%** | **38.81%** |
-| Project Gutenberg |     25.84% |        23.04% |     24.63% |     50.21% |     64.07% | **37.56%** | **36.74%** |
-| EOT-2004-Raw      |     29.08% |        21.50% |     27.54% |     51.31% |     59.92% | **37.87%** | **37.72%** |
-| Wikipedia         |     28.28% |        21.16% |     27.61% |     51.14% |     61.06% | **37.83%** | **37.60%** |
-
-
-The II is calculated based on these weights:
-
-| Benchmark     | Weight | Note (Why?)                                                                                 |
-| :------------ | -----: | :------------------------------------------------------------------------------------------ |
-| ARC-Easy      |   1.00 | —                                                                                           |
-| ARC-Challenge |   0.5  | ARC-Challenge is consistently below chance at small scales, so we assign it a much lower weight. |
-| HellaSwag     |   1.00 | —                                                                                           |
-| PIQA          |   1.00 | —                                                                                           |
-| BLiMP         |   0.60 | BLiMP primarily measures grammatical correctness rather than broader reasoning ability.     |
+| Dataset           |   ARC-Easy |  HellaSwag |       PIQA |  **Avg ↑** |
+| :---------------- | ---------: | ---------: | ---------: | ---------: |
+| FineWeb           |     27.82% |     26.89% |     52.83% | **35.85%** |
+| DCLM-1.0-Baseline |     29.08% |     27.06% |     52.23% | **36.12%** |
+| DOAB              |     31.14% |     28.00% |     52.18% | **37.11%** |
+| Project Gutenberg |     25.84% |     24.63% |     50.21% | **33.56%** |
+| EOT-2004-Raw      |     29.08% |     27.54% |     51.31% | **35.98%** |
+| Wikipedia         |     28.28% |     27.61% |     51.14% | **35.68%** |
 
+(Will add ArithMark-3.0 later)
 ## Notice
 
 This is a work in progress and is currently not completed. By the end of this project, we aim to have tested over 50 datasets.