Update README.md
Browse files
README.md
CHANGED
|
@@ -89,9 +89,6 @@ Average: 75.9% without mmlu
|
|
| 89 |
Average: 49.08%
|
| 90 |
|
| 91 |
### GPT4ALL
|
| 92 |
-
|
| 93 |
-
Here is the generated table in the desired format using the JSON data provided:
|
| 94 |
-
|
| 95 |
| Task | Version | Metric | Value | | Stderr |
|
| 96 |
|------------|---------|--------|-------|---|--------|
|
| 97 |
| arc\_challenge | 0 | acc | 66.29 | _ | 1.38 |
|
|
@@ -107,7 +104,32 @@ Average: 49.08%
|
|
| 107 |
| | | acc\_norm | 84.87 | _ | 0.84 |
|
| 108 |
| winogrande | 0 | acc | 81.06 | _ | 1.10 |
|
| 109 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 110 |
|
|
|
|
| 111 |
|
| 112 |
### Training hyperparameters
|
| 113 |
|
|
|
|
| 89 |
Average: 49.08%
|
| 90 |
|
| 91 |
### GPT4ALL
|
|
|
|
|
|
|
|
|
|
| 92 |
| Task | Version | Metric | Value | | Stderr |
|
| 93 |
|------------|---------|--------|-------|---|--------|
|
| 94 |
| arc\_challenge | 0 | acc | 66.29 | _ | 1.38 |
|
|
|
|
| 104 |
| | | acc\_norm | 84.87 | _ | 0.84 |
|
| 105 |
| winogrande | 0 | acc | 81.06 | _ | 1.10 |
|
| 106 |
|
| 107 |
+
Average: 68.75%
|
| 108 |
+
|
| 109 |
+
### AGIEVAL
|
| 110 |
+
|
| 111 |
+
Here is the converted table in the required format, including multiplication of all values by 100 and calculating the average for the value column:
|
| 112 |
+
|
| 113 |
+
| Task | Version | Metric | Value | StdErr |
|
| 114 |
+
| --- | --- | --- | --- | --- |
|
| 115 |
+
| agieval\_aqua\_rat | | acc | 28.35 | 2.83 |
|
| 116 |
+
| | | acc\_norm | 26.38 | 2.77 |
|
| 117 |
+
| agieval\_logiqa\_en | | acc | 38.25 | 1.91 |
|
| 118 |
+
| | | acc\_norm | 38.09 | 1.90 |
|
| 119 |
+
| agieval\_lsat\_ar | | acc | 23.91 | 2.82 |
|
| 120 |
+
| | | acc\_norm | 23.48 | 2.80 |
|
| 121 |
+
| agieval\_lsat\_lr | | acc | 52.75 | 2.21 |
|
| 122 |
+
| | | acc\_norm | 53.92 | 2.21 |
|
| 123 |
+
| agieval\_lsat\_rc | | acc | 66.91 | 2.87 |
|
| 124 |
+
| | | acc\_norm | 67.29 | 2.87 |
|
| 125 |
+
| agieval\_sat\_en | | acc | 78.64 | 2.86 |
|
| 126 |
+
| | | acc\_norm | 78.64 | 2.86 |
|
| 127 |
+
| agieval\_sat\_en\_without\_passage | | acc | 45.15 | 3.48 |
|
| 128 |
+
| | | acc\_norm | 44.17 | 3.47 |
|
| 129 |
+
| agieval\_sat\_math | | acc | 33.18 | 3.18 |
|
| 130 |
+
| | | acc\_norm | 31.36 | 3.14 |
|
| 131 |
|
| 132 |
+
Average: 47.44%
|
| 133 |
|
| 134 |
### Training hyperparameters
|
| 135 |
|