Update README
Browse files
README.md
CHANGED
|
@@ -1,28 +1,31 @@
|
|
| 1 |
---
|
| 2 |
-
license: mit
|
| 3 |
-
---
|
| 4 |
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
|
| 9 |
-
|
|
| 10 |
-
| **
|
| 11 |
-
|
|
| 12 |
-
|
|
| 13 |
-
|
|
| 14 |
-
|
|
| 15 |
-
|
|
| 16 |
-
|
|
| 17 |
-
|
|
| 18 |
-
|
|
| 19 |
-
|
|
| 20 |
-
|
|
| 21 |
-
|
|
| 22 |
-
|
|
| 23 |
-
|
|
| 24 |
-
|
|
| 25 |
-
|
|
| 26 |
-
|
|
| 27 |
-
|
|
| 28 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
|
|
|
| 2 |
|
| 3 |
+
## license: mit
|
| 4 |
+
|
| 5 |
+
|
| 6 |
+
| 配置 | GSM8K | SVAMP | GSM8K-hard | MultiArith |
|
| 7 |
+
| -------------------------- | ---------- | ---------- | ---------- | ---------- |
|
| 8 |
+
| **zero_shot** | 74.15% | 81.00% | 35.86% | 99.44% |
|
| 9 |
+
| eval_full_s0.0015_a0.0002 | 73.84% | 81.33% | 36.62% | 99.44% |
|
| 10 |
+
| eval_full_s0.0015_a0.00025 | 73.16% | 83.00% | 37.45% | 97.22% |
|
| 11 |
+
| **avg_full** | 73.50% | 82.17% | 37.04% | 98.50% |
|
| 12 |
+
| eval_r4_s0.02_a0.005 | 75.97% | 85.33% | 39.35% | 100.00% |
|
| 13 |
+
| eval_r4_s0.02_a0.0075 | 76.65% | 83.33% | 36.39% | 96.67% |
|
| 14 |
+
| eval_r4_s0.025_a0.0025 | 75.36% | 85.33% | 38.06% | 97.22% |
|
| 15 |
+
| **avg_r4** | 75.99% | 84.66% | 37.93% | 97.96% |
|
| 16 |
+
| eval_r8_s0.0225_a0.0035 | 75.66% | 83.00% | 37.98% | 98.33% |
|
| 17 |
+
| eval_r8_s0.0225_a0.0025 | 76.95% | 84.33% | 38.67% | 99.44% |
|
| 18 |
+
| eval_r8_s0.0225_a0.0025 | 76.42% | 82.33% | 37.98% | 97.78% |
|
| 19 |
+
| **avg_r8** | 76.34% | 83.22% | 38.21% | 98.52% |
|
| 20 |
+
| eval_r16_s0.0225_a0.005 | 75.82% | 85.67% | 39.12% | 98.89% |
|
| 21 |
+
| eval_r16_s0.0225_a0.0025 | 74.83% | 85.00% | 37.83% | 96.67% |
|
| 22 |
+
| eval_r16_s0.0225_a0.0035 | 75.66% | 83.67% | 38.89% | 98.33% |
|
| 23 |
+
| **avg_r16** | 75.44% | 84.78% | **38.61%** | 97.96% |
|
| 24 |
+
| eval_r64_s0.01_a0.0025 | 77.03% | 83.33% | 36.62% | 96.11% |
|
| 25 |
+
| eval_r64_s0.0085_a0.0025 | 75.59% | 84.33% | 37.68% | 96.11% |
|
| 26 |
+
| eval_r128_s0.008_a0.002 | 76.19% | 85.33% | 38.36% | 99.44% |
|
| 27 |
+
| eval_r128_s0.0075_a0.002 | 75.74% | 85.00% | 38.29% | 98.89% |
|
| 28 |
+
| eval_r128_s0.0075_a0.00225 | 77.48% | 85.00% | 37.45% | 100.00% |
|
| 29 |
+
| **avg_r128** | **76.47%** | **85.11%** | 38.03% | **99.44%** |
|
| 30 |
+
|
| 31 |
+
|