Update README.md
Browse files
README.md
CHANGED
|
@@ -58,7 +58,7 @@ The **`Skywork-OR1`** (Open Reasoner 1) model series consists of powerful math a
|
|
| 58 |
|
| 59 |
We evaluate our models on AIME24, AIME25, and LiveCodeBench. Instead of using Pass@1, which is common in prior work, we introduce Avg@K as the primary metric. This metric robustly measures a model's average performance across K independent attempts, reducing the impact of randomness and enhancing the reliability of the results. We believe that Avg@K provides a better reflection of a model's stability and reasoning consistency.
|
| 60 |
|
| 61 |
-
We
|
| 62 |
|
| 63 |
| Model | AIME24 (Avg@32) | AIME25 (Avg@32) | LiveCodeBench (8/1/24-2/1/25) (Avg@4) |
|
| 64 |
|-------|---------|---------|--------------|
|
|
|
|
| 58 |
|
| 59 |
We evaluate our models on AIME24, AIME25, and LiveCodeBench. Instead of using Pass@1, which is common in prior work, we introduce Avg@K as the primary metric. This metric robustly measures a model's average performance across K independent attempts, reducing the impact of randomness and enhancing the reliability of the results. We believe that Avg@K provides a better reflection of a model's stability and reasoning consistency.
|
| 60 |
|
| 61 |
+
We include the detailed results in the following table.
|
| 62 |
|
| 63 |
| Model | AIME24 (Avg@32) | AIME25 (Avg@32) | LiveCodeBench (8/1/24-2/1/25) (Avg@4) |
|
| 64 |
|-------|---------|---------|--------------|
|