Spaces:
Runtime error
Runtime error
Update README.md
Browse files
README.md
CHANGED
|
@@ -116,7 +116,7 @@ Final stress test verification leveraging OpenRouter API failover.
|
|
| 116 |
| `openai/gpt-4o-mini` | π **OpenRouter** | 0.833 | 0.667 | 0.581 | **0.694** | 90% |
|
| 117 |
| `meta-llama/llama-3.3-70b-instruct` | π **OpenRouter** | 0.500 | 0.833 | 0.545 | **0.626** | 94% |
|
| 118 |
| `qwen/qwen-2.5-72b-instruct` | π **OpenRouter** | 0.800 | 0.556 | 0.500 | **0.619** | 97% |
|
| 119 |
-
| `mistralai/mistral-small-3.1-24b` | π **OpenRouter** | 0.001 | 0.001 | 0.999 | **0.334** |
|
| 120 |
|
| 121 |
### π§ Performance Analysis: Why Models Succeed or Fail
|
| 122 |
Our deterministic grading environment reveals deep behaviors not captured by standard multiple-choice benchmarks:
|
|
|
|
| 116 |
| `openai/gpt-4o-mini` | π **OpenRouter** | 0.833 | 0.667 | 0.581 | **0.694** | 90% |
|
| 117 |
| `meta-llama/llama-3.3-70b-instruct` | π **OpenRouter** | 0.500 | 0.833 | 0.545 | **0.626** | 94% |
|
| 118 |
| `qwen/qwen-2.5-72b-instruct` | π **OpenRouter** | 0.800 | 0.556 | 0.500 | **0.619** | 97% |
|
| 119 |
+
| `mistralai/mistral-small-3.1-24b` | π **OpenRouter** | 0.001 | 0.001 | 0.999 | **0.334** | 10% |
|
| 120 |
|
| 121 |
### π§ Performance Analysis: Why Models Succeed or Fail
|
| 122 |
Our deterministic grading environment reveals deep behaviors not captured by standard multiple-choice benchmarks:
|