DeepParmar commited on
Commit
7a94b1c
Β·
unverified Β·
1 Parent(s): 2624b79

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -116,7 +116,7 @@ Final stress test verification leveraging OpenRouter API failover.
116
  | `openai/gpt-4o-mini` | πŸš€ **OpenRouter** | 0.833 | 0.667 | 0.581 | **0.694** | 90% |
117
  | `meta-llama/llama-3.3-70b-instruct` | πŸš€ **OpenRouter** | 0.500 | 0.833 | 0.545 | **0.626** | 94% |
118
  | `qwen/qwen-2.5-72b-instruct` | πŸš€ **OpenRouter** | 0.800 | 0.556 | 0.500 | **0.619** | 97% |
119
- | `mistralai/mistral-small-3.1-24b` | πŸš€ **OpenRouter** | 0.001 | 0.001 | 0.999 | **0.334** | 100% |
120
 
121
  ### 🧠 Performance Analysis: Why Models Succeed or Fail
122
  Our deterministic grading environment reveals deep behaviors not captured by standard multiple-choice benchmarks:
 
116
  | `openai/gpt-4o-mini` | πŸš€ **OpenRouter** | 0.833 | 0.667 | 0.581 | **0.694** | 90% |
117
  | `meta-llama/llama-3.3-70b-instruct` | πŸš€ **OpenRouter** | 0.500 | 0.833 | 0.545 | **0.626** | 94% |
118
  | `qwen/qwen-2.5-72b-instruct` | πŸš€ **OpenRouter** | 0.800 | 0.556 | 0.500 | **0.619** | 97% |
119
+ | `mistralai/mistral-small-3.1-24b` | πŸš€ **OpenRouter** | 0.001 | 0.001 | 0.999 | **0.334** | 10% |
120
 
121
  ### 🧠 Performance Analysis: Why Models Succeed or Fail
122
  Our deterministic grading environment reveals deep behaviors not captured by standard multiple-choice benchmarks: