File size: 272 Bytes
994182c | 1 2 3 4 5 6 7 8 9 10 11 12 13 | # HumanEval — base_a100
- Model: `Qwen/Qwen3.6-27B`
- pass@1: **93.90%** (154/164)
## Reference pass@1 (published, approx)
- Qwen2.5-Coder-32B-Instruct: 92%
- GPT-4o: 90%
- DeepSeek-V3: 91%
- Llama-3.1-70B-Instruct: 80%
- Qwen2.5-7B-Instruct: 84%
- CodeLlama-34B: 51%
|