| # HumanEval — base_a100 | |
| - Model: `Qwen/Qwen3.6-27B` | |
| - pass@1: **93.90%** (154/164) | |
| ## Reference pass@1 (published, approx) | |
| - Qwen2.5-Coder-32B-Instruct: 92% | |
| - GPT-4o: 90% | |
| - DeepSeek-V3: 91% | |
| - Llama-3.1-70B-Instruct: 80% | |
| - Qwen2.5-7B-Instruct: 84% | |
| - CodeLlama-34B: 51% | |