reports/eval/base_a100_coding.md

HumanEval — base_a100

• Model: Qwen/Qwen3.6-27B
• pass@1: 93.90% (154/164)

Reference pass@1 (published, approx)

• Qwen2.5-Coder-32B-Instruct: 92%
• GPT-4o: 90%
• DeepSeek-V3: 91%
• Llama-3.1-70B-Instruct: 80%
• Qwen2.5-7B-Instruct: 84%
• CodeLlama-34B: 51%