Update README.md
Browse files
README.md
CHANGED
|
@@ -44,7 +44,7 @@ After intense refining, <b>Nerdsking-python-coder-3B-i</b> has achieved <b>88.41
|
|
| 44 |
</p>
|
| 45 |
<i>Benchmark details (164 tasks):</i>
|
| 46 |
|
| 47 |
-
- official HumanEval execution protocol
|
| 48 |
- zero-shot pass@1
|
| 49 |
- dtype == "bfloat16"
|
| 50 |
- temperature = 0.1
|
|
|
|
| 44 |
</p>
|
| 45 |
<i>Benchmark details (164 tasks):</i>
|
| 46 |
|
| 47 |
+
- official HumanEval execution protocol: test suites executed via `exec()`
|
| 48 |
- zero-shot pass@1
|
| 49 |
- dtype == "bfloat16"
|
| 50 |
- temperature = 0.1
|