Update README.md
Browse files
README.md
CHANGED
|
@@ -89,10 +89,7 @@ print(response)
|
|
| 89 |
|
| 90 |
## Evaluation
|
| 91 |
|
| 92 |
-
Seed-Coder-8B-Instruct
|
| 93 |
-
- Competitive or superior results compared to similarly sized open-source code models.
|
| 94 |
-
- Robustness across different programming languages and domains.
|
| 95 |
-
- Ability to understand, reason, and repair complex code snippets.
|
| 96 |
|
| 97 |
| Model | HumanEval | MBPP | MHPP | BigCodeBench (Full) | BigCodeBench (Hard) | LiveCodeBench (2410 – 2502) |
|
| 98 |
|:-----------------------------:|:---------:|:----:|:----:|:-------------------:|:-------------------:|:-------------------------:|
|
|
|
|
| 89 |
|
| 90 |
## Evaluation
|
| 91 |
|
| 92 |
+
Seed-Coder-8B-Instruct has been evaluated on a wide range of coding tasks, including code generation, code reasoning, code editing, and software engineering, achieving state-of-the-art performance among ~8B open-source models.
|
|
|
|
|
|
|
|
|
|
| 93 |
|
| 94 |
| Model | HumanEval | MBPP | MHPP | BigCodeBench (Full) | BigCodeBench (Hard) | LiveCodeBench (2410 – 2502) |
|
| 95 |
|:-----------------------------:|:---------:|:----:|:----:|:-------------------:|:-------------------:|:-------------------------:|
|