Update README.md
Browse files
README.md
CHANGED
|
@@ -27,6 +27,18 @@ For further information and related work, refer to our paper: ["OpenCodeInterpre
|
|
| 27 |
## Model Information
|
| 28 |
This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
|
| 29 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
## Model Usage
|
| 31 |
### Inference
|
| 32 |
|
|
@@ -62,4 +74,7 @@ print(tokenizer.decode(outputs[0][len(inputs[0]):], skip_special_tokens=True))
|
|
| 62 |
## Contact
|
| 63 |
|
| 64 |
If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
|
| 65 |
-
We're here to assist you!"
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
## Model Information
|
| 28 |
This model is based on [deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base).
|
| 29 |
|
| 30 |
+
## Benchmark Scores
|
| 31 |
+
|
| 32 |
+
### Single-turn Score:
|
| 33 |
+
| Benchmark | Score (Current) | Score (Previous) | Average Increase |
|
| 34 |
+
|--------------|-----------------|------------------|------------------|
|
| 35 |
+
| Humaneval(+) | 0.652 (0.61) | 0.634 (0.524) | 0.643 (0.567) |
|
| 36 |
+
|
| 37 |
+
### Multi-turn Score:
|
| 38 |
+
| Benchmark | Score (Current) | Score (Previous) | Average Increase |
|
| 39 |
+
|--------------|-----------------|------------------|------------------|
|
| 40 |
+
| Humaneval(+) | 0.652 (0.622) | 0.652 (0.556) | 0.652 (0.589) |
|
| 41 |
+
|
| 42 |
## Model Usage
|
| 43 |
### Inference
|
| 44 |
|
|
|
|
| 74 |
## Contact
|
| 75 |
|
| 76 |
If you have any inquiries, please feel free to raise an issue or reach out to us via email at: xiangyue.work@gmail.com, zhengtianyu0428@gmail.com.
|
| 77 |
+
We're here to assist you!"
|
| 78 |
+
|
| 79 |
+
|
| 80 |
+
|