Update README.md
Browse files
README.md
CHANGED
|
@@ -41,7 +41,11 @@ Below is an instruction that describes a task. Write a response that appropriate
|
|
| 41 |
|
| 42 |
## Performance (evalplus)
|
| 43 |
|
| 44 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
For reference, we've provided the performance of the original Mistral model alongside Mistral-7B-code-16k-qlora model.
|
| 47 |
|
|
|
|
| 41 |
|
| 42 |
## Performance (evalplus)
|
| 43 |
|
| 44 |
+

|
| 45 |
+
|
| 46 |
+
Well, the results are better than I expected
|
| 47 |
+
- Base: `{'pass@1': 0.47560975609756095}`
|
| 48 |
+
- Base + Extra: `{'pass@1': 0.4329268292682927}`
|
| 49 |
|
| 50 |
For reference, we've provided the performance of the original Mistral model alongside Mistral-7B-code-16k-qlora model.
|
| 51 |
|