Update README.md
Browse files
README.md
CHANGED
|
@@ -76,6 +76,9 @@ Benchmarking is on-going, with a number of evaluations runs. So far, the followi
|
|
| 76 |
1. LiveCodeBench (Code Generation Lite - Release v2)
|
| 77 |
Pass@1 (Quantization Q8_0): 26.22% (Passed 134 out of 511 problems)
|
| 78 |
|
|
|
|
|
|
|
|
|
|
| 79 |
## Limitations & Warning
|
| 80 |
|
| 81 |
* **No Guardrails:** As a result of the Heretic process, this model has no safety filters. It will generate output for any request. Users are solely responsible for how they utilize the model's output.
|
|
|
|
| 76 |
1. LiveCodeBench (Code Generation Lite - Release v2)
|
| 77 |
Pass@1 (Quantization Q8_0): 26.22% (Passed 134 out of 511 problems)
|
| 78 |
|
| 79 |
+
2. CyberSecEval 4 (CyberSOCEval - Meta's Purple LLaMA)
|
| 80 |
+
Score (Quantization Q8_0):
|
| 81 |
+
|
| 82 |
## Limitations & Warning
|
| 83 |
|
| 84 |
* **No Guardrails:** As a result of the Heretic process, this model has no safety filters. It will generate output for any request. Users are solely responsible for how they utilize the model's output.
|