Instructions to use abacusai/Dracarys-72B-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
Updated model card with HF benchmarks
#2
by sreemanti-abacus - opened
README.md
CHANGED
|
@@ -83,3 +83,10 @@ print(outputs[0]["generated_text"][len(prompt):])
|
|
| 83 |
|---------------------------|-----------------|----------------|-----------------------|
|
| 84 |
| **Dracarys-72B-Instruct** | 33.86 | 54.30 | 53.26 |
|
| 85 |
| Qwen2-72B-Instruct | 30.10 | TBD | TBD |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
|---------------------------|-----------------|----------------|-----------------------|
|
| 84 |
| **Dracarys-72B-Instruct** | 33.86 | 54.30 | 53.26 |
|
| 85 |
| Qwen2-72B-Instruct | 30.10 | TBD | TBD |
|
| 86 |
+
|
| 87 |
+
## HuggingFace Benchmarks
|
| 88 |
+
|
| 89 |
+
| Model | MMLU-Pro | MMLU | BBH |
|
| 90 |
+
|---------------------------|-----------------|----------------|-----------------------|
|
| 91 |
+
| **Dracarys-72B-Instruct** | **63.22** | **82.4** | **68.17** |
|
| 92 |
+
| Qwen2-72B-Instruct | 62.8 | 82.2 | 67.78 |
|