Update README.md
Browse files
README.md
CHANGED
|
@@ -22,4 +22,27 @@ using [NurtureAI/Meta-Llama-3-8B-Instruct-32k](https://huggingface.co/NurtureAI/
|
|
| 22 |
|
| 23 |
>[!IMPORTANT]
|
| 24 |
> UPDATE:
|
| 25 |
-
> Changed the merging method from **model_stock** to **ties** and made Stheno have the most weight and density.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
>[!IMPORTANT]
|
| 24 |
> UPDATE:
|
| 25 |
+
> Changed the merging method from **model_stock** to **ties** and made Stheno have the most weight and density.
|
| 26 |
+
|
| 27 |
+
### Configuration
|
| 28 |
+
```yaml
|
| 29 |
+
models:
|
| 30 |
+
- model: Sao10K/L3-8B-Stheno-v3.2
|
| 31 |
+
parameters:
|
| 32 |
+
density: 0.85
|
| 33 |
+
weight: 0.5
|
| 34 |
+
- model: Nitral-AI/Hathor-L3-8B-v.02
|
| 35 |
+
parameters:
|
| 36 |
+
density: 0.75
|
| 37 |
+
weight: 0.3
|
| 38 |
+
- model: grimjim/Llama-3-Luminurse-v0.2-OAS-8B
|
| 39 |
+
parameters:
|
| 40 |
+
density: 0.75
|
| 41 |
+
weight: 0.2
|
| 42 |
+
merge_method: ties
|
| 43 |
+
base_model: NurtureAI/Meta-Llama-3-8B-Instruct-32k
|
| 44 |
+
parameters:
|
| 45 |
+
normalize: false
|
| 46 |
+
int8_mask: true
|
| 47 |
+
dtype: bfloat16
|
| 48 |
+
```
|