Ppoyaa commited on
Commit
cf8f92c
·
verified ·
1 Parent(s): 31e7f2e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +24 -1
README.md CHANGED
@@ -22,4 +22,27 @@ using [NurtureAI/Meta-Llama-3-8B-Instruct-32k](https://huggingface.co/NurtureAI/
22
 
23
  >[!IMPORTANT]
24
  > UPDATE:
25
- > Changed the merging method from **model_stock** to **ties** and made Stheno have the most weight and density.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
 
23
  >[!IMPORTANT]
24
  > UPDATE:
25
+ > Changed the merging method from **model_stock** to **ties** and made Stheno have the most weight and density.
26
+
27
+ ### Configuration
28
+ ```yaml
29
+ models:
30
+ - model: Sao10K/L3-8B-Stheno-v3.2
31
+ parameters:
32
+ density: 0.85
33
+ weight: 0.5
34
+ - model: Nitral-AI/Hathor-L3-8B-v.02
35
+ parameters:
36
+ density: 0.75
37
+ weight: 0.3
38
+ - model: grimjim/Llama-3-Luminurse-v0.2-OAS-8B
39
+ parameters:
40
+ density: 0.75
41
+ weight: 0.2
42
+ merge_method: ties
43
+ base_model: NurtureAI/Meta-Llama-3-8B-Instruct-32k
44
+ parameters:
45
+ normalize: false
46
+ int8_mask: true
47
+ dtype: bfloat16
48
+ ```