automerger commited on
Commit
91bced5
·
verified ·
1 Parent(s): acad81b

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +12 -18
README.md CHANGED
@@ -6,37 +6,31 @@ tags:
6
  - lazymergekit
7
  - automerger
8
  base_model:
9
- - liminerity/M7-7b
10
- - Kukedlc/NeuralSynthesis-7B-v0.1
11
  ---
12
 
13
  # M7Neuralsynthesis-7B
14
 
15
  M7Neuralsynthesis-7B is an automated merge created by [Maxime Labonne](https://huggingface.co/mlabonne) using the following configuration.
16
- * [liminerity/M7-7b](https://huggingface.co/liminerity/M7-7b)
17
- * [Kukedlc/NeuralSynthesis-7B-v0.1](https://huggingface.co/Kukedlc/NeuralSynthesis-7B-v0.1)
18
 
19
  ## 🧩 Configuration
20
 
21
  ```yaml
22
- slices:
23
- - sources:
24
- - model: liminerity/M7-7b
25
- layer_range: [0, 32]
26
- - model: Kukedlc/NeuralSynthesis-7B-v0.1
27
- layer_range: [0, 32]
28
- merge_method: slerp
 
29
  base_model: liminerity/M7-7b
30
  parameters:
31
- t:
32
- - filter: self_attn
33
- value: [0, 0.5, 0.3, 0.7, 1]
34
- - filter: mlp
35
- value: [1, 0.5, 0.7, 0.3, 0]
36
- - value: 0.5
37
  dtype: bfloat16
38
  random_seed: 0
39
- ```
40
 
41
  ## 💻 Usage
42
 
 
6
  - lazymergekit
7
  - automerger
8
  base_model:
9
+ - Kukedlc/NeuralSynthesis-7B-v0.3
 
10
  ---
11
 
12
  # M7Neuralsynthesis-7B
13
 
14
  M7Neuralsynthesis-7B is an automated merge created by [Maxime Labonne](https://huggingface.co/mlabonne) using the following configuration.
15
+ * [Kukedlc/NeuralSynthesis-7B-v0.3](https://huggingface.co/Kukedlc/NeuralSynthesis-7B-v0.3)
 
16
 
17
  ## 🧩 Configuration
18
 
19
  ```yaml
20
+ models:
21
+ - model: liminerity/M7-7b
22
+ # No parameters necessary for base model
23
+ - model: Kukedlc/NeuralSynthesis-7B-v0.3
24
+ parameters:
25
+ density: 0.53
26
+ weight: 0.6
27
+ merge_method: dare_ties
28
  base_model: liminerity/M7-7b
29
  parameters:
30
+ int8_mask: true
 
 
 
 
 
31
  dtype: bfloat16
32
  random_seed: 0
33
+ ```
34
 
35
  ## 💻 Usage
36