Ppoyaa commited on
Commit
8a46c40
·
verified ·
1 Parent(s): fc0dcf1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -41
README.md CHANGED
@@ -10,44 +10,3 @@ tags:
10
  - merge
11
 
12
  ---
13
- # merge
14
-
15
- This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
16
-
17
- ## Merge Details
18
- ### Merge Method
19
-
20
- This model was merged using the [TIES](https://arxiv.org/abs/2306.01708) merge method using [NurtureAI/Meta-Llama-3-8B-Instruct-32k](https://huggingface.co/NurtureAI/Meta-Llama-3-8B-Instruct-32k) as a base.
21
-
22
- ### Models Merged
23
-
24
- The following models were included in the merge:
25
- * [Nitral-AI/Hathor-L3-8B-v.02](https://huggingface.co/Nitral-AI/Hathor-L3-8B-v.02)
26
- * [grimjim/Llama-3-Luminurse-v0.2-OAS-8B](https://huggingface.co/grimjim/Llama-3-Luminurse-v0.2-OAS-8B)
27
- * [Sao10K/L3-8B-Stheno-v3.2](https://huggingface.co/Sao10K/L3-8B-Stheno-v3.2)
28
-
29
- ### Configuration
30
-
31
- The following YAML configuration was used to produce this model:
32
-
33
- ```yaml
34
- models:
35
- - model: Sao10K/L3-8B-Stheno-v3.2
36
- parameters:
37
- density: 0.85
38
- weight: 0.5
39
- - model: Nitral-AI/Hathor-L3-8B-v.02
40
- parameters:
41
- density: 0.75
42
- weight: 0.3
43
- - model: grimjim/Llama-3-Luminurse-v0.2-OAS-8B
44
- parameters:
45
- density: 0.75
46
- weight: 0.2
47
- merge_method: ties
48
- base_model: NurtureAI/Meta-Llama-3-8B-Instruct-32k
49
- parameters:
50
- normalize: false
51
- int8_mask: true
52
- dtype: bfloat16
53
- ```
 
10
  - merge
11
 
12
  ---