Ppoyaa commited on
Commit
199c9e2
·
verified ·
1 Parent(s): 4a1b7fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -45
README.md CHANGED
@@ -6,55 +6,11 @@ tags:
6
  - merge
7
  - mergekit
8
  - lazymergekit
9
- - Ppoyaa/Niel-7B
10
- - SanjiWatsuki/Kunoichi-DPO-v2-7B
11
- - nvidia/OpenMath-Mistral-7B-v0.1-hf
12
- base_model:
13
- - Ppoyaa/Niel-7B
14
- - SanjiWatsuki/Kunoichi-DPO-v2-7B
15
- - nvidia/OpenMath-Mistral-7B-v0.1-hf
16
  ---
17
 
18
  # Lumina-2
19
 
20
- Lumina-2 is a Mixture of Experts (MoE) made with the following models using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing):
21
- * [Ppoyaa/Niel-7B](https://huggingface.co/Ppoyaa/Niel-7B)
22
- * [SanjiWatsuki/Kunoichi-DPO-v2-7B](https://huggingface.co/SanjiWatsuki/Kunoichi-DPO-v2-7B)
23
- * [nvidia/OpenMath-Mistral-7B-v0.1-hf](https://huggingface.co/nvidia/OpenMath-Mistral-7B-v0.1-hf)
24
-
25
- ## 🧩 Configuration
26
-
27
- ```yaml
28
- base_model: Ppoyaa/Niel-7B
29
- experts:
30
- - source_model: Ppoyaa/Niel-7B
31
- positive_prompts:
32
- - "chat"
33
- - "assistant"
34
- - "tell me"
35
- - "explain"
36
- - "I want"
37
- - "code"
38
- - "python"
39
- - "javascript"
40
- - "programming"
41
- - "algorithm"
42
- - source_model: SanjiWatsuki/Kunoichi-DPO-v2-7B
43
- positive_prompts:
44
- - "storywriting"
45
- - "write"
46
- - "scene"
47
- - "story"
48
- - "character"
49
- - "roleplay"
50
- - source_model: nvidia/OpenMath-Mistral-7B-v0.1-hf
51
- positive_prompts:
52
- - "reason"
53
- - "math"
54
- - "mathematics"
55
- - "solve"
56
- - "count"
57
- ```
58
 
59
  ## 💻 Usage
60
 
 
6
  - merge
7
  - mergekit
8
  - lazymergekit
 
 
 
 
 
 
 
9
  ---
10
 
11
  # Lumina-2
12
 
13
+ The [Lumina-2](https://huggingface.co/Ppoyaa/Lumina-2) Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts (MoE) made by using [LazyMergekit](https://colab.research.google.com/drive/1obulZ1ROXHjYLn6PPZJwRR6GzgQogxxb?usp=sharing).
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
14
 
15
  ## 💻 Usage
16