appvoid commited on
Commit
91a4170
·
verified ·
1 Parent(s): a838589

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -77
README.md CHANGED
@@ -9,8 +9,16 @@ tags:
9
  ---
10
  ![palmer-003 logo](https://huggingface.co/appvoid/palmer-002.5/resolve/main/003.png)
11
 
12
- Creative writing has never been so accesible, palmer goes beyond what it was thought about small language models. This model is a "MErging of Experts" (MEoE) using an internal model `palmer-003-2401` as base, biased as an assistant, using dpo technique, without using any prompts—as a result of these efforts—palmer is better than most 1b language models on most benchmarks, despite being sometimes 40% smaller than its counterparts.
13
 
 
 
 
 
 
 
 
 
14
  ```
15
  Model MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average Params
16
  tinyllama | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B |
@@ -19,79 +27,4 @@ palmer | 0.2523 | 0.3439 | 0.3740 | 0.6208 | 0.7524 | 0.6590 | 0.5004 | 1.1B
19
  qwen | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B |
20
  ```
21
 
22
- This work constitutes, given its compactness, an advancement towards SMLs, easily empowering edge devices such as mobile phones, raspberry pis and automated software/robots. Aditionally, palmer-003 follows the same philosophy as palmer-002.5 to become a more powerful model with more data instead of less.
23
-
24
- ```
25
- prompt: Never give up.
26
- output: Keep pushing forward. Remember, you are not alone.
27
- You have the strength and the support of your family and friends.
28
- As you continue on your journey, remember to take care of yourself.
29
- Eat well, exercise regularly, and get enough sleep.
30
- Stay positive and focused on your goals.
31
- Remember, you are capable of achieving anything you set your mind to.
32
- ```
33
-
34
- **Story writing**
35
-
36
- This model excels at story writting. In fact, depending on the prompt used, it can generate stories as random and credible such as IronMan and Sonic the Hedgehog fighting zombies at outer space.
37
-
38
- ```
39
- prompt: how are you?
40
- output: [Suddenly, the door bursts open, and a group of armed men enter]
41
-
42
- Man: Who are you?
43
-
44
- Woman: We're here to help.
45
- [The group of men starts to attack them, but they manage to fend them off with their weapons]
46
- Man: You're not going to hurt us!
47
- Woman: We're just trying to help.
48
- [As the group retreats, the woman and man are left alone in the room]
49
- Man: I don't know what to do.
50
-
51
- Woman: You need to stay calm. We have to find a way out of here.
52
-
53
- [They start to search for a way out, but they quickly realize that the door is locked]
54
-
55
- Man: What are we going to do?
56
-
57
- Woman: We'll have to think outside the box. Maybe there's another way out.
58
-
59
- [As they continue to search, they come across a hidden passageway]
60
-
61
- Man: This is it! We can make our way out of here.
62
-
63
- Woman: But how are we going to get back?
64
-
65
- Man: I have an idea. Let's use the key that was left behind.
66
-
67
- [They use the key to unlock the door, and they emerge into a dark alley]
68
-
69
- Man: We made it!
70
-
71
- Woman: But what about our families?
72
-
73
- Man: We'll find a way to let them know we're okay.
74
-
75
- [As they make their way back to their homes, they realize that they have been in a nightmare]
76
-
77
- Man: This is just the beginning. We need to be prepared for anything.
78
-
79
- Woman: I know. But what if it happens again?
80
-
81
- Man: Then we'll do everything in our power to protect ourselves and those we love.
82
-
83
- [The woman and man sit down on a bench, looking out at the city]
84
-
85
- Man: We can't let this happen again. We have to be vigilant and prepared for anything.
86
-
87
- Woman: I agree. But what if we don't know how to protect ourselves?
88
-
89
- Man: Then we'll have to rely on each other. We're in this together.
90
-
91
- [The woman and man continue to sit, holding hand
92
- ```
93
-
94
- You can support me [through kofi](https://ko-fi.com/appvoid).
95
-
96
- ### Important
97
- Keep in mind that if you quantize the fp16 gguf model to let's say q8 or q6 there is gonna be a extremely huge performance drop. So, if you want the most of this model, use it as it is, in fp16.
 
9
  ---
10
  ![palmer-003 logo](https://huggingface.co/appvoid/palmer-002.5/resolve/main/003.png)
11
 
12
+ palmer-003 is appvoid's lastest effort into creating the best small, general language model possible.
13
 
14
+ **Prompt**
15
+ ```
16
+ Query: Your instruction
17
+
18
+ Answer:
19
+ ```
20
+
21
+ **Evaluation**
22
  ```
23
  Model MMLU ARC-C OBQA HellaSwag PIQA Winogrande Average Params
24
  tinyllama | 0.2577 | 0.3029 | 0.3600 | 0.5935 | 0.7329 | 0.5959 | 0.4738 | 1.1B |
 
27
  qwen | 0.4536 | 0.3490 | 0.3320 | 0.5876 | 0.7307 | 0.5896 | 0.5070 | 1.8B |
28
  ```
29
 
30
+ You can support me [through kofi](https://ko-fi.com/appvoid).