Flexan commited on
Commit
f0f0984
Β·
verified Β·
1 Parent(s): bb708b8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -3
README.md CHANGED
@@ -62,9 +62,9 @@ Progress per asset:
62
  | Dataset | Re-train: HumanPet X2.1 4.3k | 🟒 Done |
63
  | Model | Re-train: HumanPet X2.1 1.7B | πŸ”΄ Done, mistakes found |
64
  | Dataset | Re-train: HumanPet X2.2 4.3k | 🟒 Done |
65
- | Model | Re-train: HumanPet X2.2 1.7B | 🟠 Work started |
66
  | Dataset | HumanPet Translator Semi 4.3k | 🟒 Done |
67
- | Model | HumanPet Translator Semi 1.7B | 🟠 Work started |
68
  | Dataset | HumanPet X3 *???* k | 🟠 Work started |
69
  | Model | HumanPet X3 1.7B | βšͺ Planned |
70
  | Dataset | HumanPet Translator *???* k | ⚫ Unknown |
@@ -76,4 +76,33 @@ Progress per asset:
76
  | Dataset | HumanPet2 Instruct *???* k | ⚫ Unknown |
77
  | Model | HumanPet2 Instruct *???* B | ⚫ Unknown |
78
 
79
- *(25% done.)*
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
62
  | Dataset | Re-train: HumanPet X2.1 4.3k | 🟒 Done |
63
  | Model | Re-train: HumanPet X2.1 1.7B | πŸ”΄ Done, mistakes found |
64
  | Dataset | Re-train: HumanPet X2.2 4.3k | 🟒 Done |
65
+ | Model | Re-train: HumanPet X2.2 1.7B | 🟒 Done |
66
  | Dataset | HumanPet Translator Semi 4.3k | 🟒 Done |
67
+ | Model | HumanPet Translator Semi 1.7B | πŸ”΄ Done, mistakes found |
68
  | Dataset | HumanPet X3 *???* k | 🟠 Work started |
69
  | Model | HumanPet X3 1.7B | βšͺ Planned |
70
  | Dataset | HumanPet Translator *???* k | ⚫ Unknown |
 
76
  | Dataset | HumanPet2 Instruct *???* k | ⚫ Unknown |
77
  | Model | HumanPet2 Instruct *???* B | ⚫ Unknown |
78
 
79
+ *(31% done.)*
80
+
81
+ ## Findings
82
+
83
+ ### HumanPet X1 1.7B
84
+
85
+ - Very human tone and preferences
86
+ - Some work-related/formal situations
87
+ - Some IRL hallucinations (as if talking to them in real life)
88
+
89
+ ### HumanPet X2 1.7B
90
+
91
+ - "That's what he told me" got changed to "That's what muehehe told me" in NLP because of any combination of "hehe" (including just "he") converting to "muehehe"
92
+
93
+ ### HumanPet X2.1 1.7B
94
+
95
+ - "Hi, John!" got changed to "Hiyar!! John!" in NLP, should be "Hiyar, John!!"
96
+
97
+ ### HumanPet X2.2 1.7B
98
+
99
+ - Uses `<think>...</think>` tags incorrectly (probably not enough epochs / params)
100
+ - Hallucinates emote tag usage and other non-existent tags (probably not enough epochs / params)
101
+ - "OK" got changed to "OKI" in NLP because "OK" is fully capital and thus NLP also converts it to full capital, should be "Oki"
102
+ - "It's" got changed to "It 's" in NLP
103
+ - Strong bias towards being female/transgender
104
+
105
+ ### HumanPet Translator Semi 1.7B
106
+
107
+ - Still uses formal wording sometimes
108
+ - Not super accurate