Naphula commited on
Commit
fcfbf82
·
verified ·
1 Parent(s): e3fc5fd

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +81 -0
README.md ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ base_model:
4
+ - DavidAU/Gemma-The-Writer-9B
5
+ - sam-paech/Darkest-muse-v1
6
+ - sam-paech/Delirium-v1
7
+ language:
8
+ - en
9
+ library_name: transformers
10
+ tags:
11
+ - creative
12
+ - creative writing
13
+ - fiction writing
14
+ - plot generation
15
+ - sub-plot generation
16
+ - fiction writing
17
+ - story generation
18
+ - scene continue
19
+ - storytelling
20
+ - fiction story
21
+ - science fiction
22
+ - romance
23
+ - all genres
24
+ - story
25
+ - writing
26
+ - vivid prosing
27
+ - vivid writing
28
+ - fiction
29
+ - roleplaying
30
+ - float32
31
+ - swearing
32
+ - gemma2
33
+ - rp
34
+ - horror
35
+ - gemma
36
+ - karcher
37
+ - merge
38
+ - mergekit
39
+ widget:
40
+ - text: "Psychosis-9B-v1"
41
+ output:
42
+ url: https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/BDaWz9F6fG9cs6iJWoPcf.png
43
+ ---
44
+
45
+ > [!CAUTION]
46
+ > <span style="color:red; font-weight:bold">⚠️ Warning:</span> This model can produce narratives and RP that contain violent and graphic erotic content. Adjust your system prompt accordingly. Also, use **Gemma 2** chat template.
47
+ >
48
+
49
+ > [!NOTE]
50
+ > <span style="color:red; font-weight:bold">Note:</span> There are two versions of Psychosis:
51
+ > - The regular version is censored and has refusals but might be smarter overall.
52
+ > - The uncensored version does not have refusals, but is partially broken and sometimes outputs chinese.
53
+ >
54
+
55
+ # 🧠 Psychosis 9B v1
56
+
57
+ This merge was made using the `karcher` method.
58
+
59
+ The result is creative, unhinged, and (optionally) uncensored. A truly psycho version of Gemma 2.
60
+
61
+ Released in `float32` precision for maximum quality. See the 14B upscale for other versions.
62
+
63
+ ![psycho](https://cdn-uploads.huggingface.co/production/uploads/68e840caa318194c44ec2a04/BDaWz9F6fG9cs6iJWoPcf.png)
64
+
65
+ ## Ablation Notes
66
+
67
+ The uncensored version was MPOA post-ablated using `scale: 1.5` and `measurement: 31` to all layers.
68
+
69
+ **Heretic gemma the writer and ablated components were tested but this resulted in more refusals than ablating after merging.**
70
+
71
+ These commands were MPOA formatted ablation (Norm Preserved, Bi-Projected) for maximum uncensored knowledge preservation.
72
+
73
+ Unfortunately, using a lower scale of `1.3` did not prevent refusals, but it did prevent chinese output bugs. The `1.5` scale ablation was chosen because it's more uncensored.
74
+
75
+ I am releasing **both versions** in case a better ablation method is found later on.
76
+
77
+ ```
78
+ # python measure.py -m B:\9B\Psychosis-9B-v1 -o B:\9B\Psychosis-9B-v1\ablit_proj --batch-size 8 --projected
79
+ # python analyze_old.py B:\9B\Psychosis-9B-v1\ablit_proj -c
80
+ # sharded_ablate.py psychosis-9b-test2.yml --normpreserve --projected
81
+ ```