Elfrino commited on
Commit
69e6c9a
·
verified ·
1 Parent(s): 02be658

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +32 -2
README.md CHANGED
@@ -10,12 +10,42 @@ tags:
10
  ---
11
 
12
 
13
- IN TESTING.........
14
 
15
 
16
  ***notes:***
17
 
18
- Fairly creative but makes spelling mistakes and grammatical errors on occasion. Most likely the slices of the passthrough are not optimal...
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
 
20
 
21
  # merge
 
10
  ---
11
 
12
 
13
+
14
 
15
 
16
  ***notes:***
17
 
18
+ Creative, articulate and has a wacky sense of humour with the right settings:
19
+
20
+ RECOMMENDED SETTINGS:
21
+
22
+ (based on KoboldCPP):
23
+
24
+ Preset: Mayday
25
+
26
+ Temperature - 1.3
27
+
28
+ Max Ctx. Tokens - 4096
29
+
30
+ Top p Sampling - 0.99
31
+
32
+ Repetition Penalty - 1.1
33
+
34
+ Amount to Gen. - 280
35
+
36
+ ***New findings:***
37
+
38
+
39
+ IMPORTANT: Repetition Penalty Slope (RpSlp in KoboldCPP) should be set to 0
40
+
41
+ around 47 layers offloaded to GPU
42
+
43
+ Smartcontext enabled
44
+
45
+ Custom RoPe Config enabled (but left as default)
46
+
47
+ Prompt template: Alpaca
48
+
49
 
50
 
51
  # merge