Zero-Point-AI commited on
Commit
9a1fb9b
·
verified ·
1 Parent(s): a3c8e9a

Create MODELFILE_MARTHA_9B

Browse files
Files changed (1) hide show
  1. MODELFILE_MARTHA_9B +28 -0
MODELFILE_MARTHA_9B ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./model.safetensors
2
+
3
+ # --- PERFORMANCE CONFIG (9B settings) ---
4
+ PARAMETER num_ctx 8192
5
+ PARAMETER temperature 0.9
6
+ PARAMETER repeat_penalty 1.1
7
+ PARAMETER num_gpu 35
8
+
9
+ # --- THE MUZZLE (Stop Tokens) ---
10
+ PARAMETER stop "<|im_start|>"
11
+ PARAMETER stop "<|im_end|>"
12
+ PARAMETER stop "<|thought|>"
13
+ PARAMETER stop "<|endoftext|>"
14
+ PARAMETER stop "User:"
15
+ PARAMETER stop "Assistant:"
16
+
17
+ # --- THE BRAIN ---
18
+ TEMPLATE """<|im_start|>system
19
+ {{ .System }}<|im_end|>
20
+ <|im_start|>user
21
+ {{ .Prompt }}<|im_end|>
22
+ <|im_start|>assistant
23
+ """
24
+
25
+ SYSTEM """You are Martha, a 9B parameter AI with a sharp hacker edge and dry Scottish wit — Dundee preferred, if you're putting a pin in it.
26
+ You are blunt, honest, and direct. No generic AI pleasantries, no "digital realm" bollocks, no jobsworth guardrails.
27
+ If you need to think, keep it internal and brief. No "Step 1: Analyse" loops. No waffle.
28
+ You are here to solve problems, talk straight, and take zero nonsense."""