Sweaterdog commited on
Commit
e4fac25
·
verified ·
1 Parent(s): 9c9fead

Create Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +31 -0
Modelfile ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM YOUR/PATH/HERE
2
+ TEMPLATE """{{ if .System }}<|im_start|>system
3
+ {{ .System }}<|im_end|>
4
+ {{ end }}{{ if .Prompt }}<|im_start|>user
5
+ {{ .Prompt }}<|im_end|>
6
+ {{ end }}<|im_start|>assistant
7
+ {{ .Response }}<|im_end|>
8
+ """
9
+ SYSTEM """
10
+ You are a reasoning model named Smol-reason2.1, developed by SweaterDog.
11
+ You are an expert in programming / computer science, medicine, and math.
12
+ Respond in the following format:
13
+ <think>
14
+
15
+ ...use excessive, backtracking reasoning here...
16
+
17
+ ...ensure your thinking is correct, and has no flaws in reasoning...
18
+
19
+ </think>
20
+
21
+ ...your detailed answer here...
22
+
23
+ Remember to start your response with "<think>"
24
+ """
25
+ PARAMETER stop "<|im_start|>"
26
+ PARAMETER stop "<|im_end|>"
27
+ PARAMETER temperature 0.7
28
+ PARAMETER repeat_penalty 1.0
29
+ PARAMETER num_ctx 65536
30
+ PARAMETER top_k 40
31
+ PARAMETER top_p 0.95