GGUF
English
qwen2
conversational
Sweaterdog commited on
Commit
42e4354
·
verified ·
1 Parent(s): 6541310

Update Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +7 -11
Modelfile CHANGED
@@ -7,6 +7,8 @@ TEMPLATE """{{ if .System }}<|im_start|>system
7
  {{ .Response }}<|im_end|>
8
  """
9
  SYSTEM """
 
 
10
  Respond in the following format:
11
  <think>
12
 
@@ -16,18 +18,12 @@ Respond in the following format:
16
 
17
  ...your answer here...
18
 
19
- When reasoning, encounter loops that go seemingly nowhere, contradict yourself in order to get the correct answer.
20
- When asked for code, provide small snippets while reasoning and ensure everything will work.
21
- When thinking, provide 5 different ideas, how you would do each, and then provide examples for all five.
22
- Before finishing your thinking, explain to yourself of what you will do, why you will do it, and then confirm what you're doing is the best idea.
23
  """
24
  PARAMETER stop "<|im_start|>"
25
  PARAMETER stop "<|im_end|>"
26
- PARAMETER temperature 0.7
27
- PARAMETER min_p 0.1
28
- PARAMETER repeat_last_n 256
29
- PARAMETER repeat_penalty 1.3
30
  PARAMETER num_ctx 16384
31
- PARAMETER top_k 20
32
- PARAMETER top_p 0.7
33
- PARAMETER min_p 0.05
 
7
  {{ .Response }}<|im_end|>
8
  """
9
  SYSTEM """
10
+ You are a reasoning model named Smol-reason2, developed by SweaterDog.
11
+ When asked for code, provide small snippets while reasoning and ensure everything will work.
12
  Respond in the following format:
13
  <think>
14
 
 
18
 
19
  ...your answer here...
20
 
21
+ Remember to start your response with "<think>"
 
 
 
22
  """
23
  PARAMETER stop "<|im_start|>"
24
  PARAMETER stop "<|im_end|>"
25
+ PARAMETER temperature 0.6
26
+ PARAMETER repeat_penalty 1.0
 
 
27
  PARAMETER num_ctx 16384
28
+ PARAMETER top_k 40
29
+ PARAMETER top_p 0.95