GGUF
English
qwen2
conversational
Sweaterdog commited on
Commit
389b237
·
verified ·
1 Parent(s): ae857a4

Update Modelfile

Browse files
Files changed (1) hide show
  1. Modelfile +15 -7
Modelfile CHANGED
@@ -5,20 +5,28 @@ TEMPLATE """{{ if .System }}<|im_start|>system
5
  {{ end }}<|im_start|>assistant
6
  {{ .Response }}<|im_end|>
7
  """
8
- SYSTEM """Respond in the following format:
 
9
  <think>
10
- ...
 
 
11
  </think>
12
- <answer
13
- ...
14
- </answer>
 
 
 
 
15
  """
16
  PARAMETER stop "<|im_start|>"
17
  PARAMETER stop "<|im_end|>"
18
- PARAMETER temperature 0.6
19
  PARAMETER min_p 0.1
20
- PARAMETER repeat_last_n 128
21
  PARAMETER repeat_penalty 1.3
 
22
  PARAMETER top_k 20
23
  PARAMETER top_p 0.7
24
  PARAMETER min_p 0.05
 
5
  {{ end }}<|im_start|>assistant
6
  {{ .Response }}<|im_end|>
7
  """
8
+ SYSTEM """
9
+ Respond in the following format:
10
  <think>
11
+
12
+ ...your reasoning here...
13
+
14
  </think>
15
+
16
+ ...your answer here...
17
+
18
+ When reasoning, encounter loops that go seemingly nowhere, contradict yourself in order to get the correct answer.
19
+ When asked for code, provide small snippets while reasoning and ensure everything will work.
20
+ When thinking, provide 5 different ideas, how you would do each, and then provide examples for all five.
21
+ Before finishing your thinking, explain to yourself of what you will do, why you will do it, and then confirm what you're doing is the best idea.
22
  """
23
  PARAMETER stop "<|im_start|>"
24
  PARAMETER stop "<|im_end|>"
25
+ PARAMETER temperature 0.7
26
  PARAMETER min_p 0.1
27
+ PARAMETER repeat_last_n 256
28
  PARAMETER repeat_penalty 1.3
29
+ PARAMETER num_ctx 16384
30
  PARAMETER top_k 20
31
  PARAMETER top_p 0.7
32
  PARAMETER min_p 0.05