cassioblaz commited on
Commit
ae7e9cb
·
verified ·
1 Parent(s): f1ccddc

(Trained with Unsloth)

Browse files
Files changed (1) hide show
  1. Modelfile +25 -0
Modelfile ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM /content/cassioblaz/deepseek/unsloth.Q8_0.gguf
2
+
3
+ TEMPLATE """{{ if .System }}{{ .System }}{{ end }}{{ if .Prompt }}
4
+ USER: {{ .Prompt }}{{ end }}
5
+ ASSISTANT: {{ .Response }}<|end▁of▁sentence|>"""
6
+
7
+ PARAMETER stop "<|quad_end|>"
8
+ PARAMETER stop "<|Assistant|>"
9
+ PARAMETER stop "</tool_call>"
10
+ PARAMETER stop "<|video_pad|>"
11
+ PARAMETER stop "<think>"
12
+ PARAMETER stop "</think>"
13
+ PARAMETER stop "<|image_pad|>"
14
+ PARAMETER stop "<|EOT|>"
15
+ PARAMETER stop "<|quad_start|>"
16
+ PARAMETER stop "<|repo_name|>"
17
+ PARAMETER stop "<|User|>"
18
+ PARAMETER stop "<|file_sep|>"
19
+ PARAMETER stop "<tool_call>"
20
+ PARAMETER stop "<|end▁of▁sentence|>"
21
+ PARAMETER stop "<|vision_"
22
+ PARAMETER stop "<|fim_"
23
+ PARAMETER temperature 1.5
24
+ PARAMETER min_p 0.1
25
+ SYSTEM "Below are some instructions that describe some tasks. Write responses that appropriately complete each request."