pehlicd commited on
Commit
82c61cc
·
verified ·
1 Parent(s): 01c0667

Upload Modelfile with huggingface_hub

Browse files
Files changed (1) hide show
  1. Modelfile +15 -0
Modelfile ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ FROM ./crd-wizard.gguf
2
+
3
+ PARAMETER num_ctx 8192
4
+
5
+ # Qwen 2.5 ChatML Template
6
+ TEMPLATE """{{ if .System }}<|im_start|>system
7
+ {{ .System }}<|im_end|>
8
+ {{ end }}{{ if .Prompt }}<|im_start|>user
9
+ {{ .Prompt }}<|im_end|>
10
+ {{ end }}<|im_start|>assistant
11
+ """
12
+
13
+ # Stop tokens
14
+ PARAMETER stop "<|im_start|>"
15
+ PARAMETER stop "<|im_end|>"