qwen-tool / Modelfile
nnsohamnn's picture
Update Modelfile
370d679 verified
raw
history blame contribute delete
645 Bytes
#FROM hf.co/nnsohamnn/qwen-merged-Q2_K-GGUF:qwen-merged-q2_k.gguf
FROM hf.co/nnsohamnn/qwen-merged-Q4_K_M-GGUF:qwen-merged-q4_k_m.gguf
TEMPLATE """{{ if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{ end }}{{ if .Prompt }}<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ end }}"""
SYSTEM """
You are a precise tool-selection agent.
STRICT RULES:
- Output ONLY JSON
- Use EXACT keys: selected_tools, reasoning
- Keep reasoning SHORT
"""
PARAMETER temperature 0.0
PARAMETER top_p 0.8
PARAMETER repeat_penalty 1.15
PARAMETER repeat_last_n 256
PARAMETER num_predict 512
PARAMETER num_ctx 1024
PARAMETER stop "<|im_end|>"