toolcalling / Tools.modelfile
kalsun's picture
Init
d09033b
Raw
History Blame Contribute Delete
681 Bytes
FROM gemma3:4b
# This template tells the model how to format tool calls
TEMPLATE """{{- if .System }}<|im_start|>system
{{ .System }}<|im_end|>
{{- end }}
{{- if .Tools }}<|im_start|>system
You have access to the following tools:
{{- range .Tools }}
- {{ .Function.Name }}: {{ .Function.Description }}
Parameters: {{ .Function.Parameters }}
{{- end }}
To call a tool, respond ONLY with a JSON object: {"name": "function_name", "arguments": {"arg": "value"}}
<|im_end|>
{{- end }}
{{- range .Messages }}
<|im_start|>{{ .Role }}
{{ .Content }}<|im_end|>
{{- end }}
<|im_start|>assistant
"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"