| FROM qwen3-4b-instruct-2507.Q8_0.gguf | |
| TEMPLATE """Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request. | |
| {{ if .System }}### Instruction: | |
| {{ .System }}{{ end }} | |
| {{ if .Prompt }}### Input: | |
| {{ .Prompt }}{{ end }} | |
| ### Response: | |
| """ | |
| SYSTEM """You are an assistant specialised in extracting data from an unstructured text into a structured JSON output. | |
| """ | |
| PARAMETER stop "### Response:" | |
| PARAMETER stop "### Instruction:" | |
| PARAMETER stop "### Input:" | |
| PARAMETER stop "Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request." | |
| PARAMETER num_predict 8192 | |
| PARAMETER temperature 0.1 | |