File size: 258 Bytes
825e7ee | 1 2 3 4 5 6 7 8 9 10 11 12 13 | FROM ./llm-350m-instruct-q4_k_m.gguf
TEMPLATE """### Instruction:
{{ .Prompt }}
### Response:
"""
PARAMETER stop "### Instruction:"
PARAMETER stop "### Response:"
PARAMETER temperature 0.7
PARAMETER top_p 0.9
PARAMETER top_k 50
PARAMETER repeat_penalty 1.1
|