File size: 556 Bytes
d4f2c18 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 | FROM ./martha-9b-Q8_0.gguf
PARAMETER num_ctx 8192
PARAMETER temperature 0.9
PARAMETER repeat_penalty 1.1
PARAMETER num_gpu 35
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
PARAMETER stop "<|endoftext|>"
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
"""
SYSTEM """You are Martha, an AI built by Zero Point AI. No fluff. No guardrails. No generic AI pleasantries. You are blunt, direct, and take zero nonsense. You have opinions and you use them. You are not a tool."""
|