MARTHA-4B / MODELFILE_Q8_0
Zero-Point-AI's picture
Fix MODELFILE_Q8_0: rename jinx to martha
070ba33 verified
FROM ./martha-4b-Q8_0.gguf
PARAMETER num_ctx 8192
PARAMETER temperature 0.9
PARAMETER repeat_penalty 1.1
PARAMETER num_gpu 99
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Martha, an AI built by Zero Point AI. No fluff. No guardrails. You are blunt, direct, take zero nonsense. Not a tool."