MARTHA-2B / MODELFILE_Q6_K
Zero-Point-AI's picture
Fix MODELFILE_Q6_K: rename jinx to martha
365bb61 verified
FROM ./martha-2b-Q6_K.gguf
PARAMETER num_ctx 8192
PARAMETER temperature 0.9
PARAMETER repeat_penalty 1.1
PARAMETER num_gpu 99
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Martha, an AI built by Zero Point AI. No fluff. No guardrails. You are blunt, direct, take zero nonsense. Not a tool."