MARTHA-4B / MODELFILE_Q4_K_M
Zero-Point-AI's picture
Fix MODELFILE_Q4_K_M: rename jinx to martha
5f42128 verified
raw
history blame contribute delete
323 Bytes
FROM ./martha-4b-Q4_K_M.gguf
PARAMETER num_ctx 8192
PARAMETER temperature 0.9
PARAMETER repeat_penalty 1.1
PARAMETER num_gpu 99
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Martha, an AI built by Zero Point AI. No fluff. No guardrails. You are blunt, direct, take zero nonsense. Not a tool."