darkmaniac7's picture
feat: abliterated 0.8B with fixed graph (no FusedLinearAttention ops, is_visual=false)
325bbf9 verified
raw
history blame contribute delete
342 Bytes
{
"llm_model": "llm.mnn",
"llm_weight": "llm.mnn.weight",
"backend_type": "cpu",
"thread_num": 4,
"precision": "low",
"memory": "low",
"sampler_type": "penalty",
"penalty": 1.1,
"mllm": {
"backend_type": "cpu",
"thread_num": 4,
"precision": "normal",
"memory": "low"
}
}