TokForge-AccelerationPack-Draft / config_opencl.json
darkmaniac7's picture
Add config_opencl.json for OpenCL draft backend support
5531dd9 verified
raw
history blame contribute delete
172 Bytes
{
"llm_model": "llm.mnn",
"llm_weight": "llm.mnn.weight",
"backend_type": "opencl",
"precision": "low",
"memory": "low",
"sampler_type": "greedy"
}