Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled Heretic Variant

#2007
by laser50 - opened

Hi, I am loving the original model of this, I am using the imatrix heretic v2 variant.. I have started to really appreciate Claude's thinking, and was hoping to be able to use that but still keep the heretic portion, Not even sure if this is possible with a Claude distilled model... But either way, here's the request!

Model in question for (potential) heretic variant: https://huggingface.co/mradermacher/Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-GGUF

I looked into doing it myself, but I lack the RAM, and with today's prices I'd have to sell organs :'(

I think @MuXodious would be better for you, or any other member of heretic-org, because we at mradermacher for now doing only quants. I would do that heretic, but I still didnt manage to understand how to heretic big models on multiple gpus lol

Sign up or log in to comment