claude-3.7-sonnet-reasoning-gemma3-12B please!
Hi team mradermacher,
Could you please help quantize the model reedmayhew/claude-3.7-sonnet-reasoning-gemma3-12B into GGUF format?
I know this is not the newest release, but I would still greatly appreciate it if you could make a GGUF version available. Thanks a lot!
The model you referenced already is a GGUF: https://huggingface.co/reedmayhew/claude-3.7-sonnet-reasoning-gemma3-12B/tree/main
We usually don't quantize already quantized model but because he is providing the GGUF in Q8_0 we can do so without really any noticeable loss in quality.
It's queued! :D
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#claude-3.7-sonnet-reasoning-gemma3-12B-GGUF for quants to appear.