https://huggingface.co/DQN-Labs-Community/dqnCode-v1
https://huggingface.co/DQN-Labs-Community/dqnCode-v1
4B parameter model, already has f16 and Q4KM quants in GGUF.
sadly I need original model to queue it, if no original weights, I can try asking to manually handle this model
sadly I need original model to queue it, if no original weights, I can try asking to manually handle this model
If you can't use the F16 GGUF file, there's another repo of the same model that is in HF format: DQN-Labs/dqncode1new-16bit
yeah, I dont have enough knowledge of the system to handle it myself, so I would need to ask someone else to handle it, but now that we have safetensors I can queue it myself =)
It's queued!
You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#dqncode1new-16bit-GGUF for quants to appear.
Thanks a lot!
If you are able to, once quantization is complete, can you change the name of the repo to match dqnCode-v1 instead of dqncode1new-16bit?
I cannot, I would need to ask mradermacher himself, but not sure if I can, and if he can, the response sometimes takes quite a while. You can help me by renaming it yourself to the repo name that you need...
I cannot, I would need to ask mradermacher himself, but not sure if I can, and if he can, the response sometimes takes quite a while. You can help me by renaming it yourself to the repo name that you need...
Ah, in that case it's fine then. The model's already passed through the pipeline and I see there's quite a queue in the status website and I don't want to waste resources. However, could you perhaps send the models to DQN-Labs-Community/dqnCode-v1 (with attribution of course). If you can't, absolutely no worries, and thanks so much for quantizing the model :D
well, when it quants you are free to download and redistribute it anywhere you want =)
the queue is a bit stuck because my server crashed, I hope it wakes up soon...
well, when it quants you are free to download and redistribute it anywhere you want =)
the queue is a bit stuck because my server crashed, I hope it wakes up soon...
That's great! Thank you so much!