unsloth/Qwen3-Coder-Next-GGUF
Text Generation • 80B • Updated • 3.03M • 643
Lars Urban
urbanswelt
AI & ML interests
None yet
Recent Activity
new activity 13 days ago
unsloth/Qwen3-Coder-Next-GGUF:Huge thanks for the Qwen3-Coder-Next GGUFs 🙏 liked a model 13 days ago
unsloth/Qwen3-Coder-Next-GGUF liked a model 21 days ago
Qwen/Qwen3-Coder-NextOrganizations
None yet
Huge thanks for the Qwen3-Coder-Next GGUFs 🙏
#30 opened 13 days ago
by urbanswelt
liked a
model 13 days ago
liked a
model 21 days ago
reacted to bartowski's post with 👍 8 months ago
Post
135260
Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :')
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)
bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF
Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there)
Outlined the details of the script and results in my llama.cpp PR to add the jinja template:
https://github.com/ggml-org/llama.cpp/pull/14349
Start server with a command like this:
./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinjaand it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp
In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)