https://huggingface.co/MuXodious/Qwen3.5-4B-MiniFantasy-MTP

#2575
by sillykiwi - opened

Please GGUF and preserve the MTP capabilities of https://huggingface.co/MuXodious/Qwen3.5-4B-MiniFantasy-MTP

GGUF My Repo strips out the MTP layers, and I am not sure what is required to preserve them into GGUF format.

Thanks!

It's queued!

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Qwen3.5-4B-MiniFantasy-MTP-GGUF for quants to appear.

sillykiwi changed discussion status to closed

Sign up or log in to comment