New Ostrich

#2449
by etemiz - opened

Hi can you make quants for https://huggingface.co/etemiz/Ostrich-27B-Qwen3.6-260526
Thanks <3

YES! I love Ostrich and it would be great to know if MTP can be preserved in the quants because it works really well for me on the Qwen3.6 base model.

Hold on, catching your ostrich guys =)

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Ostrich-27B-Qwen3.6-260526-GGUF for quants to appear.

There was an error in config.json, I fixed it

"mtp_num_hidden_layers": 1,

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#Ostrich-27B-Qwen3.6-260526-GGUF for quants to appear.

Sign up or log in to comment