Can we get a 9B-FP8 version next

#5
by kq - opened

Tested Qwen3.5-27B-FP8. It’s flawless—zero loss vs. FP16. Can we get a 9B-FP8 version next?

Hey @littlebird13 can we please get an official FP8 quant? These small models greatly benefit from a good quant.

Sign up or log in to comment