Request for Qwen3.5-122B-A10B FP8 version

#4
by PowAG - opened

Qwen just released their 122B version.
https://huggingface.co/Qwen/Qwen3.5-122B-A10B

Will there be a FP8 version for 122B model? Not only the 4bit AWQ version.

Waht a speed you achieve, the 4bit quat cyankiwi/Qwen3.5-122B-A10B-AWQ-4bit(https://huggingface.co/cyankiwi/Qwen3.5-122B-A10B-AWQ-4bit) is released.
And it seems that there will be a official FP8 version of Qwen3.5-122B soon.

Sign up or log in to comment