is it possible to provide FP8 version in additional to BF16

#10
by water258 - opened

really love the model which is better then GLM-4.6V-Flash & Qwen3-vl-30b in my testing.
I am wondering if provide FP8 version like Qwen3 then it would much easier to provision on sagemaker etc

Sign up or log in to comment