Will There Be an FP8 Version?
#9
by P1atinum - opened
Although the model has a relatively small number of parameters, we are still hoping for an FP8 version. At present, we have not seen any ASR models released with FP8 quant.
If possible, are there any recommended methods for quantizing the model to FP8 on our own? Thank you!