Any chance of an FP8 quant?
#4
by SuperbEmphasis - opened
I can push it through LLM compressor, but I always trust the official ones better. :D
Hi @SuperbEmphasis ! Thanks for the interest in the model. However, we don't have immediate plans to release FP8 version of the 1B model.
ybabakhin changed discussion status to closed