float8_e4m3fn or fp8 or preferablly GGUF format weights
#20
by MayensGuds - opened
that would be really good, and it would push the project out to every one, user Seanscripts provided bf16, further quant would be awesome.
that would be really good, and it would push the project out to every one, user Seanscripts provided bf16, further quant would be awesome.