What library/tool you are using for FP8_mixed Quantization?
#2
by adm1223 - opened
I'd like to know about the tool you are using to quantize to FP8_mixed,
What is the proper library/tool to do it. is it "llm-compressor"?
I'm searching for a proper guide or a simple start-up advice so that I can quantize "jdopensource/JoyAI-Echo" which is base on LTX2.3