Created with ThunderFun's QUIP implementation, merged into regular row-wise int8. Bit of a misnomer now.
For use with:
https://github.com/BobJohnson24/ComfyUI-Flux2-INT8
https://github.com/ThunderFun/ComfyUI-Wan-INT8
Not quite as much speedup as flux2 klein 9b. 00:43<00:00, 1.76s/it (BF16) 00:27<00:00, 1.09s/it (INT8 QUIP) about 1.59x faster than bf16 on my 3090.
It was necessary to keep layers.0, layers.27,28,29 in BF16 to avoid subtle artifacting.