GGUF Versions
It would be helpful if GGUF versions like the ones from https://huggingface.co/realrebelai/MOSS-Image_GGUFs were included in this package. That way, people using lower-VRAM GPUs could run the model more easily.
What is low VRAM in this case? The model is already so small and int8 is going to be a lot faster for most GPUs. GGUFs aren't and won't be supported, but 4bit quant can be added if there's actual use for it.
4bit quants make it possible for people with 6gb vram to run it with TE offload to CPU
It would be helpful if GGUF versions like the ones from https://huggingface.co/realrebelai/MOSS-Image_GGUFs were included in this package. That way, people using lower-VRAM GPUs could run the model more easily.
Of course this would be helpful, they will not support this because they hate anything that isn't Int8 ConvRot 😂 (I'm being ironic, they just don't want to waste their time, and yes, they don't like GGUF too).