GGUF version compatible with city96 gguf loader?
#1
by
kingograder - opened
You plan to quantize the model and publish it so that it is compatible with gguf loader by city96 https://github.com/city96/ComfyUI-GGUF
This will greatly help in working with the model on <16GB GPUS