Quantized in GGUF format using SD.cpp.
Send me a tip if this quantization helped you: https://ko-fi.com/xdnss
- Downloads last month
- 278
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support