I got broken models when use the k quantize so there's no k quantized models(sad)
- Downloads last month
- 35
Hardware compatibility
Log In to add your hardware
4-bit
5-bit
8-bit
I got broken models when use the k quantize so there's no k quantized models(sad)
4-bit
5-bit
8-bit