XXL GGUF
Collection
Inspired by Unsloth XL quants, I started mastering my own GGUF quants with gool to make them even better then XL ones. • 13 items • Updated
CodeRosa-70B-AB1
XXL GGUF quant of https://huggingface.co/altomek/CodeRosa-70B-AB1
I am still experimenting with this quant, mayby update it later, but this one is quite good.
- Downloads last month
- 9
Hardware compatibility
Log In to add your hardware
2-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for altomek/CodeRosa-70B-AB1-XXL-GGUF
Base model
altomek/CodeRosa-70B-AB1