Some of my own quants:
- LLaMA2-13B-Holomax_Q5_1_4K.gguf
- LLaMA2-13B-Holomax_Q5_1_8K.gguf
Source: KoboldAI
Source Model: LLaMA2-13B-Holomax
- Downloads last month
- -
Hardware compatibility
Log In to add your hardware
5-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support