GGUF quants for Huginn V5.6: https://huggingface.co/The-Face-Of-Goonery/HuginnV5.5-12.6B (Read the disclaimer)
- Downloads last month
- 8
Hardware compatibility
Log In
to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
GGUF quants for Huginn V5.6: https://huggingface.co/The-Face-Of-Goonery/HuginnV5.5-12.6B (Read the disclaimer)
2-bit
3-bit
4-bit
5-bit
6-bit