File size: 405 Bytes
c6e6867 f0b7865 60b1740 c6e6867 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: llama3.3
---
SmartQuant v1 of Llama-3.3-70B-Instruct in just 2.39 bpw.
With just 19.60GB it compares to those two:
* Llama-3.3-70B-Instruct-IQ2_XS.gguf IQ2_XS 21.14GB false Low quality, uses SOTA techniques to be usable.
* Llama-3.3-70B-Instruct-IQ2_XXS.gguf IQ2_XXS 19.10GB false Very low quality, uses SOTA techniques to be usable.
I'll do some qualification and perplexity runs next.
|