--- language: - en license: llama3.2 tags: - mobile - edge-ai - quantized - gguf - q6 - recommended pipeline_tag: text-generation --- # Llama 3.2 1B Instruct - Q6 Mobile (GGUF) - RECOMMENDED The balanced choice between tiny Q4 (~767MB) and larger Q8 (~1.3GB). Best quality-to-size ratio for most deployments. | Property | Value | |----------|-------| | **Parameters** | 1.23 billion | | **Quantization** | Q6_K (6-bit) | | **Size** | ~1.02 GB | | **Speed** | ~25 tok/s (S20 FE CPU) | | **Quality Retention** | ~97% | This is the **recommended default variant** when unsure which to choose.