--- language: - en - vi license: other library_name: gguf tags: - acne - dermatology - skincare - gguf - research - quantization - qwen3.5 pipeline_tag: text-generation base_model: - Qwen/Qwen3.5-0.8B --- # Acnoryx AI Research Bundle ## Overview - Base model: Qwen/Qwen3.5-0.8B - Model size: 0.8b - Research quantizations: Q3_K_M, IQ3_M, Q2_K, IQ2_M, IQ2_XS, IQ2_XXS, IQ1_M, IQ1_S - Purpose: evaluate quality vs. size trade-offs below the production threshold ## Notes - IQ1/IQ2 formats require an importance matrix (imatrix). - These files are more experimental than the release bundle. - Production-facing use should prefer the release bundle. - If prompting in Vietnamese, write with full accents for best consistency. ## Evaluation Snapshot Research GGUFs were continued from the existing results and merged with the latest rerun on the same curated 58-question bilingual benchmark. | Quant | Think | No-Think | Avg | Status | |---|---:|---:|---:|---| | Q3_K_M | 74.1% | 72.4% | 73.2% | Best current research quant | | IQ3_M | 60.3% | 60.3% | 60.3% | Heavy quality loss | | IQ2_M | 20.7% | 19.0% | 19.8% | Below usable threshold | | IQ2_XS | 5.2% | 3.4% | 4.3% | Triggered early-stop for lower bits | ## Research Guidance - Public research recommendation: **Q3_K_M** only - **IQ3_M** is still uploadable for experiments, but quality is clearly degraded - The rerun auto-stopped below **IQ2_XS** because average pass rate fell under 50%, so lower-bit quants should be considered archival artifacts rather than viable deployments - For any user-facing scenario, prefer the release bundle instead of this research branch For cross-family ranking and release-vs-research comparison, see `results/COMPARISON.md` in the workspace.