Q4NX Base Models
Collection
These work with q4nx-build (github.com/Atomic-Germ/q4nx-build) • 26 items • Updated
This model is a variant of Meta AI’s LLaMA 3.2 3B Instruct release. It preserves the original architecture and weights, with potential optimizations via quantization, low-level tuning, or runtime enhancements tailored for NPUs using FastFlowLM.
⚠️ This model is subject to Meta’s LLaMA 3 license. You must accept Meta’s terms to use or download it.
Governed by Meta AI's LLaMA 3 license:
👉 https://ai.meta.com/llama/license/
Key restrictions include:
If this version includes any fine-tuning or post-training modification:
Users are responsible for verifying the legality of dataset use and redistribution.
@misc{touvron2024llama3,
title={LLaMA 3: Open Foundation and Instruction Models},
author={Touvron, Hugo and others},
year={2024},
url={https://ai.meta.com/llama/}
Base model
meta-llama/Llama-3.2-3B-Instruct