File size: 3,025 Bytes
c341ba5 5827785 c341ba5 1083e87 c341ba5 5827785 c341ba5 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 | ---
license: apache-2.0
base_model: Qwen/Qwen3-Coder-Next
pipeline_tag: text-generation
library_name: mlx
tags:
- mlx
- apple-silicon
- qwen3-next
- coding
- mixture-of-experts
- quantized
- 4-bit
- mirror
- automatosx
- ax-engine
---
# AX Qwen3 Coder Next MLX 4-bit
> **Parameter count:** approximately 79.67B logical parameters (80B total,
> 3B active per token). `4-bit` is the quantization precision, not a 4B
> model-size claim.
This is a revision-pinned, transparent mirror of
[mlx-community/Qwen3-Coder-Next-4bit](https://huggingface.co/mlx-community/Qwen3-Coder-Next-4bit)
at commit `7b9321eabb85ce79625cac3f61ea691e4ea984b5`.
The model weights, index, configuration, tokenizer, chat template, generation
configuration, and tool-parser files are byte-identical to that upstream
revision. AutomatosX did not fine-tune, merge, re-quantize, or otherwise alter
the model artifacts. We add only mirror documentation, a copy of the declared
Apache 2.0 license, and machine-readable provenance.
## Model details
- Base model: [Qwen/Qwen3-Coder-Next](https://huggingface.co/Qwen/Qwen3-Coder-Next)
- Format: MLX Safetensors for Apple Silicon
- Architecture: Qwen3NextForCausalLM, mixture of experts
- Main quantization: 4-bit affine, group size 64
- Quantization exceptions: router and shared-expert gate tensors remain 8-bit,
as defined by the unchanged upstream config
- Layers: 48
- Experts: 512 total, 10 selected per token
- Configured context limit: 262,144 tokens
- Weight shards: 9, totaling 44,844,286,500 bytes
- Upstream conversion tool: mlx-lm 0.30.5
## Download
~~~bash
hf download AutomatosX/AX-Qwen3-Coder-Next-MLX-4bit \
--local-dir ./AX-Qwen3-Coder-Next-MLX-4bit
~~~
## Use with MLX-LM
~~~bash
pip install mlx-lm
mlx_lm.generate \
--model AutomatosX/AX-Qwen3-Coder-Next-MLX-4bit \
--prompt "Write a Python function that merges two sorted lists."
~~~
Applications should apply the included chat template for conversational or
tool-using prompts.
## Serve with AX Engine
You can also serve the downloaded model through the OpenAI-compatible API in
[AX Engine](https://github.com/defai-digital/ax-engine):
~~~bash
ax-engine serve ./AX-Qwen3-Coder-Next-MLX-4bit --port 31418
~~~
## Mirror policy and provenance
This release is meant to group a required upstream artifact under the
AutomatosX catalog, not to claim a new conversion. `UPSTREAM_README.md`
preserves the original upstream model card. `ax_provenance.json` pins the
source commit and records SHA-256 values and sizes for every mirrored artifact.
The local Hugging Face cache contained an AX-generated `model-manifest.json`;
it is not present in the pinned upstream repository and was deliberately not
published here.
This is a standard direct-decoding model. It does not contain an MTP head and
no MTP conversion was applied.
## License
The upstream model metadata declares Apache License 2.0. See `LICENSE`, the
upstream model card, and the base-model card for limitations and responsible-use
guidance.
|