Qwen3-30B-A3B-Instruct-2507 (baseRT .base)

Qwen/Qwen3-30B-A3B-Instruct-2507 converted to the baseRT .base format for local inference on Apple Silicon via BaseRT.

A 30B-parameter Mixture-of-Experts model (128 experts, 8 active per token; ~3B active params).

Files

File Quant Size Notes
Qwen3-30B-A3B-Instruct-2507-Q4.base Q4 (experts) ~17 GB Recommended; runs on 24–32 GB Apple Silicon

A Q8 build (~31 GB, for machines with a larger working-set budget) is planned.

Usage

basert chat  basecompute/Qwen3-30B-A3B-Instruct-2507
basert serve basecompute/Qwen3-30B-A3B-Instruct-2507

Requires Apple Silicon (M1 or later) and macOS 14+.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for basecompute/Qwen3-30B-A3B-Instruct-2507

Finetuned
(81)
this model