| --- |
| license: apache-2.0 |
| base_model: Qwen/Qwen3-4B |
| library_name: basert |
| pipeline_tag: text-generation |
| tags: |
| - basert |
| - apple-silicon |
| - quantized |
| --- |
| |
| # Qwen3-4B |
|
|
| [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`Qwen/Qwen3-4B`](https://huggingface.co/Qwen/Qwen3-4B) for fast local inference on Apple Silicon (Metal). |
|
|
| ## Files |
|
|
| | File | Precision | Size | |
| |------|-----------|------| |
| | `Qwen3-4B-Q4.base` | 4-bit | 2.3 GB | |
| | `Qwen3-4B-Q8.base` | 8-bit | 4.2 GB | |
|
|
| ## Usage |
|
|
| ```bash |
| curl -LsSf https://basecompute.co/install.sh | sh |
| basert pull basecompute/Qwen3-4B |
| basert chat basecompute/Qwen3-4B |
| ``` |
|
|
| Released under the apache-2.0 license, inherited from the base model. |
|
|
