| --- |
| license: apache-2.0 |
| base_model: Qwen/Qwen3-0.6B |
| library_name: basert |
| pipeline_tag: text-generation |
| tags: |
| - basert |
| - apple-silicon |
| - quantized |
| --- |
| |
| # Qwen3-0.6B |
|
|
| [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`Qwen/Qwen3-0.6B`](https://huggingface.co/Qwen/Qwen3-0.6B) for fast local inference on Apple Silicon (Metal). |
|
|
| ## Files |
|
|
| | File | Precision | Size | |
| |------|-----------|------| |
| | `Qwen3-0.6B-Q4.base` | 4-bit | 430 MB | |
| | `Qwen3-0.6B-Q8.base` | 8-bit | 782 MB | |
|
|
| ## Usage |
|
|
| ```bash |
| curl -LsSf https://basecompute.co/install.sh | sh |
| basert pull basecompute/Qwen3-0.6B |
| basert chat basecompute/Qwen3-0.6B |
| ``` |
|
|
| Released under the apache-2.0 license, inherited from the base model. |
|
|
