| license: apache-2.0 | |
| base_model: Qwen/Qwen3-1.7B | |
| library_name: basert | |
| pipeline_tag: text-generation | |
| tags: | |
| - basert | |
| - apple-silicon | |
| - quantized | |
| # Qwen3-1.7B | |
| [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of | |
| [`Qwen/Qwen3-1.7B`](https://huggingface.co/Qwen/Qwen3-1.7B) for fast local inference on Apple | |
| Silicon (Metal). | |
| ## Files | |
| | File | Precision | Size | | |
| |------|-----------|------| | |
| | `Qwen3-1.7B-Q4.base` | 4-bit | 1.1G | | |
| | `Qwen3-1.7B-Q8.base` | 8-bit | 2.0G | | |
| ## Usage | |
| ```bash | |
| curl -LsSf https://basecompute.co/install.sh | sh | |
| basert pull basecompute/Qwen3-1.7B | |
| basert chat basecompute/Qwen3-1.7B | |
| ``` | |
| Released under the apache-2.0 license, inherited from the base model. | |