metadata
license: apache-2.0
base_model: Qwen/Qwen3-1.7B
library_name: basert
pipeline_tag: text-generation
tags:
- basert
- apple-silicon
- quantized
Qwen3-1.7B
BaseRT .base builds of
Qwen/Qwen3-1.7B for fast local inference on Apple
Silicon (Metal).
Files
| File | Precision | Size |
|---|---|---|
Qwen3-1.7B-Q4.base |
4-bit | 1.1G |
Qwen3-1.7B-Q8.base |
8-bit | 2.0G |
Usage
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Qwen3-1.7B
basert chat basecompute/Qwen3-1.7B
Released under the apache-2.0 license, inherited from the base model.