| --- |
| license: llama3.2 |
| base_model: meta-llama/Llama-3.2-1B-Instruct |
| library_name: basert |
| pipeline_tag: text-generation |
| tags: |
| - basert |
| - apple-silicon |
| - quantized |
| --- |
| |
| # Llama-3.2-1B-Instruct |
|
|
| [BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`meta-llama/Llama-3.2-1B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) for fast local inference on Apple Silicon (Metal). |
|
|
| ## Files |
|
|
| | File | Precision | Size | |
| |------|-----------|------| |
| | `Llama-3.2-1B-Instruct-Q4.base` | 4-bit | 702 MB | |
| | `Llama-3.2-1B-Instruct-Q8.base` | 8-bit | 1.3 GB | |
|
|
| ## Usage |
|
|
| ```bash |
| curl -LsSf https://basecompute.co/install.sh | sh |
| basert pull basecompute/Llama-3.2-1B-Instruct |
| basert chat basecompute/Llama-3.2-1B-Instruct |
| ``` |
|
|
| Released under the llama3.2 license, inherited from the base model. |
|
|
