---
license: llama3.2
base_model: meta-llama/Llama-3.2-1B-Instruct
library_name: basert
pipeline_tag: text-generation
tags:
  - basert
  - apple-silicon
  - quantized
---

# Llama-3.2-1B-Instruct

[BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`meta-llama/Llama-3.2-1B-Instruct`](https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct) for fast local inference on Apple Silicon (Metal).

## Files

| File | Precision | Size |
|------|-----------|------|
| `Llama-3.2-1B-Instruct-Q4.base` | 4-bit | 702 MB |
| `Llama-3.2-1B-Instruct-Q8.base` | 8-bit | 1.3 GB |

## Usage

```bash
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Llama-3.2-1B-Instruct
basert chat basecompute/Llama-3.2-1B-Instruct
```

Released under the llama3.2 license, inherited from the base model.