metadata
license: llama3.2
base_model: meta-llama/Llama-3.2-1B-Instruct
library_name: basert
pipeline_tag: text-generation
tags:
- basert
- apple-silicon
- quantized
Llama-3.2-1B-Instruct
BaseRT .base builds of meta-llama/Llama-3.2-1B-Instruct for fast local inference on Apple Silicon (Metal).
Files
| File | Precision | Size |
|---|---|---|
Llama-3.2-1B-Instruct-Q4.base |
4-bit | 702 MB |
Llama-3.2-1B-Instruct-Q8.base |
8-bit | 1.3 GB |
Usage
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Llama-3.2-1B-Instruct
basert chat basecompute/Llama-3.2-1B-Instruct
Released under the llama3.2 license, inherited from the base model.