Mistral-7B-Instruct-v0.3
BaseRT .base builds of
mistralai/Mistral-7B-Instruct-v0.3 for fast local inference on Apple
Silicon (Metal).
Files
| File | Precision | Size |
|---|---|---|
Mistral-7B-Instruct-v0.3-Q4.base |
4-bit | 3.8G |
Mistral-7B-Instruct-v0.3-Q8.base |
8-bit | 7.0G |
Usage
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Mistral-7B-Instruct-v0.3
basert chat basecompute/Mistral-7B-Instruct-v0.3
Released under the apache-2.0 license, inherited from the base model.
- Downloads last month
- 150
Model tree for basecompute/Mistral-7B-Instruct-v0.3
Base model
mistralai/Mistral-7B-v0.3 Finetuned
mistralai/Mistral-7B-Instruct-v0.3