File size: 1,850 Bytes
50aae6d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 | ---
license: apache-2.0
base_model: meta-models/Muse-Glimmer-30B
library_name: basert
pipeline_tag: image-text-to-text
tags:
- basert
- apple-silicon
- quantized
---
# Muse-Glimmer-30B
[BaseRT](https://github.com/basecompute/baseRT) `.base` builds of [`meta-models/Muse-Glimmer-30B`](https://huggingface.co/meta-models/Muse-Glimmer-30B) for fast local inference on Apple Silicon (Metal).
These are the **official GGUF k-quants** from
[`meta-models/Muse-Glimmer-30B-GGUF`](https://huggingface.co/meta-models/Muse-Glimmer-30B-GGUF),
repackaged into `.base` — the super-block bytes are copied through verbatim, so
the weights are bit-identical to the upstream GGUFs rather than a
re-quantization of them. File names match the upstream ones.
Both builds are **text + vision**: the `mmproj-kquant.gguf` perception tower is
folded into the same bundle, so there is no separate projector file to manage.
## Files
| File | Source GGUF | Size |
|------|-------------|------|
| `muse-glimmer-30B-kquant-dynamic.base` | `muse-glimmer-30B-kquant-dynamic.gguf` | 21.0 GB |
| `muse-glimmer-30B-kquant-17gb.base` | `muse-glimmer-30B-kquant-17gb.gguf` | 18.1 GB |
Each `.base` is larger than its source GGUF because the perception tower is
folded in (the upstream `mmproj-kquant.gguf` is a separate 1.4 GB file).
`kquant-dynamic` is the default: a per-tensor Q4_K/Q5_K/Q6_K mix
(`Q4_K_M`-class). `kquant-17gb` is the smaller fixed-size build.
## Usage
```bash
curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Muse-Glimmer-30B
basert chat basecompute/Muse-Glimmer-30B
```
Images use the model's own `<|patch|>` placeholder:
```bash
basert complete basecompute/Muse-Glimmer-30B --chat \
--image photo.png --prompt "<|patch|>Describe this image."
```
Released under the apache-2.0 license, inherited from the base model.
|