Qwen3.5-2B / README.md
prabodbc's picture
Qwen3.5-2B Q4+Q8 .base bundles (vision tower included)
b1e5e5d verified
|
Raw
History Blame Contribute Delete
927 Bytes
metadata
license: apache-2.0
base_model: Qwen/Qwen3.5-2B
library_name: basert
pipeline_tag: text-generation
tags:
  - basert
  - apple-silicon
  - quantized
  - multimodal

Qwen3.5-2B

BaseRT .base builds of Qwen/Qwen3.5-2B for fast local inference on Apple Silicon (Metal).

Qwen3.5-2B is a hybrid-attention (Gated DeltaNet + periodic full attention) instruct model with a native vision tower. These bundles include the vision encoder — image inputs work out of the box.

Files

File Precision Size
Qwen3.5-2B-Q4.base 4-bit 1.3 GB
Qwen3.5-2B-Q8.base 8-bit 2.3 GB

Usage

curl -LsSf https://basecompute.co/install.sh | sh
basert pull basecompute/Qwen3.5-2B
basert chat basecompute/Qwen3.5-2B

Released under the apache-2.0 license, inherited from the base model.