README.md

---
license: other
license_name: lfm-open-license-v1.0
license_link: https://huggingface.co/LiquidAI/LFM2-VL-450M
base_model:
- LiquidAI/LFM2-VL-450M
tags:
- torq
- synaptics
- sl2619
- npu
- edge
- lfm2
- lfm2-vl
pipeline_tag: image-text-to-text
---

# LFM2-VL-450M — Torq build (Synaptics SL2619 NPU)

Pre-compiled **Torq VMFB** build of LiquidAI's
[LFM2-VL-450M](https://huggingface.co/LiquidAI/LFM2-VL-450M) vision-language model,
ready to run on the Synaptics **SL2619** edge NPU. The SigLIP vision encoder and the
LFM2 hybrid conv/attention text decoder both execute on the NPU in bf16; the token
embeddings run on the host CPU.

Image + prompt → caption / visual question answering. The image is encoded once and
its KV cache is reused, so follow-up questions about the same image stay fast.

## Contents

| File | Size | Role |
|---|--:|---|
| `vision_encoder_256.vmfb` | 203 MB | SigLIP vision encoder, 256-res → 64 image tokens |
| `decoder_image_2part_A.vmfb` | 353 MB | one-shot image-prefill decoder, layers 0–7 |
| `decoder_image_2part_B.vmfb` | 311 MB | one-shot image-prefill decoder, layers 8–15 |
| `decoder_nolm.vmfb` | 577 MB | LFM2 single-token decode body (hidden-state output) |
| `lm_head.vmfb` | 134 MB | tied LM head (hidden → 65 536 logits) |
| `token_embeddings.npy` | 134 MB | CPU embedding LUT / tied-LM-head weights (bf16) |
| `config.json`, `tokenizer.json` | — | model config + tokenizer |
| `cats-and-dogs-256.jpg` | — | sample 256-res image for the demo |
| `onnx/` | ~2 GB | reference ONNX exports (vision encoder, merged decoder, embeddings) for non-Torq runtimes |

## Quick start

Runs through the **liquidAI-VLM** demo in
[synaptics-torq/torq-examples](https://github.com/synaptics-torq/torq-examples):

```sh
# downloads this repo to models/Synaptics/liquidAI-LFM2-VLM/
python setup_demos.py liquidAI-VLM

cd liquidAI-VLM
MODELS=../models/Synaptics/liquidAI-LFM2-VLM
python src/infer.py \
  -m              $MODELS/decoder_nolm.vmfb \
  --lm-head       $MODELS/lm_head.vmfb \
  --vision        $MODELS/vision_encoder_256.vmfb \
  --image-decoder $MODELS/decoder_image_2part_ \
  --image         $MODELS/cats-and-dogs-256.jpg
```

Then ask questions at the `Q:` prompt (e.g. *"What is the breed of the dog?"*).

## Model details

- **Base model:** LiquidAI LFM2-VL-450M (SigLIP vision tower + LFM2 language model).
- **Text decoder:** LFM2 — hidden size 1024, 16 layers, 16 attention heads, vocabulary 65 536, hybrid short-convolution + grouped-query attention.
- **Image tokens:** 64 per image (256-resolution input).
- **Precision:** bf16 on the NPU.
- **Target:** Synaptics SL2619, compiled with the Torq compiler.
- **On-device performance (SL2619, indicative):** vision encode ~2.4 s, image→KV prefill ~3.7 s, decode ~3.6–4.2 tok/s.

## License

Derived from LiquidAI's LFM2-VL-450M and distributed under LiquidAI's **LFM Open
License v1.0** — see the [base model](https://huggingface.co/LiquidAI/LFM2-VL-450M)
for the full terms.