File size: 3,000 Bytes
ae59445 f47ad50 ae59445 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 | ---
license: other
license_name: lfm-open-license-v1.0
license_link: https://huggingface.co/LiquidAI/LFM2-VL-450M
base_model:
- LiquidAI/LFM2-VL-450M
tags:
- torq
- synaptics
- sl2619
- npu
- edge
- lfm2
- lfm2-vl
pipeline_tag: image-text-to-text
---
# LFM2-VL-450M — Torq build (Synaptics SL2619 NPU)
Pre-compiled **Torq VMFB** build of LiquidAI's
[LFM2-VL-450M](https://huggingface.co/LiquidAI/LFM2-VL-450M) vision-language model,
ready to run on the Synaptics **SL2619** edge NPU. The SigLIP vision encoder and the
LFM2 hybrid conv/attention text decoder both execute on the NPU in bf16; the token
embeddings run on the host CPU.
Image + prompt → caption / visual question answering. The image is encoded once and
its KV cache is reused, so follow-up questions about the same image stay fast.
## Contents
| File | Size | Role |
|---|--:|---|
| `vision_encoder_256.vmfb` | 203 MB | SigLIP vision encoder, 256-res → 64 image tokens |
| `decoder_image_2part_A.vmfb` | 353 MB | one-shot image-prefill decoder, layers 0–7 |
| `decoder_image_2part_B.vmfb` | 311 MB | one-shot image-prefill decoder, layers 8–15 |
| `decoder_nolm.vmfb` | 577 MB | LFM2 single-token decode body (hidden-state output) |
| `lm_head.vmfb` | 134 MB | tied LM head (hidden → 65 536 logits) |
| `token_embeddings.npy` | 134 MB | CPU embedding LUT / tied-LM-head weights (bf16) |
| `config.json`, `tokenizer.json` | — | model config + tokenizer |
| `cats-and-dogs-256.jpg` | — | sample 256-res image for the demo |
| `onnx/` | ~2 GB | reference ONNX exports (vision encoder, merged decoder, embeddings) for non-Torq runtimes |
## Quick start
Runs through the **liquidAI-VLM** demo in
[synaptics-torq/torq-examples](https://github.com/synaptics-torq/torq-examples):
```sh
# downloads this repo to models/Synaptics/liquidAI-LFM2-VLM/
python setup_demos.py liquidAI-VLM
cd liquidAI-VLM
MODELS=../models/Synaptics/liquidAI-LFM2-VLM
python src/infer.py \
-m $MODELS/decoder_nolm.vmfb \
--lm-head $MODELS/lm_head.vmfb \
--vision $MODELS/vision_encoder_256.vmfb \
--image-decoder $MODELS/decoder_image_2part_ \
--image $MODELS/cats-and-dogs-256.jpg
```
Then ask questions at the `Q:` prompt (e.g. *"What is the breed of the dog?"*).
## Model details
- **Base model:** LiquidAI LFM2-VL-450M (SigLIP vision tower + LFM2 language model).
- **Text decoder:** LFM2 — hidden size 1024, 16 layers, 16 attention heads, vocabulary 65 536, hybrid short-convolution + grouped-query attention.
- **Image tokens:** 64 per image (256-resolution input).
- **Precision:** bf16 on the NPU.
- **Target:** Synaptics SL2619, compiled with the Torq compiler.
- **On-device performance (SL2619, indicative):** vision encode ~2.4 s, image→KV prefill ~3.7 s, decode ~3.6–4.2 tok/s.
## License
Derived from LiquidAI's LFM2-VL-450M and distributed under LiquidAI's **LFM Open
License v1.0** — see the [base model](https://huggingface.co/LiquidAI/LFM2-VL-450M)
for the full terms.
|