README.md

---
library_name: transformers
license: other
license_name: lfm1.0
license_link: LICENSE
language:
- en
pipeline_tag: image-text-to-text
tags:
- liquid
- lfm2.5
- lfm2
- edge
- vision
base_model: LiquidAI/LFM2.5-VL-1.6B
---

<center>
<div style="text-align: center;">
  <img 
    src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png" 
    alt="Liquid AI"
    style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
  />
</div>
<div style="display: flex; justify-content: center; gap: 0.5em;">
<a href="https://playground.liquid.ai/chat?model=lfm2.5-vl-1.6b"><strong>Try LFM</strong></a> • <a href="https://docs.liquid.ai/lfm/getting-started/welcome"><strong>Docs</strong></a> • <a href="https://leap.liquid.ai/"><strong>LEAP</strong></a> • <a href="https://discord.com/invite/liquid-ai"><strong>Discord</strong></a>
</div>
</center>

<br>

# LFM2.5-VL-1.6B-Extract

**LFM2.5-VL-1.6B-Extract** extracts user-defined fields from images and returns them as **JSON**. It is Liquid AI's first vision model in the [Liquid Nanos](https://huggingface.co/collections/LiquidAI/liquid-nanos) collection—compact, task-specific models built for production workflows—and extends the Extract family alongside [LFM2-1.2B-Extract](https://huggingface.co/LiquidAI/LFM2-1.2B-Extract) for text documents.

## ⚙️ How it works

You specify what to extract as a YAML field list in the system prompt, and the model returns a JSON object with those fields. Structured outputs integrate cleanly with rule-based systems and downstream pipelines. Use it out of the box or fine-tune for domain-specific extraction.

- **System prompt**:

```yaml
wood_color: The overall coloration of the wood surface
wood_texture: The tactile quality of the wood surface 
wood_pattern: The partern types visible on the wood surface
```

- **User prompt**:
<img src="https://huggingface.co/LiquidAI/LFM2.5-VL-1.6B-Extract/resolve/main/sample_image.png" width="300">

- **Output**:
```yaml
{
  "wood_color": "light tan to beige with darker brown streaks",
  "wood_texture": "smooth with visible grain patterns",
  "wood_pattern": "wavy, linear, irregular"
}
```

Our model supports the enum feature, which lets you provide a list of possible choices alongside the field description as follows, and the model will return one of the listed values as its answer. 

- **System prompt**:

```yaml
wood_color: The overall coloration of the wood surface, such as blue, red, or light tan
wood_texture: The tactile quality of the wood surface, select from smooth, rough, or grainy
wood_pattern: The partern types visible on the wood surface, e.g., straight, wavy, or curly
```


## 🌟 Use cases

- Detecting safety-critical events in images (e.g. fallen person, fire, leakage) to trigger automated safety systems.
- Collecting statistical information about objects across video frames for analytics pipelines.
- Auto-tag product images with structured attributes for Retail/E-commerce.

## 📄 Model details

| Property | Detail |
|---|---:|
| **Parameters (LM only)** | 1.2B |
| **Vision encoder** | SigLIP2 (~400M, [SigLIP-2 paper](https://arxiv.org/abs/2502.14786)) |
| **Backbone layers** | hybrid conv+attention |
| **Image input** | Single image, dynamic resolution |
| **Context** | 128,000 tokens |
| **Vocab size** | 65,536 (text) |
| **Precision** | bfloat16 |
| **License** | LFM Open License v1.0 |

## 📊 Performance

We evaluated LFM2.5-VL-1.6B-Extract on a 2,000-sample benchmark of
`(image, schema, JSON)` triples, with reference labels generated by an
ensemble of frontier multimodal models. Predictions are scored on the
following three dimensions:

- **JSON Validity** — share of samples producing strict-parseable JSON
- **Schema Consistency F1 Score** — set-level F1 over predicted vs requested field names, macro-averaged across samples
- **VLM Judge Score** — match against the image directly, judged by a separate vision model ([Qwen/Qwen3.5-35B-A3B](https://huggingface.co/Qwen/Qwen3.5-35B-A3B))

<img src="https://huggingface.co/LiquidAI/LFM2.5-VL-1.6B-Extract/resolve/main/lfm2_5_vl_1_6b_metrics.png" width="800">

| Model | Params | JSON Validity | F1 Score | VLM Judge Score |
|---|---:|---:|---:|---:|
| **LFM2.5-VL-1.6B-Extract** | **1.6B** | **99.6** | **99.6** | **90.6** |
| LFM2.5-VL-1.6B | 1.6B | 91.8 | 75.8 | 66.0 |
| FastVLM-1.5B | 1.91B | 87.3 | 80.3 | 50.9 |
| SmolVLM2-2.2B-Instruct | 2.25B | 84.4 | 82.9 | 64.8 |
| Qwen3.5-2B | 2.27B | 97.9 | 97.7 | 89.7 |
| gemma-4-E2B-it | 2.3B | 97.4 | 97.1 | 84.4 |
| InternVL3_5-2B | 2.35B | **99.6** | 99.2 | 87.7 |
| *(ref) Qwen3-VL-4B-Instruct* | 4.44B | 99.8 | 99.7 | 92.0 |
| *(ref) InternVL3_5-4B* | 4.73B | 99.5 | 99.4 | 90.2 |

LFM2.5-VL-1.6B-Extract outperforms similarly-sized (~2B) open-source VLMs on this benchmark and is competitive with models 2× its size.

**Reproducing these numbers**: The full evaluation pipeline, which includes extraction, VLM judging, and metric aggregation, is bundled in this repository under `model_eval/`. Setup, configuration, and run instructions are in the folder's [`README`](./model_eval/README.md).

**Scope**: These numbers characterize the model on the input/output form it is designed for: a single input image, a YAML field list as the schema, and a flat JSON object as the output. Performance is not expected to transfer to vastly different tasks, e.g. multi-image reasoning or free-form VQA.

## 🏃 How to run

You can run LFM2.5-VL-1.6B-Extract with Hugging Face [`transformers`](https://github.com/huggingface/transformers) v5.1 or newer:

```bash
pip install transformers pillow
```

```python
from transformers import AutoProcessor, AutoModelForImageTextToText
from transformers.image_utils import load_image

model_id = "LiquidAI/LFM2.5-VL-1.6B-Extract"
model = AutoModelForImageTextToText.from_pretrained(
    model_id,
    device_map="auto",
    dtype="bfloat16",
    trust_remote_code=True,
)
processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)

image = load_image("https://huggingface.co/LiquidAI/LFM2.5-VL-1.6B-Extract/resolve/main/sample_image.png")

fields_yaml = """wood_color: The overall coloration of the wood surface
wood_texture: The tactile quality of the wood surface
wood_pattern: The pattern types visible on the wood surface"""

system_prompt = f"""Extract the following from the image:

{fields_yaml}

Respond with only a JSON object. Do not include any text outside the JSON."""

conversation = [
    {"role": "system", "content": system_prompt},
    {"role": "user",   "content": [{"type": "image", "image": image}]},
]

inputs = processor.apply_chat_template(
    conversation,
    add_generation_prompt=True,
    return_tensors="pt",
    return_dict=True,
    tokenize=True,
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=512, do_sample=False)
response = processor.batch_decode(
    outputs[:, inputs["input_ids"].shape[1]:],
    skip_special_tokens=True,
)[0]
print(response)
# {
#   "wood_color": "light tan to beige with darker brown streaks",
#   "wood_texture": "smooth with visible grain patterns",
#   "wood_pattern": "wavy, linear, irregular"
# }
```

> [!WARNING]
> The model is intended for single-turn conversations. We recommend using greedy decoding (`temperature=0`).

## 📬 Contact

- Got questions or want to connect? [Join our Discord community](https://discord.com/invite/liquid-ai)
- If you are interested in custom solutions with edge deployment, please contact [our sales team](https://www.liquid.ai/contact).

## Citation

```bibtex
@article{liquidai2025lfm2,
 title={LFM2 Technical Report},
 author={Liquid AI},
 journal={arXiv preprint arXiv:2511.23404},
 year={2025}
}
```