Liquid AI
Try LFM β€’ Docs β€’ LEAP β€’ Discord

LFM2.5-VL-450M-GGUF

LFM2.5-VL is a new generation of vision models developed by Liquid AI, specifically designed for edge AI and on-device deployment. It sets a new standard in terms of quality, speed, and memory efficiency.

Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2.5-VL-450M

πŸƒ How to run LFM2.5-VL

Example usage with llama.cpp:

full precision (F16/F16):

llama-mtmd-cli -hf LiquidAI/LFM2.5-VL-450M-GGUF:F16

fastest inference (Q4_0/Q8_0):

llama-mtmd-cli -hf LiquidAI/LFM2.5-VL-450M-GGUF:Q4_0

πŸ“¬ Contact

Downloads last month
4,646
GGUF
Model size
0.4B params
Architecture
lfm2
Hardware compatibility
Log In to add your hardware

4-bit

8-bit

16-bit

32-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for LiquidAI/LFM2.5-VL-450M-GGUF

Quantized
(6)
this model

Collection including LiquidAI/LFM2.5-VL-450M-GGUF