Hugging Face's logo

kaitchup
/
LFM2.5-1.2B-Thinking-NVFP4

Safetensors
lfm2
llm-compressor
compressed-tensors
Model card Files
xet
 Community
LFM2.5-1.2B-Thinking-NVFP4 / README.md
bnjmnmarie's picture
bnjmnmarie
Update README.md
7a526bf verified
preview code
|
raw
history blame contribute delete
1.16 kB
metadata 
license: other
license_name: lfm1.0
license_link: LICENSE
base_model:
  - LiquidAI/LFM2.5-1.2B-Thinking
tags:
  - llm-compressor

This model has some serious quality issues. It's not broken and still chat but it significantly underperforms the original model on complicated tasks.

This is LFM2.5-1.2B-Thinking quantized with llm-compressor to NVFP4. The model is compatible with vLLM (tested: v0.14.0). Tested with an L4 (Google Colab).