Hugging Face's logo

kaitchup
/
LFM2.5-1.2B-Thinking-FP8-Dynamic

Safetensors
lfm2
llm-compressor
compressed-tensors
Model card Files
xet
Community
LFM2.5-1.2B-Thinking-FP8-Dynamic / README.md
bnjmnmarie's picture
bnjmnmarie
Upload folder using huggingface_hub
18116d3 verified
preview code
|
raw
history blame contribute delete
1.03 kB
metadata 
license: other
license_name: lfm1.0
license_link: LICENSE
base_model:
  - LiquidAI/LFM2.5-1.2B-Thinking
tags:
  - llm-compressor

This is LFM2.5-1.2B-Thinking quantized with llm-compressor to FP8. The model is compatible with vLLM (tested: v0.14.0). Tested with an L4 (Google Colab).