This is LFM2.5-1.2B-JP quantized with llm-compressor to NVFP4. The model is compatible with vLLM (tested: v0.13.0). Tested with an RTX 4090.
- Developed by: The Kaitchup
- License: Apache 2.0 license
How to Support My Work
"buy me a kofi" Subscribe to The Kaitchup. This helps me a lot to continue quantizing and evaluating models for free.
- Downloads last month
- 124
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support