exolabs/lfm2-5-8b-a1b-mlx-4bit-dequant-bf16
Private dequantized BF16 export for vLLM validation.
- Internal model id:
lfm2-5-8b-a1b-mlx-4bit - MLX source:
LiquidAI/LFM2.5-8B-A1B-MLX-4bit - Original HF comparison model:
LiquidAI/LFM2.5-8B-A1B - Export dtype:
bfloat16 - Text-only export:
False
This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.
- Downloads last month
- 135
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support