exolabs/ornith-1-0-35b-4bit-text-dequant-bf16
Public dequantized BF16 export for vLLM validation.
- Internal model id:
ornith-1-0-35b-4bit - MLX source:
mlx-community/Ornith-1.0-35B-4bit - Original HF comparison model:
deepreinforce-ai/Ornith-1.0-35B - Export dtype:
bfloat16 - Text-only export:
False
This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.
- Downloads last month
- 431
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support