Quantized 3bit MLX version of https://huggingface.co/NousResearch/DeepHermes-3-Mistral-24B-Preview
- Downloads last month
- 6
Model size
3B params
Tensor type
F16
·
U32 ·
Hardware compatibility
Log In to add your hardware
3-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Lowkey-Loki/DeepHermes-3-Mistral-24B-Preview-mlx-3bit
Base model
mistralai/Mistral-Small-24B-Base-2501