MLX
Safetensors
mistral3
rotorquant
kv-cache-quantization
2-bit
weight-quantization
leanstral
lean4
formal-proofs
theorem-proving
quantized
apple-silicon
mistral
Mixture of Experts
Instructions to use majentik/Leanstral-RotorQuant-MLX-2bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use majentik/Leanstral-RotorQuant-MLX-2bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Leanstral-RotorQuant-MLX-2bit majentik/Leanstral-RotorQuant-MLX-2bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio