How to use AutomatosX/AX-Clef-27B-MLX-AXQ-6bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download AutomatosX/AX-Clef-27B-MLX-AXQ-6bit --local-dir AX-Clef-27B-MLX-AXQ-6bit
https://huggingface.co/AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/resolve/main/axquant_plan.json
hf download hf://AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/axquant_plan.json
curl -L -o axquant_plan.json https://huggingface.co/AutomatosX/AX-Clef-27B-MLX-AXQ-6bit/resolve/main/axquant_plan.json
