How to use ailexleon/Magistaroth-24B-v1-MPOA-mlx-4Bit with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ailexleon/Magistaroth-24B-v1-MPOA-mlx-4Bit", dtype="auto")
How to use ailexleon/Magistaroth-24B-v1-MPOA-mlx-4Bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir Magistaroth-24B-v1-MPOA-mlx-4Bit ailexleon/Magistaroth-24B-v1-MPOA-mlx-4Bit
ailexleon commited on 