sweepai

/

sweep-next-edit-v2-7B

like 41

Follow

Sweep AI 157

Just download all files, instal mlx-lm ( pip install mlx-lm) and then:

1. BF16

python -m mlx_lm.convert \
    --hf-path /path/to/safetensors_folder \
    --mlx-path /path/to/output_mlx_bf16

2. 8-bit

python -m mlx_lm.convert \
    --hf-path /path/to/safetensors_folder \
    -q 8 \
    --mlx-path /path/to/output_mlx_8bit