File size: 565 Bytes
6716e35 c1849b2 6716e35 c1849b2 d0951cb | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | ---
base_model:
- CohereLabs/BLS-Mini-Code-1.0
base_model_relation: quantized
library_name: mlx
---
Generated via:
```
git clone https://github.com/eauchs/mlx-lm --single-branch --depth=1 --branch add-cohere2-moe
uv venv venv
source venv/bin/activate.fish
uv pip install mlx[cpu] ./mlx-lm
python -m mlx_lm.convert \
--hf-path "./BLS-Mini-Code-1.0" \
-q \
--q-bits 4 --q-group-size 64 \
--mlx-path ./cohere-mlx-q4
```
Requires this fork of mlx_lm to run (main doesn't include support for cohere2_moe yet): https://github.com/eauchs/mlx-lm/tree/add-cohere2-moe |