---
base_model:
- CohereLabs/BLS-Mini-Code-1.0
tags:
- cohere2
- cohere2_moe
- llama.cpp
- BLS
- BLS-Mini-Code
- BLS-Mini-Code-1.0
---
<P>
This is an experimental quantization of CohereLab's BLS-Mini-Code-1.0, a 30B A3B MoE model, and is still in development.<BR>
I am not affiliated with CohereLabs in any way and this is my own independent work.<BR>
To use these GGUFs with llama.cpp, you <B>must install</B> the <A HREF="https://github.com/ggml-org/llama.cpp/pull/24260">llama.cpp PR #24260</A> for the Cohere2-MoE :<br>
</P>

```
git fetch origin pull/24260/head:cohere2-moe
git checkout cohere2-moe

OR

gh pr checkout 24260
```