--- inference: false library_name: transformers license: apache-2.0 tags: - conversational - chat base_model: CohereLabs/North-Mini-Code-1.0 --- # **Model Card for North Mini Code** ## **Model Summary** North Mini Code is an open weights research release of a 30B-A3B parameter model optimized for code generation, agentic software engineering, and terminal tasks. Developed by: [Cohere](https://cohere.com/) and [Cohere Labs](https://cohere.com/research) * Point of Contact: [**Cohere Labs**](https://cohere.com/research) * License: Apache 2.0 * Model: North Mini Code * Model Size: 30B total; 3B active * Context length: 256K & 64K max output For more details about this model, please check out our [blog post](https://huggingface.co/blog/CohereLabs/introducing-north-mini-code). **Try North Mini Code** You can try out North Mini Code before downloading the weights in OpenCode and our hosted [Hugging Face Space](https://huggingface.co/spaces/CohereLabs/North-Mini-Code-1.0). **Evaluation** ![image1](https://cdn-uploads.huggingface.co/production/uploads/62668f725fb8d521d94d8451/4wH5d_YAaW0lZG65bC8g5.png)
Benchmarking Methodology [CLICK TO EXPAND] - We used SWE-Bench Verified, SWE-Bench Pro, Terminal-Bench v2, and Terminal-Bench Hard to benchmark North Mini Code's agentic coding capabilities. For evaluation harnesses, we used the Swe-Agent harness v1.1.0 for SWE-Bench, and a simple ReAct harness employing a single terminal-use tool based on Harbor's Tmux session implementation for Terminal-Bench v2. For Terminal Bench Hard, we directly used Terminus-2, following the same methodology as the Artificial Analysis Intelligence Index to compare North-Mini-Code-1.0 with the other models. Additionally, we used SciCode and LiveCodeBench v6 as complex code-generation benchmarks outside of tool use. - We run each benchmark with 3 different seeds and report the average benchmark performance, using temperature=1.0 and top\_p=0.95. We used publicly reported scores for competitor models, either from original reports or the Artificial Analysis Intelligence Index, where available. Additionally, Gemma4’s scores for agentic coding tasks were reported by [Qwen team](https://qwen.ai/blog?id=qwen3.6-35b-a3b). For benchmark results that any public report is missing, denoted by (\*) in the figure, we run them internally using the recommended model configuration.
**Usage** To use our model in transformers, please use our BF16 model weights. Our FP8 checkpoint is designed to be used with vLLM and is not compatible with transformers due to our quantization algorithm. ### **vLLM** You can also run the model in vLLM. Please use vLLM main for North Mini Code until a new release is available, and accurate response parsing also requires installing Cohere’s melody library. ```shell uv pip install "git+https://github.com/vllm-project/vllm.git" uv pip install cohere_melody>=0.9.0 ``` Then the vllm server can be started with the following command: ```shell vllm serve CohereLabs/North-Mini-Code-1.0-fp8 \ -tp 1 \ --max-model-len 320000 \ --tool-call-parser cohere_command4 \ --reasoning-parser cohere_command4 \ --enable-auto-tool-choice \ --moe-backend triton ``` **Use locally deployed North Mini Code in OpenCode:** Please use OpenCode main branch until a new release is available. ```shell # Example commands to install on linux git clone https://github.com/anomalyco/opencode.git cd opencode # Install Bun curl -fsSL https://bun.sh/install | bash export BUN_INSTALL="$HOME/.bun" export PATH="$BUN_INSTALL/bin:$PATH" # node-gyp was needed by a dependency bun add -g node-gyp # Install dependencies bun install # Build CLI bun run --cwd packages/opencode build /usr/bin/install -m 755 \ ./opencode/packages/opencode/dist/opencode-linux-x64/bin/opencode \ /root/.local/bin/opencode ``` To use locally deployed North Mini Code in Opencode, please use this config which enables interleaved reasoning: ```json { "$schema": "https://opencode.ai/config.json", "model": "vllm/CohereLabs/North-Mini-Code-1.0-fp8", "provider": { "vllm": { "npm": "@ai-sdk/openai-compatible", "name": "Local vLLM server", "options": { "baseURL": "http://127.0.0.1:8000/v1", "apiKey": "EMPTY" }, "models": { "North-Mini-Code-1.0": { "name": "North-Mini-Code-1.0", "interleaved": { "field": "reasoning" }, "limit": { "context": 256000, "output": 64000 } } } } } } ``` ## **Model Details** **Input**: Text only. **Output**: Model generates text. **Model Architecture**: North-Mini-Code-1.0 is a decoder-only Transformer-based sparse Mixture-of-Experts model. It uses an efficient attention implementation, interleaved between sliding-window attention with RoPE and global attention with no positional embeddings, in a 3:1 ratio. The feed-forward block is an MoE block with 128 experts, of which 8 are activated per token. Each expert block is an FFN block with SwiGLU activation. The router applies a sigmoid activation function to the logits before the top-k selection. We also use a single dense layer before the sparse layers. North-Mini-Code-1.0 was post-trained using a two-stage cascaded supervised fine-tuning (SFT) followed by reinforcement learning with verifiable rewards (RLVR), focusing on agentic coding. For more technical details, please check out our [blog post](https://huggingface.co/blog/CohereLabs/introducing-north-mini-code). **Context Length:** North-Mini-Code-1.0 supports a context length of 256K & 64K output length. ## **Model Card Contact** For errors or additional questions about details in this model card, contact \[labs@cohere.com\].