--- license: apache-2.0 library_name: transformers base_model: google/gemma-4-12B-it base_model_relation: finetune pipeline_tag: text-classification tags: - decision-model - decision-index - system-one - gemma4 --- # Karpo Decision 12B

GitHub Karpo Decision 31B: Decision Index #1 License: Apache 2.0

A multimodal decision model of the Karpo Decision family: given a state (a web page and its screenshot, a document, a conversation: text, JSON and images) and typed questions about it, it returns a probability for every option of every question in one forward pass, without generating text. Fine-tuned from [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it), with a linear readout over the options. - **Parameters:** 12.0B in bf16, plus a 255 × 3,840 readout in fp32 - **Input:** multimodal, text and images (a screenshot at `state.viewport_screenshot`, or data URLs in `images`) - **Questions:** `choice` (up to 255 options), `noul` (true or false), `score` (a level on a scale) - **Context:** 32,768 tokens per sequence; a longer request is split by questions, each part with the full state - **Interfaces:** a Python API and an HTTP server in the System One format (`POST /v1/systemone`) - **Licence:** [Apache-2.0](LICENSE) ## The Karpo Decision family Score vs. size: Karpo Decision 0.8B to 31B on the Decision Index 0.3 public suite, with the other board models of each size class *Score vs. size on the Decision Index 0.3 public suite, board of 12 November 2026.* | Model | Base | Parameters | |---|---|---| | [karpo-decision-31B](https://huggingface.co/MachinePulseAI/karpo-decision-31B) | Gemma 4 31B | 31.3B | | **karpo-decision-12B** | Gemma 4 12B | 12.0B | | [karpo-decision-9B](https://huggingface.co/MachinePulseAI/karpo-decision-9B) | Qwen3.5 9B | 8.4B | | [karpo-decision-4B](https://huggingface.co/MachinePulseAI/karpo-decision-4B) | Qwen3.5 4B | 4.5B | | [karpo-decision-2B](https://huggingface.co/MachinePulseAI/karpo-decision-2B) | Qwen3.5 2B | 2.2B | | [karpo-decision-0.8B](https://huggingface.co/MachinePulseAI/karpo-decision-0.8B) | Qwen3.5 0.8B | 0.85B | The family's largest model, [karpo-decision-31B](https://huggingface.co/MachinePulseAI/karpo-decision-31B), is ranked #1 on the [Decision Index](https://huggingface.co/spaces/multimodalart/jev-decision-index), with the highest Full score, 73.9, on the maintainers' private tests (edition 0.4.1, board of 12 November 2026, 300 entries); its public index is 75.0. ## How it works - **A readout, not generation.** Every option is labelled with an option code. At the `Answer: (` slot that ends a question's branch, a linear readout scores 255 option codes and a softmax over the question's own options gives the probabilities. Nothing is decoded, so the answer is always one of the options. - **Many questions, one forward pass.** A request is one state and any number of questions, encoded as one sequence: the list of questions, the state, then one branch per question with its options. - **Branch attention.** A branch reads the shared block (questions and state) and itself, never another branch. The state is computed once per sequence, and no question sees another question's options. The question-list-first layout follows [FlexDM](https://github.com/1000luca/FlexDM) and [jev-brain](https://github.com/wcole3/jev-brain); the shared-block and branch rule follows [Sieve-31B-v3](https://huggingface.co/sthanika-ai/Sieve-31B-v3). ## Use Inference code: [github.com/machinepulse-ai/karpo-decision](https://github.com/machinepulse-ai/karpo-decision). Python 3.12 or later and one GPU; the weights take 23.9 GB, long requests more. Loading the checkpoint as a plain chat model does not reproduce its answers. ```bash pip install "karpo-decision @ git+https://github.com/machinepulse-ai/karpo-decision" ``` ```python from huggingface_hub import snapshot_download from karpo_decision.decider import Decider path = snapshot_download("MachinePulseAI/karpo-decision-12B") decider = Decider.from_pretrained(path, device="cuda") response = decider.decide({ "state": "Order 1182: the customer asks to return a blender bought 45 days ago. Policy: returns within 30 days.", "questions": { "eligible": {"type": "noul", "instructions": "Is the return eligible under the policy?"}, "action": {"type": "choice", "instructions": "What should the agent do?", "criteria": {"refund": "Issue a full refund", "decline": "Politely decline the return", "escalate": "Escalate to a supervisor"}}, }, }) print(response["answers"]) # {"eligible": {"type": "noul", "noul": P(true)}, # "action": {"type": "choice", "choice": , "probabilities": {: p, ...}, "confidence": c}} ``` HTTP server (`POST /v1/systemone`, `GET /healthz`): ```bash CKPT=$(python -c 'from huggingface_hub import snapshot_download; print(snapshot_download("MachinePulseAI/karpo-decision-12B"))') torchrun --standalone --nproc_per_node 1 -m karpo_decision.serve.server --checkpoint "$CKPT" --port 18440 ``` [Decision Index](https://github.com/apolinario/decision-index) kit, installed separately: ```bash pip install "decision-index @ git+https://github.com/apolinario/decision-index" python -m decision_index run --engine karpo_decision.serve.engine:DecisionIndexEngine \ --option checkpoint="$CKPT" --out runs/karpo-decision-12B ``` ## Lineage [google/gemma-4-12B](https://huggingface.co/google/gemma-4-12B) → [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it) → **karpo-decision-12B** (fine-tuned) ## Limitations - No audio: the audio embedder is in the checkpoint but unused. - Not a chat or text-generation model; generation was not evaluated. - A question that does not fit in 32,768 tokens with its state is refused, never truncated. - It always picks one of the given options. ## Licence The weights and model files are licensed under the [Apache License, Version 2.0](LICENSE). Copyright 2026 MachinePulse Pte. Ltd. karpo-decision-12B is a modified version of [google/gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it) ([Apache-2.0](https://ai.google.dev/gemma/docs/gemma_4_license)): decoder weights fine-tuned, readout added. Gemma 4 stays under its own licence, a copy of which is in [licenses/Gemma-4-LICENSE](licenses/Gemma-4-LICENSE); see [NOTICE](NOTICE). The inference code ([github.com/machinepulse-ai/karpo-decision](https://github.com/machinepulse-ai/karpo-decision)) is licensed under Apache-2.0. ### Attribution Not required by the licence, but appreciated: if a product or service uses this model or a derivative, show > Powered by karpo-decision (MachinePulse) with a link to where the medium allows one.