decision-kai Core ML
FP16 Core ML conversion of llm-semantic-router/Decision-1.0-Kai-0.6B at revision 7185f514f54b8f93c55998b1e8f9c5cc67f0d029. The complete native model has 571,909,635 unique parameters and three trained decision paths. choice.mlpackage, noul.mlpackage, and score.mlpackage jointly implement those paths; calling only Choice is not the full native model.
This is an initial fixed-shape release. Supported shapes are listed below. Longer requests or larger candidate sets must be rejected or served by a later variant; silently truncating them changes the model. The source model's public input budget is 1,024 tokens. conversion/run_coreml.py supplies the pinned System One renderer, tokenizer, candidate masks, softmax, and output mapping.
| Decision path | Tokens | Candidate slots | FP16 package MB | Validated source requests | Max probability error vs native |
|---|---|---|---|---|---|
| choice | 128 | 3 | 643.8 | 2 | 0.00114638 |
| noul | 128 | 2 | 643.8 | 2 | 0.00321746 |
| score | 128 | 3 | 643.8 | 2 | 0.000484943 |
All three installed packages total 1931.4 MB. The three graphs each carry an embedding copy; this exceeds the unique native parameter payload. Package size does not include Core ML compilation.
Each package was compared against the complete pinned native model on the source repository's real decision and System One examples. This small parity check establishes conversion behavior on those inputs; it is not an official Decision Index score or a broad quality evaluation.
The tracker lists an estimated 307.8M encoder for this entry. This release contains about 572M unique native parameters, including all trained paths and heads. Its exact historical serving adapter is not publicly verified, so the tracker score is not attributed to this Core ML build.
The Decision contributions are Apache 2.0. The inherited tokenizer has additional Gemma-origin terms. See LICENSE, NOTICE, LICENSING_STATUS.md, DISTRIBUTION_TERMS.md, and LICENSES/ included here. The tokenizer and source runtime were not retrained or modified.
Conversion code, source locks, fixed real fixtures, and reports are in conversion/ and reports/. Source artifacts remain at the upstream model link above.
uv sync --project conversion
uv run --project conversion python conversion/run_coreml.py --repo-root . --request-json conversion/upstream-system-one.json
Repository: https://huggingface.co/FluidInference/decision-1.0-kai-coreml
- Downloads last month
- -