| --- |
| license: apache-2.0 |
| base_model: |
| - bespokelabs/Bespoke-Nimble-9B-v2 |
| - Qwen/Qwen3.5-9B |
| library_name: onnx |
| tags: |
| - ollaya |
| - onnx |
| - decision-model |
| - system-one |
| pipeline_tag: text-classification |
| --- |
| |
| # nimble for Ollaya |
|
|
| [Ollaya](https://github.com/ollaya-dev/ollaya) package of **[bespokelabs/Bespoke-Nimble-9B-v2](https://huggingface.co/bespokelabs/Bespoke-Nimble-9B-v2)** and **[Qwen/Qwen3.5-9B](https://huggingface.co/Qwen/Qwen3.5-9B)** by Bespoke Labs (adapter) and the Qwen team (base model). |
| Ollaya runs open decision models locally, the way Ollama runs LLMs: typed questions in, |
| calibrated answers out, behind a TypeSafe-compatible API. |
|
|
| ```sh |
| ollaya run nimble |
| ``` |
|
|
| ## What is in this repository |
|
|
| This repository holds only the files Ollaya derives, with no weights. Each graph is an ONNX export of the |
| original model whose weights **reference the authors' own weight files by byte offset**, |
| so `ollaya pull` downloads the weights from the upstream repositories, unmodified and pinned to a |
| commit, and verifies their sha256. |
|
|
| | Tag | Upstream | Files | |
| |---|---|---| |
| | `nimble:9b` | [bespokelabs/Bespoke-Nimble-9B-v2@4b8c04d](https://huggingface.co/bespokelabs/Bespoke-Nimble-9B-v2/tree/4b8c04d1ac2cea3e41e5e3c4d2130bcead2c0abe), [Qwen/Qwen3.5-9B@c202236](https://huggingface.co/Qwen/Qwen3.5-9B/tree/c202236235762e1c871ad0ccb60c8ee5ba337b9a) | `9b/model-fp32.onnx`, `9b/decision.json`, `9b/calibration.json` | |
|
|
| Each tag has an fp32 graph, used on CPU and GPU. Each tag also has `decision.json` (sequence layout, special tokens) and |
| `calibration.json` (temperatures). |
|
|
| ## Parity |
|
|
| Ollaya's Rust runtime matches the author's reference code (serving_schema.prepare_prompts and inference.candidate_logits, PyTorch fp32 with the LoRA unmerged) on 492 questions from 104 requests: identical token rows, the same 4 rejected requests, the same decision on every question, option logits within 1.1e-4 and probabilities within 6.5e-6 (CUDA). |
| |
| ## License |
| |
| Same as the upstream model (Apache-2.0). Ollaya itself is Apache-2.0. |
| |
