Image-Text-to-Text
Transformers
Safetensors
GGUF
qwen3_5
system-one
decision-making
classification
calibration
structured-output
on-device
multimodal
Instructions to use bynn-intelligence-com/decisionnode-edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bynn-intelligence-com/decisionnode-edge with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="bynn-intelligence-com/decisionnode-edge")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("bynn-intelligence-com/decisionnode-edge") model = AutoModelForMultimodalLM.from_pretrained("bynn-intelligence-com/decisionnode-edge", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use bynn-intelligence-com/decisionnode-edge with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf bynn-intelligence-com/decisionnode-edge:Q8_0 # Run inference directly in the terminal: llama cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf bynn-intelligence-com/decisionnode-edge:Q8_0 # Run inference directly in the terminal: llama cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf bynn-intelligence-com/decisionnode-edge:Q8_0 # Run inference directly in the terminal: ./llama-cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf bynn-intelligence-com/decisionnode-edge:Q8_0 # Run inference directly in the terminal: ./build/bin/llama-cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0
Use Docker
docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use bynn-intelligence-com/decisionnode-edge with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "bynn-intelligence-com/decisionnode-edge" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bynn-intelligence-com/decisionnode-edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
- SGLang
How to use bynn-intelligence-com/decisionnode-edge with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "bynn-intelligence-com/decisionnode-edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bynn-intelligence-com/decisionnode-edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "bynn-intelligence-com/decisionnode-edge" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "bynn-intelligence-com/decisionnode-edge", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Ollama
How to use bynn-intelligence-com/decisionnode-edge with Ollama:
ollama run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
- Unsloth Desktop
- Docker Model Runner
How to use bynn-intelligence-com/decisionnode-edge with Docker Model Runner:
docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
- Lemonade
How to use bynn-intelligence-com/decisionnode-edge with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull bynn-intelligence-com/decisionnode-edge:Q8_0
Run and chat with the model
lemonade run user.decisionnode-edge-Q8_0
List all available models
lemonade list
- Atomic Chat
Model card: System One, recommended setup
Browse files- MANIFEST.sha256 +1 -1
- README.md +52 -2
MANIFEST.sha256
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32 ./LICENSE-base
|
| 3 |
2014f13a6fe1d9178c84cde47bb087a7a74adbe38650f1823a944077081e86d0 ./LICENSING.md
|
| 4 |
e4dcac398e39a098e07f625ed239949296a2000d95dcc275cb0d8083ebb51dc9 ./NOTICE
|
| 5 |
-
|
| 6 |
c44489690e63adb3abd8c65ede675fadc5714126e3f866cbd292df824880cb77 ./assets/decisionnode-banner.png
|
| 7 |
5febf5c3cb5843034f2251d959c475a4a629dec65bf3ea494b4fed0a3b8aa3aa ./calibration.json
|
| 8 |
28b44a18f60b7e3039c503971b6d194b51c723f0c8a62d56bd6ce7f7f34e9f87 ./config.json
|
|
|
|
| 2 |
50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32 ./LICENSE-base
|
| 3 |
2014f13a6fe1d9178c84cde47bb087a7a74adbe38650f1823a944077081e86d0 ./LICENSING.md
|
| 4 |
e4dcac398e39a098e07f625ed239949296a2000d95dcc275cb0d8083ebb51dc9 ./NOTICE
|
| 5 |
+
28c7af7e249d0e7bc648f9a83e42740dc37487f748eb12b457b53a6f2fba61e6 ./README.md
|
| 6 |
c44489690e63adb3abd8c65ede675fadc5714126e3f866cbd292df824880cb77 ./assets/decisionnode-banner.png
|
| 7 |
5febf5c3cb5843034f2251d959c475a4a629dec65bf3ea494b4fed0a3b8aa3aa ./calibration.json
|
| 8 |
28b44a18f60b7e3039c503971b6d194b51c723f0c8a62d56bd6ce7f7f34e9f87 ./config.json
|
README.md
CHANGED
|
@@ -5,6 +5,7 @@ base_model: Qwen/Qwen3.5-2B-Base
|
|
| 5 |
base_model_relation: finetune
|
| 6 |
library_name: transformers
|
| 7 |
tags:
|
|
|
|
| 8 |
- decision-making
|
| 9 |
- classification
|
| 10 |
- calibration
|
|
@@ -17,7 +18,9 @@ tags:
|
|
| 17 |
|
| 18 |
# DecisionNode Edge
|
| 19 |
|
| 20 |
-
DecisionNode Edge is an open-weight decision model from [Bynn Intelligence](https://decisionnode.com). It reads text and images and answers each question with a typed, calibrated decision: a choice, a score, a yes-or-no probability or a number. It never generates free text. It runs entirely on your own hardware, from a datacenter GPU to a laptop CPU, and uses the same request and response format as the [DecisionNode API](https://decisionnode.com/docs/api).
|
|
|
|
|
|
|
| 21 |
|
| 22 |
This repository contains DecisionNode Edge 0.9.1, the larger of the two DecisionNode Edge models. [DecisionNode Edge Mini](https://huggingface.co/bynn-intelligence-com/decisionnode-edge-mini) is a 0.85-billion-parameter sibling for CPUs and constrained devices.
|
| 23 |
|
|
@@ -29,6 +32,7 @@ This repository contains DecisionNode Edge 0.9.1, the larger of the two Decision
|
|
| 29 |
- **Fast everywhere.** Optimized backends for NVIDIA GPUs, Apple silicon, x86 CPUs and llama.cpp devices, selected automatically, with consistent answers across all of them.
|
| 30 |
- **Private by design.** Inference runs offline. Nothing you send to the model leaves your machine.
|
| 31 |
- **Compatible with the DecisionNode API.** Code written for the hosted API runs against DecisionNode Edge with only the transport changed.
|
|
|
|
| 32 |
|
| 33 |
## The DecisionNode family
|
| 34 |
|
|
@@ -63,6 +67,51 @@ Available only on the hosted platform:
|
|
| 63 |
|
| 64 |
Decision accuracy is the mean over our 15-benchmark evaluation suite (see Evaluation). Times are the median for one question at about 500 tokens of input; the desktop CPU is an 8-core AMD Ryzen 7 9800X3D.
|
| 65 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 66 |
## Model details
|
| 67 |
|
| 68 |
| | |
|
|
@@ -197,12 +246,13 @@ DecisionNode Edge is designed for the frequent, well-defined judgments inside so
|
|
| 197 |
- classification and scoring against criteria you define in the request
|
| 198 |
- validation and guardrail checks before an action runs
|
| 199 |
- reading values from images, such as whether a total matches or how many items are present
|
|
|
|
| 200 |
- applications that must run offline or keep data on the device
|
| 201 |
|
| 202 |
## Limitations
|
| 203 |
|
| 204 |
- **Decisions about people need human oversight.** Do not use DecisionNode Edge to make consequential decisions about individuals on its own. Uses in hiring, credit, housing, insurance, education, benefits, law enforcement or health care require a person who reviews each decision and can overrule it, in line with the DecisionNode acceptable use policy.
|
| 205 |
-
- **Calibrated, not infallible.** An answer given with probability 0.9 is wrong about one time in ten. Use the probabilities to decide when to defer to a person or a larger model.
|
| 206 |
- **Accuracy varies by domain and language.** Evaluate the model on your own data before relying on it.
|
| 207 |
- **Input length.** The model was evaluated on inputs of up to 8,192 tokens. The runtime accepts up to 16,384 tokens and rejects longer inputs rather than truncating them.
|
| 208 |
- **Not a generative model.** DecisionNode Edge does not produce text. Use it through the runtime; loading it in a text-generation pipeline yields meaningless output.
|
|
|
|
| 5 |
base_model_relation: finetune
|
| 6 |
library_name: transformers
|
| 7 |
tags:
|
| 8 |
+
- system-one
|
| 9 |
- decision-making
|
| 10 |
- classification
|
| 11 |
- calibration
|
|
|
|
| 18 |
|
| 19 |
# DecisionNode Edge
|
| 20 |
|
| 21 |
+
DecisionNode Edge is an open-weight System One decision model from [Bynn Intelligence](https://decisionnode.com). It reads text and images and answers each question with a typed, calibrated decision: a choice, a score, a yes-or-no probability or a number. It never generates free text. It runs entirely on your own hardware, from a datacenter GPU to a laptop CPU, and uses the same request and response format as the [DecisionNode API](https://decisionnode.com/docs/api).
|
| 22 |
+
|
| 23 |
+
A System One model is a class of AI model that returns typed, probabilistic decisions from a fixed answer space instead of generating text. Given a piece of state and a set of questions defined in code, it answers each one with a schema-valid value such as a chosen option, a score, or a probability, and then stops.
|
| 24 |
|
| 25 |
This repository contains DecisionNode Edge 0.9.1, the larger of the two DecisionNode Edge models. [DecisionNode Edge Mini](https://huggingface.co/bynn-intelligence-com/decisionnode-edge-mini) is a 0.85-billion-parameter sibling for CPUs and constrained devices.
|
| 26 |
|
|
|
|
| 32 |
- **Fast everywhere.** Optimized backends for NVIDIA GPUs, Apple silicon, x86 CPUs and llama.cpp devices, selected automatically, with consistent answers across all of them.
|
| 33 |
- **Private by design.** Inference runs offline. Nothing you send to the model leaves your machine.
|
| 34 |
- **Compatible with the DecisionNode API.** Code written for the hosted API runs against DecisionNode Edge with only the transport changed.
|
| 35 |
+
- **Escalates when unsure.** Settle most questions on the device and send only the low-confidence ones to the hosted models (see [Recommended setup](#recommended-setup)).
|
| 36 |
|
| 37 |
## The DecisionNode family
|
| 38 |
|
|
|
|
| 67 |
|
| 68 |
Decision accuracy is the mean over our 15-benchmark evaluation suite (see Evaluation). Times are the median for one question at about 500 tokens of input; the desktop CPU is an 8-core AMD Ryzen 7 9800X3D.
|
| 69 |
|
| 70 |
+
## Recommended setup
|
| 71 |
+
|
| 72 |
+
DecisionNode Edge is built to run where the decision is made: on a robot, a drone, a vehicle, a camera, a laptop or your own servers. We recommend pairing it with the hosted models in a cascade:
|
| 73 |
+
|
| 74 |
+
1. DecisionNode Edge answers every question first, locally, in milliseconds and without a network round trip.
|
| 75 |
+
2. When its confidence is below your threshold (we suggest 0.7), the same question goes to DecisionNode Flash on the hosted API.
|
| 76 |
+
3. When Flash is also below the threshold, the question goes to DecisionNode, the most accurate model. Its answer is final: below the threshold, your code takes its safe action, such as holding, declining or slowing down.
|
| 77 |
+
|
| 78 |
+
Most questions are settled on the device, and only the hard ones reach the API. You keep local speed and privacy for the common case, and the highest accuracy where it matters. All three models share one request and response format and calibrated probabilities, so the same request and the same threshold work at every step.
|
| 79 |
+
|
| 80 |
+
If you run your own hardware, from GPUs to embedded devices, this is the setup we recommend. If you prefer a fully managed inference service at very low cost, call the [hosted API](https://decisionnode.com/docs/api) directly.
|
| 81 |
+
|
| 82 |
+
```python
|
| 83 |
+
import os
|
| 84 |
+
|
| 85 |
+
import requests
|
| 86 |
+
from huggingface_hub import snapshot_download
|
| 87 |
+
from decisionnode_edge import EdgeModel
|
| 88 |
+
|
| 89 |
+
edge = EdgeModel.load(snapshot_download("bynn-intelligence-com/decisionnode-edge"))
|
| 90 |
+
API = "https://api.decisionnode.com/v1/decide"
|
| 91 |
+
HEADERS = {"Authorization": f"Bearer {os.environ['DECISIONNODE_API_KEY']}"}
|
| 92 |
+
|
| 93 |
+
|
| 94 |
+
def confidence(answer):
|
| 95 |
+
if answer["type"] == "truth": # distance from 0.5, on the same 0 to 1 scale
|
| 96 |
+
return abs(2 * answer["truth"] - 1)
|
| 97 |
+
return answer["confidence"]
|
| 98 |
+
|
| 99 |
+
|
| 100 |
+
def decide(request, threshold=0.7):
|
| 101 |
+
answers = edge.decide(request)["answers"]
|
| 102 |
+
for model in ("decisionnode-flash-latest", "decisionnode-latest"):
|
| 103 |
+
unsure = {k: q for k, q in request["questions"].items() if confidence(answers[k]) < threshold}
|
| 104 |
+
if not unsure:
|
| 105 |
+
break
|
| 106 |
+
hosted = requests.post(API, headers=HEADERS, timeout=10,
|
| 107 |
+
json={**request, "model": model, "questions": unsure})
|
| 108 |
+
hosted.raise_for_status()
|
| 109 |
+
answers.update(hosted.json()["answers"])
|
| 110 |
+
return answers # still below the threshold: take the safe action
|
| 111 |
+
```
|
| 112 |
+
|
| 113 |
+
Pass images as base64 `data` with a `media_type` (not a local `path`), so the same request is valid on the device and on the hosted API. Only the questions that are still unsure are sent, and a decision never changes when the same request is sent again, so each question costs at most one call per hosted model.
|
| 114 |
+
|
| 115 |
## Model details
|
| 116 |
|
| 117 |
| | |
|
|
|
|
| 246 |
- classification and scoring against criteria you define in the request
|
| 247 |
- validation and guardrail checks before an action runs
|
| 248 |
- reading values from images, such as whether a total matches or how many items are present
|
| 249 |
+
- on-device decisions in robots, drones, vehicles and cameras, with the hosted models for the hard cases
|
| 250 |
- applications that must run offline or keep data on the device
|
| 251 |
|
| 252 |
## Limitations
|
| 253 |
|
| 254 |
- **Decisions about people need human oversight.** Do not use DecisionNode Edge to make consequential decisions about individuals on its own. Uses in hiring, credit, housing, insurance, education, benefits, law enforcement or health care require a person who reviews each decision and can overrule it, in line with the DecisionNode acceptable use policy.
|
| 255 |
+
- **Calibrated, not infallible.** An answer given with probability 0.9 is wrong about one time in ten. Use the probabilities to decide when to defer to a person or a larger model (see [Recommended setup](#recommended-setup)).
|
| 256 |
- **Accuracy varies by domain and language.** Evaluate the model on your own data before relying on it.
|
| 257 |
- **Input length.** The model was evaluated on inputs of up to 8,192 tokens. The runtime accepts up to 16,384 tokens and rejects longer inputs rather than truncating them.
|
| 258 |
- **Not a generative model.** DecisionNode Edge does not produce text. Use it through the runtime; loading it in a text-generation pipeline yields meaningless output.
|