Instructions to use bynn-intelligence-com/decisionnode-edge with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use bynn-intelligence-com/decisionnode-edge with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="bynn-intelligence-com/decisionnode-edge")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("bynn-intelligence-com/decisionnode-edge")
model = AutoModelForMultimodalLM.from_pretrained("bynn-intelligence-com/decisionnode-edge", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use bynn-intelligence-com/decisionnode-edge with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf bynn-intelligence-com/decisionnode-edge:Q8_0
# Run inference directly in the terminal:
llama cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf bynn-intelligence-com/decisionnode-edge:Q8_0
# Run inference directly in the terminal:
llama cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf bynn-intelligence-com/decisionnode-edge:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf bynn-intelligence-com/decisionnode-edge:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf bynn-intelligence-com/decisionnode-edge:Q8_0

Use Docker

docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0

Llama new
LM Studio
Jan

vLLM

How to use bynn-intelligence-com/decisionnode-edge with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "bynn-intelligence-com/decisionnode-edge"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0

SGLang

How to use bynn-intelligence-com/decisionnode-edge with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "bynn-intelligence-com/decisionnode-edge" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "bynn-intelligence-com/decisionnode-edge" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Ollama
How to use bynn-intelligence-com/decisionnode-edge with Ollama:
```
ollama run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
```
Unsloth Desktop
Docker Model Runner
How to use bynn-intelligence-com/decisionnode-edge with Docker Model Runner:
```
docker model run hf.co/bynn-intelligence-com/decisionnode-edge:Q8_0
```

Lemonade

How to use bynn-intelligence-com/decisionnode-edge with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull bynn-intelligence-com/decisionnode-edge:Q8_0

Run and chat with the model

lemonade run user.decisionnode-edge-Q8_0

List all available models

lemonade list

Atomic Chat

decisionnode-edge / tokenizer_config.json

bynn-intelligence

DecisionNode Edge 0.9.1

071512e verified 5 days ago

Raw History Blame Contribute Delete

1.47 kB

{
  "add_prefix_space": false,
  "audio_bos_token": "<|audio_start|>",
  "audio_eos_token": "<|audio_end|>",
  "audio_token": "<|audio_pad|>",
  "backend": "tokenizers",
  "bos_token": null,
  "clean_up_tokenization_spaces": false,
  "eos_token": "<|endoftext|>",
  "errors": "replace",
  "extra_special_tokens": [
    "<|im_start|>",
    "<|im_end|>",
    "<|object_ref_start|>",
    "<|object_ref_end|>",
    "<|box_start|>",
    "<|box_end|>",
    "<|quad_start|>",
    "<|quad_end|>",
    "<|vision_start|>",
    "<|vision_end|>",
    "<|vision_pad|>",
    "<|image_pad|>",
    "<|video_pad|>"
  ],
  "image_token": "<|image_pad|>",
  "is_local": true,
  "local_files_only": false,
  "merges_file": null,
  "model_max_length": 262144,
  "model_specific_special_tokens": {
    "audio_bos_token": "<|audio_start|>",
    "audio_eos_token": "<|audio_end|>",
    "audio_token": "<|audio_pad|>",
    "image_token": "<|image_pad|>",
    "video_token": "<|video_pad|>",
    "vision_bos_token": "<|vision_start|>",
    "vision_eos_token": "<|vision_end|>"
  },
  "pad_token": "<|endoftext|>",
  "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
  "split_special_tokens": false,
  "tokenizer_class": "Qwen3_5Tokenizer",
  "unk_token": null,
  "video_token": "<|video_pad|>",
  "vision_bos_token": "<|vision_start|>",
  "vision_eos_token": "<|vision_end|>"
}

	{
	"add_prefix_space": false,
	"audio_bos_token": "<\|audio_start\|>",
	"audio_eos_token": "<\|audio_end\|>",
	"audio_token": "<\|audio_pad\|>",
	"backend": "tokenizers",
	"bos_token": null,
	"clean_up_tokenization_spaces": false,
	"eos_token": "<\|endoftext\|>",
	"errors": "replace",
	"extra_special_tokens": [
	"<\|im_start\|>",
	"<\|im_end\|>",
	"<\|object_ref_start\|>",
	"<\|object_ref_end\|>",
	"<\|box_start\|>",
	"<\|box_end\|>",
	"<\|quad_start\|>",
	"<\|quad_end\|>",
	"<\|vision_start\|>",
	"<\|vision_end\|>",
	"<\|vision_pad\|>",
	"<\|image_pad\|>",
	"<\|video_pad\|>"
	],
	"image_token": "<\|image_pad\|>",
	"is_local": true,
	"local_files_only": false,
	"merges_file": null,
	"model_max_length": 262144,
	"model_specific_special_tokens": {
	"audio_bos_token": "<\|audio_start\|>",
	"audio_eos_token": "<\|audio_end\|>",
	"audio_token": "<\|audio_pad\|>",
	"image_token": "<\|image_pad\|>",
	"video_token": "<\|video_pad\|>",
	"vision_bos_token": "<\|vision_start\|>",
	"vision_eos_token": "<\|vision_end\|>"
	},
	"pad_token": "<\|endoftext\|>",
	"pretokenize_regex": "(?i:'s\|'t\|'re\|'ve\|'m\|'ll\|'d)\|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+\|\\p{N}\| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]\|\\s[\\r\\n]+\|\\s+(?!\\S)\|\\s+",
	"split_special_tokens": false,
	"tokenizer_class": "Qwen3_5Tokenizer",
	"unk_token": null,
	"video_token": "<\|video_pad\|>",
	"vision_bos_token": "<\|vision_start\|>",
	"vision_eos_token": "<\|vision_end\|>"
	}