Instructions to use bynn-intelligence-com/decisionnode-edge-mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use bynn-intelligence-com/decisionnode-edge-mini with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="bynn-intelligence-com/decisionnode-edge-mini")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("bynn-intelligence-com/decisionnode-edge-mini")
model = AutoModelForMultimodalLM.from_pretrained("bynn-intelligence-com/decisionnode-edge-mini", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use bynn-intelligence-com/decisionnode-edge-mini with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0
# Run inference directly in the terminal:
llama cli -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0
# Run inference directly in the terminal:
llama cli -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Use Docker

docker model run hf.co/bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Llama new
LM Studio
Jan

vLLM

How to use bynn-intelligence-com/decisionnode-edge-mini with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "bynn-intelligence-com/decisionnode-edge-mini"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge-mini",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/bynn-intelligence-com/decisionnode-edge-mini:Q8_0

SGLang

How to use bynn-intelligence-com/decisionnode-edge-mini with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "bynn-intelligence-com/decisionnode-edge-mini" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge-mini",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "bynn-intelligence-com/decisionnode-edge-mini" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "bynn-intelligence-com/decisionnode-edge-mini",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Ollama
How to use bynn-intelligence-com/decisionnode-edge-mini with Ollama:
```
ollama run hf.co/bynn-intelligence-com/decisionnode-edge-mini:Q8_0
```
Unsloth Desktop
Docker Model Runner
How to use bynn-intelligence-com/decisionnode-edge-mini with Docker Model Runner:
```
docker model run hf.co/bynn-intelligence-com/decisionnode-edge-mini:Q8_0
```

Lemonade

How to use bynn-intelligence-com/decisionnode-edge-mini with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull bynn-intelligence-com/decisionnode-edge-mini:Q8_0

Run and chat with the model

lemonade run user.decisionnode-edge-mini-Q8_0

List all available models

lemonade list

Atomic Chat

decisionnode-edge-mini

File size: 3,226 Bytes

47dda17
 
 
 
30a6280
4d3d1f8
0e77dfd
47dda17
 
 
0e77dfd
47dda17
 
 
 
 
 
30a6280
47dda17
30a6280
 
47dda17
0e77dfd
30a6280
47dda17
0e77dfd
 
 
 
 
 
47dda17

0d96a4ff68ad6d4b6f1f30f713b18d5184912ba8dd389f86aa7710db079abcb0  ./LICENSE
50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32  ./LICENSE-base
2014f13a6fe1d9178c84cde47bb087a7a74adbe38650f1823a944077081e86d0  ./LICENSING.md
a23ef088ac75a7835adb29e8beecf021dd800ab0de680f0749854ad96d99ab9d  ./NOTICE
40bf67864068e6a0bb796befb96bc5d09714bee0f3e0fb23909f8afd7c0fd10f  ./README.md
c44489690e63adb3abd8c65ede675fadc5714126e3f866cbd292df824880cb77  ./assets/decisionnode-banner.png
09a12dd7588ea0d7db23b289586bdc1ed90164526422518b54cb9fa2681f89ca  ./box_calibration.json
930c4ffef71c486cc2f3f85f034dac6072457f2ce98f24fd12eece88446cf6d6  ./calibration.json
e2bebad8e9bbbb35aee3d61bbdc07be43b0e55345862a2f56ba194775bf77023  ./config.json
bb4a558a59e56c012a925191367764b9b7131c4aeefb18dff286c9a008161b18  ./decisionnode-edge-mini-0.9.1-q8_0.gguf
31bfe14119850f5313fb23d19a138af85b18c48531c30d618a552a7204f2f8f4  ./decisionnode_edge.json
172c8c463cb272eef18eb088b925549eaa27ad0cff5db5d50ae04c2d87d4bc08  ./decisionnode_edge_build.json
e0a87595ad939efa5585b61844d3a2a70d29ba7752f68b8139f2195753a6bfde  ./examples/request.json
427c35402e539c31874952e8b96d68e6a82eb809f8d0d0a5bdc367073348ed8a  ./model.safetensors
27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516  ./preprocessor_config.json
c6b96098f3be79e4fcfd640896831eb8ac5ff6aeb3edd076f6268c000fb3699c  ./readout.safetensors
0d96a4ff68ad6d4b6f1f30f713b18d5184912ba8dd389f86aa7710db079abcb0  ./runtime/LICENSE
06b52d22d46c230f3d6215f370520038c6ccabac5f2c9c224c766a3e5aa8e43a  ./runtime/README.md
e0a87595ad939efa5585b61844d3a2a70d29ba7752f68b8139f2195753a6bfde  ./runtime/examples/request.json
fdab0f52237084c3793475ffa211fafdf5c3fb5973674131587dae0788613780  ./runtime/pyproject.toml
0c067d73ac9a01af3049c980c08f35acd257e4044372fd2066a74db466499a39  ./runtime/src/decisionnode_edge/__init__.py
245003271a41ecab8fe982194acf84f9c4fc0b686762583931a9444ad2aa6354  ./runtime/src/decisionnode_edge/__main__.py
736741c822983f1d7d8ed26ea01227f2f2e902c98dc7d0c21d8fa5abcf219150  ./runtime/src/decisionnode_edge/answers.py
1488cd43642f6bd49b810683b7e72688e98dc62d2e955c202331e027a62b1889  ./runtime/src/decisionnode_edge/backends.py
4ace977690bb7ae16010a298c478f1a5056caaf724c0d696b5ddac6699225f6b  ./runtime/src/decisionnode_edge/build.py
3e2d2198d9fd4fac076773e655a0c73c810a932be07ce99460edee64fb7004bc  ./runtime/src/decisionnode_edge/model.py
3be9ac7eb2807241d0b9b49cb5797049395f7fbca6ddee9a645274edd1c3e4a5  ./runtime/src/decisionnode_edge/places.py
fb1b35692c68ad904d44743f580e2145ff68d14ac7b94267c7c19402f88b2e5f  ./runtime/src/decisionnode_edge/request.py
bc5ebac62720ff5f0317ab757126eb25621af046da94cb7564ec41d482b277f2  ./runtime/src/decisionnode_edge/server.py
969e07b2698c7b746cf7e5c390c8110756053c2a6495a30d84a411d54a9054c6  ./runtime/src/decisionnode_edge/systemone.py
670afbb7b0fcc7f65f1c7d11f868a3daf143c2210eed0d528a27938d24c2327a  ./runtime/src/decisionnode_edge/template.py
6e9f31870a35eb9372bbc8719603e5d02f2e07eff90af9f7b77fe3b17d3628ff  ./tokenizer.json
429721f730f42043159445b48039714682fac2cef2ad0e82917dfa0c8ca5f430  ./tokenizer_config.json
d039cd7d88b3502a99edd455496b75b44ecf7dd3b3669748bafac37e6cecc085  ./video_preprocessor_config.json