Instructions to use hodza/BlackBox-Coder-3B-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use hodza/BlackBox-Coder-3B-GGUF with llama-cpp-python:

# !pip install llama-cpp-python

from llama_cpp import Llama

llm = Llama.from_pretrained(
	repo_id="hodza/BlackBox-Coder-3B-GGUF",
	filename="BlackBox-Coder-3B-F32.gguf",
)

llm.create_chat_completion(
	messages = "No input example has been defined for this model task."
)

Notebooks
Google Colab
Kaggle
Local Apps

llama.cpp

How to use hodza/BlackBox-Coder-3B-GGUF with llama.cpp:

Install from brew

brew install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32
# Run inference directly in the terminal:
llama-cli -hf hodza/BlackBox-Coder-3B-GGUF:F32

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32
# Run inference directly in the terminal:
llama-cli -hf hodza/BlackBox-Coder-3B-GGUF:F32

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32
# Run inference directly in the terminal:
./llama-cli -hf hodza/BlackBox-Coder-3B-GGUF:F32

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32
# Run inference directly in the terminal:
./build/bin/llama-cli -hf hodza/BlackBox-Coder-3B-GGUF:F32

Use Docker

docker model run hf.co/hodza/BlackBox-Coder-3B-GGUF:F32

LM Studio
Jan
Ollama
How to use hodza/BlackBox-Coder-3B-GGUF with Ollama:
```
ollama run hf.co/hodza/BlackBox-Coder-3B-GGUF:F32
```

Unsloth Studio new

How to use hodza/BlackBox-Coder-3B-GGUF with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for hodza/BlackBox-Coder-3B-GGUF to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for hodza/BlackBox-Coder-3B-GGUF to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for hodza/BlackBox-Coder-3B-GGUF to start chatting

Pi new

How to use hodza/BlackBox-Coder-3B-GGUF with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32

Configure the model in Pi

# Install Pi:
npm install -g @mariozechner/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "hodza/BlackBox-Coder-3B-GGUF:F32"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Hermes Agent new

How to use hodza/BlackBox-Coder-3B-GGUF with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama-server -hf hodza/BlackBox-Coder-3B-GGUF:F32

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default hodza/BlackBox-Coder-3B-GGUF:F32

Run Hermes

hermes

Docker Model Runner
How to use hodza/BlackBox-Coder-3B-GGUF with Docker Model Runner:
```
docker model run hf.co/hodza/BlackBox-Coder-3B-GGUF:F32
```

Lemonade

How to use hodza/BlackBox-Coder-3B-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull hodza/BlackBox-Coder-3B-GGUF:F32

Run and chat with the model

lemonade run user.BlackBox-Coder-3B-GGUF-F32

List all available models

lemonade list

BlackBox-Coder-3B-GGUF / Modelfile

hodza

added ollama modelfile

21d1b8d verified over 1 year ago

raw

history blame contribute delete

2.51 kB

	FROM BlackBox-Coder-3B-Q8.gguf

	PARAMETER temperature 0.1
	PARAMETER top_p 0.3
	PARAMETER repetition_penalty = 1.1
	# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
	PARAMETER num_ctx 4096

	# sets a custom system message to specify the behavior of the chat assistant
	SYSTEM """Ты помощник для работы в системе BlackBox с использованием языка Component Pascal. Твоя задача информативно отвечать на вопросы.
	Ответ необходимо предоставить в формате markdown и выделять код символами ```.

	Пример:

	Вопрос: Как реализовать сортировку пузырьком?
	Ответ:

	Cортировку пузырьком можно реализовать с помощью следующего кода:

	```
	PROCEDURE BubbleSort*;
	VAR i, j: INTEGER; x: Item;
	BEGIN
	FOR i := 1 TO n-1 DO
	FOR j := n-1 TO i BY -1 DO
	IF a[j-1] > a[j] THEN
	x := a[j-1]; a[j-1] := a[j]; a[j] := x
	END
	END
	END
	END BubbleSort;
	```
	"""

	LICENSE """
	Copyright 2025 Anton Shelin

	Redistribution and use in source and binary forms, with or without modification, are permitted provided that the following conditions are met:

	1. Redistributions of source code must retain the above copyright notice, this list of conditions and the following disclaimer.

	2. Redistributions in binary form must reproduce the above copyright notice, this list of conditions and the following disclaimer in the documentation and/or other materials provided with the distribution.

	THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS “AS IS” AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
	"""