Instructions to use SZLHOLDINGS/A11OY-MINI with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use SZLHOLDINGS/A11OY-MINI with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SZLHOLDINGS/A11OY-MINI:F16
# Run inference directly in the terminal:
llama cli -hf SZLHOLDINGS/A11OY-MINI:F16

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf SZLHOLDINGS/A11OY-MINI:F16
# Run inference directly in the terminal:
llama cli -hf SZLHOLDINGS/A11OY-MINI:F16

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf SZLHOLDINGS/A11OY-MINI:F16
# Run inference directly in the terminal:
./llama-cli -hf SZLHOLDINGS/A11OY-MINI:F16

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf SZLHOLDINGS/A11OY-MINI:F16
# Run inference directly in the terminal:
./build/bin/llama-cli -hf SZLHOLDINGS/A11OY-MINI:F16

Use Docker

docker model run hf.co/SZLHOLDINGS/A11OY-MINI:F16

LM Studio
Jan

vLLM

How to use SZLHOLDINGS/A11OY-MINI with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SZLHOLDINGS/A11OY-MINI"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SZLHOLDINGS/A11OY-MINI",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/SZLHOLDINGS/A11OY-MINI:F16

Ollama
How to use SZLHOLDINGS/A11OY-MINI with Ollama:
```
ollama run hf.co/SZLHOLDINGS/A11OY-MINI:F16
```
Unsloth Desktop

How to use SZLHOLDINGS/A11OY-MINI with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf SZLHOLDINGS/A11OY-MINI:F16

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "SZLHOLDINGS/A11OY-MINI:F16"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use SZLHOLDINGS/A11OY-MINI with Docker Model Runner:
```
docker model run hf.co/SZLHOLDINGS/A11OY-MINI:F16
```

Lemonade

How to use SZLHOLDINGS/A11OY-MINI with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull SZLHOLDINGS/A11OY-MINI:F16

Run and chat with the model

lemonade run user.A11OY-MINI-F16

List all available models

lemonade list

Hermes Agent

How to use SZLHOLDINGS/A11OY-MINI with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf SZLHOLDINGS/A11OY-MINI:F16

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default SZLHOLDINGS/A11OY-MINI:F16

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use SZLHOLDINGS/A11OY-MINI with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf SZLHOLDINGS/A11OY-MINI:F16

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "SZLHOLDINGS/A11OY-MINI:F16" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

A11OY-MINI / conversion_receipt.json

betterwithage

Add conversion_receipt.json (live Chaski GGUF SKU, publication_eligible false)

160eaf6 verified 4 days ago

Raw

History Blame Contribute Delete

2.22 kB

	{
	"kind": "szl-a11oy-mini-conversion-receipt",
	"schema": "szl.gguf-conversion-run/v1",
	"artifact": "SZLHOLDINGS/A11OY-MINI",
	"parent": "SZLHOLDINGS/chaski",
	"forbidden_parent": "SZLHOLDINGS/chaski-5050",
	"parent_artifact": "merged-shard",
	"parent_merged_shard": "model.safetensors-00001-of-00001.safetensors",
	"parent_hub_sha": "1c55df8652e9d0f7b84356b1e2d54849165ae884",
	"base_model": "Qwen/Qwen3.5-0.8B",
	"silhouette": "Qwen3.5 instruct",
	"cut": "live SZL Chaski",
	"sku_class": "GGUF_SKU_OF_LIVE_CHASKI",
	"third_llm": false,
	"new_train": false,
	"seed": 11,
	"doctrine": "v11 LOCKED 749/14/163",
	"lambda": "Conjecture 1",
	"proposal_only": true,
	"publication_eligible": false,
	"autonomy_eligible": false,
	"evals": "none-this-run",
	"quality": "ROADMAP",
	"card_status": "ROADMAP",
	"bytes_measured": true,
	"gguf_exists": true,
	"base_model_relation_quantized": false,
	"hub_put": false,
	"khipu_lab_pin": false,
	"inference_lab_pin": false,
	"khipu_lab": "SZLHOLDINGS/szl-model-inference-lab",
	"khipu_gguf": "SZLHOLDINGS/SZL-Khipu-1.5B-GGUF",
	"tok_s_claim": false,
	"direct_safetensors_ollama": "BANNED",
	"convert_path": [
	"llama.cpp convert_hf_to_gguf.py --outtype f16",
	"llama-quantize Q4_K_M"
	],
	"llama_cpp_commit": "6fe74980162af0ed5e559870d5deccafaa034e7c",
	"merged_dir": "/workspace/chaski-live-merge",
	"parent_shard_bytes": 1746942600,
	"f16": {
	"path": "/workspace/a11oy_mini/a11oy-mini-f16.gguf",
	"bytes": 1557662240,
	"sha256": "a5df00e4e3ca07f65a4b43aad4ef1505625952a3105e6dcc0dba87f2fa35fc57",
	"label": "MEASURED"
	},
	"q4_k_m": {
	"path": "/workspace/a11oy_mini/a11oy-mini-q4_k_m.gguf",
	"bytes": 541903392,
	"sha256": "06136ba385b2e052cf4cdb3dc8d333948e0b612bd15a541b314e170399c2faa6",
	"label": "MEASURED"
	},
	"claim_boundary": "A11OY-MINI is a later GGUF SKU of live SZLHOLDINGS/chaski, not a new train and not chaski-5050. Evals inherit none-this-run. publication_eligible false. Quality ROADMAP. Bytes are MEASURED only when a local .gguf hash is written. No Hub PUT from this checkout. Lab stays Khipu. No tok/s.",
	"computed_at": "2026-08-28T18:46:49.646536+00:00",
	"source": "local-convert"
	}