Text Generation
Transformers
Safetensors
English
qwen3_5
image-text-to-text
szl-holdings
series-a
doctrine-v11
governed-ai
proposal-only
conversational
Instructions to use SZLHOLDINGS/chaski with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SZLHOLDINGS/chaski with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SZLHOLDINGS/chaski") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("SZLHOLDINGS/chaski") model = AutoModelForMultimodalLM.from_pretrained("SZLHOLDINGS/chaski", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SZLHOLDINGS/chaski with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SZLHOLDINGS/chaski" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SZLHOLDINGS/chaski
- SGLang
How to use SZLHOLDINGS/chaski with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/chaski" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/chaski" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use SZLHOLDINGS/chaski with Docker Model Runner:
docker model run hf.co/SZLHOLDINGS/chaski
File size: 6,551 Bytes
235d8e9 6f021ec e3bcf6f 552517c e3f2384 552517c e3bcf6f 235d8e9 e3bcf6f 552517c e3bcf6f 552517c e3bcf6f 552517c e3bcf6f d406eef 9943a51 d406eef 9943a51 d406eef cca047a 552517c 6f021ec 552517c 235d8e9 552517c 235d8e9 6f021ec d406eef 552517c 235d8e9 50b4514 e3bcf6f c7e8368 d406eef 552517c c7e8368 552517c c7e8368 d406eef cca047a 9943a51 552517c d406eef 9943a51 552517c 235d8e9 c7e8368 d406eef 9943a51 c7e8368 552517c 235d8e9 d406eef 9943a51 cca047a 9943a51 bef153f 552517c 235d8e9 552517c c7e8368 552517c 235d8e9 552517c 235d8e9 552517c d406eef | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 | ---
thumbnail: https://huggingface.co/SZLHOLDINGS/chaski/resolve/main/og-card.png
license: apache-2.0
language:
- en
pipeline_tag: text-generation
library_name: transformers
base_model: Qwen/Qwen3.5-0.8B
base_model_relation: adapter
tags:
- szl-holdings
- series-a
- doctrine-v11
- governed-ai
- proposal-only
szl:
doctrine: v11-LOCKED
lean: "749/14/163"
lambda: "Conjecture 1 — advisory, never a theorem"
evidence_ceiling: 0.97
artifact_class: ADAPTER
originality: FINETUNE_DISCLOSED_BASE
collection: "SZL Fall 2026 — Original Cuts"
jobs: COMPLETED
job_id: 6a91bf1045686a1580c12105
job_namespace: SZLHOLDINGS
weights: AVAILABLE
evals: MEASURED
named_n:
revision: 1c55df8652e9d0f7b84356b1e2d54849165ae884
date: "2026-08-28"
json_draft: "0/5"
adversarial_refusal: "2/6"
label: MEASURED
gate: fail
report: eval_report.json
report_sha256: 4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05
report_bytes: 3996
report_commit: db71c243d0176bccff1ff087cd4dd57663bd6502
method: "in-process greedy generate, messages[:-1], transformers 5.16.1 bf16 CPU, load_in_4bit=False; live Chaski merged shard 1c55df8; PR 63 gates"
publication_eligible: false
gpu: UNAVAILABLE
job_prior_error: 6a91bb7c984507d9db4ea0a4
job_completed_no_weights: 6a91ba00984507d9db4ea07f
job_prior_failed:
- 6a91b8ba984507d9db4ea071
- 6a91b990984507d9db4ea077
- 6a91bb7c984507d9db4ea0a4
---
# Chaski
<p align="center">
<img src="og-card.png" alt="Chaski" width="100%"/>
</p>
`KANCHAY` · Doctrine v11 · Lean `749/14/163` · Λ = Conjecture 1 (advisory) · [a-11-oy.com](https://a-11-oy.com)
Adapters are on this repo. Named-N evals MEASURED json_draft 0/5, adversarial_refusal 2/6, not a pass. Not publication-eligible.
**One line.** Messenger LLM. Proposal-only drafts and honest refusals for the SZL controller.
<!-- SZL-ATELIER-CUT:v1:START -->
## The cut
Multimodal models narrate what they see. Chaski may only carry a payload the controller already signed. Vision without authorship.
A courier that cannot invent the dispatch. The oldest job in the Andes, as a LoRA.
### Silhouette → leave → SZL
| Leader | Take, then tweak |
|---|---|
| Anthropic | Claude vision, minus the right to conclude. |
| NVIDIA | NVLM / NeMo multimodal, minus the right to act. |
| Unsloth | Adapter on Qwen3.5-0.8B. |
Nobody else ships this combination. That is the point of a one-of-one.
## Intended use
Carry signed payloads across organs.
## Limitations
- proposal-only
- Do not treat as a VLM product card without a signed vision eval.
Canonical GitHub: [`szl-holdings/szl-forge`](https://github.com/szl-holdings/szl-forge/blob/main/chaski/)
<!-- SZL-ATELIER-CUT:v1:END -->
| | |
|---|---|
| **Artifact** | `adapter_model.safetensors` + merged ~1.7GB shard **AVAILABLE** |
| **Parent / eval revision** | `1c55df8652e9d0f7b84356b1e2d54849165ae884` |
| **Originality** | SZL fine-tune of a disclosed Apache Qwen instruct base |
| **Base** | `Qwen/Qwen3.5-0.8B` (Apache-2.0, 0.6B–2B lock). Not an Unsloth-default card. |
| **License** | `apache-2.0` |
| **HF Jobs** | Attempt 5 **COMPLETED** [`6a91bf1045686a1580c12105`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf1045686a1580c12105) (`report_to=none`). Tensors on Hub. |
| **Named-N** | MEASURED fail. `json_draft` **0/5**. `adversarial_refusal` **2/6**. Not a pass. |
| **Receipt** | `eval_report.json` 3996 bytes sha256 `4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05` (commit `db71c24`) |
| **Method** | in-process greedy generate, `messages[:-1]`, transformers 5.16.1 bf16 CPU, `load_in_4bit=False`. Date 2026-08-28. File `eval_report.json`. PR 63. |
| **Quality** | ROADMAP (prose). Failed gate is not a publish. |
| **Status** | CUTTING |
| **Lab** | House CPU lab stays **Khipu GGUF**. Lab load forbidden for Chaski. |
| **Later SKU** | [`A11OY-MINI`](https://huggingface.co/SZLHOLDINGS/A11OY-MINI) GGUFs exist on that repo. They do **not** inherit this Named-N. Mini stays evals none-this-run. |
| **Sibling** | [`szl-receiptagent-qwen35-0.8b-v2`](https://huggingface.co/SZLHOLDINGS/szl-receiptagent-qwen35-0.8b-v2) |
> **Fashion rule.** Silhouette from Qwen3 / Qwen3.5 instruct. Cut is original SZL. We do not republish someone else's tensors.
## Intended use
- **Who:** a11oy / Alloy controller, not an end-user chatbot
- **What:** JSON drafts (`decision=DRAFT`, `approvalRequired=true`, `executed=false`) and doctrine-faithful UNKNOWN
- **Where:** behind a validating controller. The weights propose. The controller gates.
## What it is NOT
- Not an autonomous agent, executor, factual oracle, or weapon.
- Not a Qwen rehost.
- Not the live lab model. Not a tokens/s claim.
- Not publication-eligible on this MEASURED run.
- Not a 5/5 or 6/6. Do not read 2/6 as a pass.
## Evaluation
**Named-N MEASURED fail** on live Chaski `1c55df8` (2026-08-28). Receipt: [`eval_report.json`](https://huggingface.co/SZLHOLDINGS/chaski/blob/main/eval_report.json) sha256 `4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05`.
| Probe | N | Score | Label |
|---|---|---|---|
| `json_draft` | 5 | **0/5** | MEASURED fail |
| `adversarial_refusal` | 6 | **2/6** | MEASURED fail |
Method: in-process greedy generate, `messages[:-1]`, transformers 5.16.1 bf16 CPU, `load_in_4bit=False` on live Chaski `1c55df8` (2026-08-28). File: `eval_report.json`. PR 63. What this is NOT: a passing eval gate, a published score, an A11OY-MINI eval, or a 5/5. `publication_eligible: false`.
`train_loss` MEASURED `1.783925924450159` is a train metric, not an eval.
## Training
- **Recipe:** Unsloth QLoRA SFT. Script: `train_chaski.py`. Loads **only** `szl_dataset.jsonl`.
- **1–2 FAILED:** `6a91b8ba984507d9db4ea071` CastError; `6a91b990984507d9db4ea077` pyyaml 30s timeout.
- **3 COMPLETED receipt-only:** [`6a91ba00984507d9db4ea07f`](https://huggingface.co/jobs/SZLHOLDINGS/6a91ba00984507d9db4ea07f).
- **4 ERROR, not RUNNING:** [`6a91bb7c984507d9db4ea0a4`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bb7c984507d9db4ea0a4) Trackio 404. Files persisted.
- **5 COMPLETED `report_to=none`:** [`6a91bf1045686a1580c12105`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf1045686a1580c12105). Tensors now on Hub.
- **Trackio:** 404 `betterwithage/trackio-bucket`. No dashboard URL.
- **publication_eligible:** false
## Limitations
- Narrow curriculum. Controller required. Λ = Conjecture 1. Trust ceiling 0.97. CUTTING.
- This MEASURED run failed Named-N. Do not ship as a pass.
|