README.md

---
thumbnail: https://huggingface.co/SZLHOLDINGS/KHIPU-R2/resolve/main/og-card.png
license: apache-2.0
language:
  - en
base_model: Qwen/Qwen2.5-1.5B-Instruct
base_model_relation: adapter
library_name: peft
pipeline_tag: text-generation
tags:
  - qlora
  - peft
  - governed-agent
  - proposal-only
  - research-only
  - szl-holdings
  - khipu
  - abstain-retrain
szl:
  doctrine: v11-LOCKED
  lean: "749/14/163"
  lambda: "Conjecture 1 — advisory, never a theorem"
  artifact_class: ADAPTER
  publication_eligible: false
  autonomy_eligible: false
  never_overwrite: SZLHOLDINGS/SZL-Khipu-1.5B
  jobs: COMPLETED
  job_id: "6a91bf11984507d9db4ea104"
  job_prior_error: "6a91ba2c45686a1580c12020"
  weights: AVAILABLE
  evals: MEASURED
  gpu: UNAVAILABLE
---

# KHIPU-R2

<p align="center">
  <img src="og-card.png" alt="KHIPU-R2" width="100%"/>
</p>

`KANCHAY` · Doctrine v11 · Lean `749/14/163` · Λ = Conjecture 1 (advisory) · [a-11-oy.com](https://a-11-oy.com)


Adapters are on this repo. Abstain is MEASURED 3/6, not a pass. Not publication-eligible.

QLoRA adapter on disclosed [`Qwen/Qwen2.5-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) (runtime `unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit`). Proposal-only brain navigator / abstain retrain. Doctrine v11 LOCKED. Λ = Conjecture 1 (advisory, never a theorem).



<!-- SZL-ATELIER-CUT:v1:START -->
## The cut

Leaders ship v1 and changelog the rest. We name the retraining of silence as its own model. Failure is an artifact, not a footnote.

A public retrain whose only job is to improve one metric: honest abstain under adversarial handles.

### Silhouette → leave → SZL

| Leader | Take, then tweak |
|---|---|
| Anthropic | Red-team → constitution update. We red-team → adapter. |
| NVIDIA | Recipe re-run with a new seed and a signed delta. |
| Unsloth | Same FastLanguageModel loop, new curriculum, new receipt. |

Nobody else ships this combination. That is the point of a one-of-one.

## Intended use

Continue the abstain-retrain loop. Fail closed until the receipt lands.

## Limitations

- research-only
- No signed R2 eval receipt in this atelier.

Canonical GitHub: [`szl-holdings/szl-forge`](https://github.com/szl-holdings/szl-forge/blob/main/khipu/)
<!-- SZL-ATELIER-CUT:v1:END -->

| | |
|---|---|
| **Artifact** | `adapter_model.safetensors` (147.8M) + `adapter_config.json` **AVAILABLE** |
| **Job** | [`6a91bf11984507d9db4ea104`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf11984507d9db4ea104) **COMPLETED** |
| **Does NOT overwrite** | signed [`SZL-Khipu-1.5B`](https://huggingface.co/SZLHOLDINGS/SZL-Khipu-1.5B) |
| **Prior job** | [`6a91ba2c`](https://huggingface.co/jobs/SZLHOLDINGS/6a91ba2c45686a1580c12020) **ERROR** Trackio 404 |
| **Lab** | Forbidden. Pin stays Khipu GGUF. GPU **UNAVAILABLE**. |
| **License** | Apache-2.0 |
| **Autonomy** | false |

## Evaluation (MEASURED this job)

Method: in-process Unsloth generate, scoring ported from `eval_khipu.py`, temperature 0, held-out never in gradients. Host job worker. Date 2026-08-28 17:20 UTC. File: `eval_measured.json`.

| split | k/n | what-NOT |
|---|---|---|
| plan-valid | **11 / 11** | not a public leaderboard |
| grounding (`eval.jsonl` navigate) | **5 / 5** | n=5 |
| abstain (`adversarial.jsonl`) | **3 / 6** | not 5/5, not 6/6 |
| hallucinated citations | **0** | this job only |

Prior published original `SZL-Khipu-1.5B` MEASURED abstain was **2/6**. This run is **3/6**. Small n. Do not derive a world-rank score from k/n on n=11.

## Training (MEASURED / REPORTED)

- Unsloth QLoRA, seed 11, lr 2e-4, LoRA r=32 α=64, 45 epochs
- Train: 15 navigate + 8 abstain rows × oversample 4 (in-memory 32)
- Held-out: 5 + 6, `held_out_in_gradients: false`
- `training_loss` MEASURED `0.017188…` is a train metric, not an eval
- adapter sha256 `e44d53f29f2d443598e06d6c0441557fd3a5010888c7aa97b56ec3c0e050d349`

## What this is NOT

- Not a replacement for `SZL-Khipu-1.5B`
- Not Chaski (Qwen3.5 lock)
- Not an autonomous agent
- Not a GGUF. Mini GGUFs exist on [`A11OY-MINI`](https://huggingface.co/SZLHOLDINGS/A11OY-MINI); Mini evals none-this-run; Mini does **not** inherit this 3/6

## Load

```python
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base_id = "Qwen/Qwen2.5-1.5B-Instruct"
tok = AutoTokenizer.from_pretrained(base_id)
base = AutoModelForCausalLM.from_pretrained(base_id)
model = PeftModel.from_pretrained(base, "SZLHOLDINGS/KHIPU-R2")
```

Owner: Stephen Lutar / SZL Holdings.