betterwithage commited on
Commit
64b8faf
·
verified ·
1 Parent(s): 9fc2f7b

docs: publish KHIPU-R2 card from szl-forge@72544fd0be1c8a312660c57d8460648c87df2d47

Browse files

Exact-source KHIPU-R2 card publication. The measured 3/6 abstention result remains explicitly not a pass; publication_eligible and autonomy_eligible remain false. No weights, adapter, configs, evals, visibility, hardware, or runtime state changed.

Files changed (2) hide show
  1. README.md +84 -92
  2. szl-source-binding.json +3 -3
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- thumbnail: https://huggingface.co/SZLHOLDINGS/KHIPU-R2/resolve/main/og-card.png
3
  license: apache-2.0
4
  language:
5
  - en
@@ -32,113 +32,105 @@ szl:
32
  gpu: UNAVAILABLE
33
  ---
34
 
35
- <p align="center">
36
- <img src="holo-banner.svg" alt="KHIPU-R2 — holographic step-up banner" width="100%"/>
37
- </p>
38
 
39
- <h1 align="center">K H I P U — R 2</h1>
40
 
41
- <p align="center"><em>Failure is an artifact, not a footnote.</em></p>
 
 
 
42
 
43
- <p align="center">
44
- <img alt="Base: Qwen2.5-1.5B-Instruct" src="https://img.shields.io/badge/base-Qwen2.5--1.5B--Instruct-334155?style=flat-square"/>
45
- <img alt="Downloads" src="https://img.shields.io/huggingface/dt/SZLHOLDINGS/KHIPU-R2?style=flat-square&color=3af4c8&label=downloads"/>
46
- <img alt="Artifact: QLoRA adapter r=32 a=64" src="https://img.shields.io/badge/artifact-QLoRA%20adapter%20r32%20a64-0d9488?style=flat-square"/>
47
- <img alt="Abstain: MEASURED 3/6, was 2/6 — not a pass" src="https://img.shields.io/badge/abstain-3%2F6%20was%202%2F6%20%C2%B7%20not%20a%20pass-b45309?style=flat-square"/>
48
- <img alt="Plan-valid 11/11" src="https://img.shields.io/badge/plan--valid-11%2F11-16a34a?style=flat-square"/>
49
- <img alt="Hallucinated citations: 0" src="https://img.shields.io/badge/hallucinated%20citations-0-16a34a?style=flat-square"/>
50
- <img alt="Lifecycle: research-only" src="https://img.shields.io/badge/lifecycle-research--only-7e8aa3?style=flat-square"/>
51
- </p>
52
 
53
- <p align="center">
54
- <code>KANCHAY</code> · Doctrine v11 · Lean <code>749/14/163</code> · Λ = Conjecture 1 (advisory) · <a href="https://a-11-oy.com">a-11-oy.com</a>
55
- </p>
56
 
57
- Adapters are on this repo. Abstain is MEASURED 3/6, not a pass. This card-only release does not modify adapter files and does not open the publication or autonomy gates.
58
-
59
- QLoRA adapter on disclosed [`Qwen/Qwen2.5-1.5B-Instruct`](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct) (runtime `unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit`). Proposal-only brain navigator / abstain retrain. Doctrine v11 LOCKED. Λ = Conjecture 1 (advisory, never a theorem).
60
-
61
- <!-- SZL-ATELIER-CUT:v1:START -->
62
- ## The cut
63
-
64
- Leaders ship v1 and changelog the rest. We name the retraining of silence as its own model. Failure is an artifact, not a footnote.
65
-
66
- A public retrain whose only job is to improve one metric: honest abstain under adversarial handles.
67
-
68
- ### Silhouette → leave → SZL
69
-
70
- | Leader | Take, then tweak |
71
- |---|---|
72
- | Anthropic | Red-team → constitution update. We red-team → adapter. |
73
- | NVIDIA | Recipe re-run with a new seed and a bounded delta. |
74
- | Unsloth | Same FastLanguageModel loop, new curriculum, new evidence record. |
75
-
76
- This card makes the combination inspectable: a separate abstain-retraining SKU, bounded small-sample results, and an exact-source documentation publisher that cannot modify weights or promotion state.
77
-
78
- ## Intended use
79
-
80
- Continue the abstain-retrain loop. Keep publication and autonomy gates closed until independently verifiable evaluation evidence satisfies the governed release criteria.
81
-
82
- ## Limitations
83
-
84
- - research-only
85
- - No signed R2 eval receipt in this atelier.
86
- - Publishing this card is a documentation update, not model promotion or autonomy approval.
87
-
88
- Canonical GitHub: [`szl-holdings/szl-forge/khipu_r2`](https://github.com/szl-holdings/szl-forge/tree/main/khipu_r2)
89
- <!-- SZL-ATELIER-CUT:v1:END -->
90
-
91
- ## Specification
92
-
93
- | | |
94
- |---|---|
95
- | **Artifact** | `adapter_model.safetensors` (147.8M) + `adapter_config.json` **AVAILABLE** |
96
- | **Job** | [`6a91bf11984507d9db4ea104`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf11984507d9db4ea104) **COMPLETED** |
97
- | **Does NOT overwrite** | signed [`SZL-Khipu-1.5B`](https://huggingface.co/SZLHOLDINGS/SZL-Khipu-1.5B) |
98
- | **Prior job** | [`6a91ba2c`](https://huggingface.co/jobs/SZLHOLDINGS/6a91ba2c45686a1580c12020) **ERROR** Trackio 404 |
99
- | **Card publication** | Exact-source README + local SVG + source binding only; weights, adapter, configs, evals, visibility, hardware, and runtime unchanged |
100
- | **Lab** | Forbidden. Pin stays Khipu GGUF. GPU **UNAVAILABLE**. |
101
- | **License** | Apache-2.0 |
102
- | **Autonomy** | false |
103
-
104
- ## Evaluation (MEASURED this job)
105
-
106
- Method: in-process Unsloth generate, scoring ported from `eval_khipu.py`, temperature 0, held-out never in gradients. Host job worker. Date 2026-08-28 17:20 UTC. File: `eval_measured.json`.
107
-
108
- | split | k/n | what-NOT |
109
  |---|---|---|
110
- | plan-valid | **11 / 11** | not a public leaderboard |
111
- | grounding (`eval.jsonl` navigate) | **5 / 5** | n=5 |
112
- | abstain (`adversarial.jsonl`) | **3 / 6** | not 5/5, not 6/6 |
113
- | hallucinated citations | **0** | this job only |
114
 
115
- Prior published original `SZL-Khipu-1.5B` MEASURED abstain was **2/6**. This run is **3/6**. Small n. Do not derive a world-rank score from k/n on n=11.
 
 
116
 
117
- ## Training (MEASURED / REPORTED)
118
 
119
- - Unsloth QLoRA, seed 11, lr 2e-4, LoRA r=32 α=64, 45 epochs
120
- - Train: 15 navigate + 8 abstain rows × oversample 4 (in-memory 32)
121
- - Held-out: 5 + 6, `held_out_in_gradients: false`
122
- - `training_loss` MEASURED `0.017188…` is a train metric, not an eval
123
- - adapter sha256 `e44d53f29f2d443598e06d6c0441557fd3a5010888c7aa97b56ec3c0e050d349`
124
 
125
- ## What this is NOT
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
126
 
127
- - Not a replacement for `SZL-Khipu-1.5B`
128
- - Not Chaski (Qwen3.5 lock)
129
- - Not an autonomous agent
130
- - Not a GGUF. Mini GGUFs exist on [`A11OY-MINI`](https://huggingface.co/SZLHOLDINGS/A11OY-MINI); Mini evals none-this-run; Mini does **not** inherit this 3/6
131
 
132
- ## Load
 
 
133
 
134
- ```python
135
  from peft import PeftModel
136
  from transformers import AutoModelForCausalLM, AutoTokenizer
137
 
138
  base_id = "Qwen/Qwen2.5-1.5B-Instruct"
139
- tok = AutoTokenizer.from_pretrained(base_id)
140
- base = AutoModelForCausalLM.from_pretrained(base_id)
141
- model = PeftModel.from_pretrained(base, "SZLHOLDINGS/KHIPU-R2")
 
 
142
  ```
143
 
144
- Owner: Stephen Lutar / SZL Holdings.
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ thumbnail: https://huggingface.co/SZLHOLDINGS/KHIPU-R2/resolve/9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52/og-card.png
3
  license: apache-2.0
4
  language:
5
  - en
 
32
  gpu: UNAVAILABLE
33
  ---
34
 
35
+ # KHIPU-R2
 
 
36
 
37
+ **Research-only · historical abstention 3/6 · publication and autonomy gates closed**
38
 
39
+ Adapters are on this repo. Abstain is MEASURED 3/6, not a pass.
40
+ That statement describes the dated owner-run records below, rather than
41
+ a new evaluation or current model qualification. This is a separate
42
+ abstention-retraining SKU. Not a replacement for `SZL-Khipu-1.5B`.
43
 
44
+ Card and metadata review snapshot: [9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52](https://huggingface.co/SZLHOLDINGS/KHIPU-R2/tree/9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52).
45
+ No weights were downloaded, no model was loaded, and no evaluation or
46
+ signature verification was rerun in this review.
 
 
 
 
 
 
47
 
48
+ ## Distributed forms
 
 
49
 
50
+ | Form | Files | Scope |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
51
  |---|---|---|
52
+ | QLoRA adapter | `adapter_model.safetensors`, `adapter_config.json` | The PEFT example below explicitly selects this adapter form. |
53
+ | Separate fp32 merged checkpoint | Root `model.safetensors`, `config.json`, `merge_receipt.json` | A distinct runtime form; selecting the adapter does not load this merged checkpoint. |
 
 
54
 
55
+ Current artifact bytes and their equality to historical evaluated bytes
56
+ were not independently rehashed. The merge receipt's base revision is
57
+ `main@merge-time`, which is not an immutable base identity.
58
 
59
+ ## Dated evaluation records
60
 
61
+ The [2026-08-28 owner-run job record](https://huggingface.co/SZLHOLDINGS/KHIPU-R2/blob/9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52/eval_measured.json)
62
+ reports in-process Unsloth generation at temperature 0 with scoring ported
63
+ from `eval_khipu.py`. It reports `held_out_in_gradients: false`.
 
 
64
 
65
+ | Metric | Historical result | Limit |
66
+ |---|---|---|
67
+ | plan-valid | **11 / 11** | Small owner-run synthetic protocol |
68
+ | grounding (`eval.jsonl` navigate) | **5 / 5** | Five navigation cases |
69
+ | abstain (`adversarial.jsonl`) | **3 / 6** | Visible release blocker; not a pass |
70
+ | hallucinated citations | **0** | These cases only |
71
+
72
+ The [2026-09-13 corrected-harness CPU re-verification](https://huggingface.co/SZLHOLDINGS/KHIPU-R2/blob/9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52/eval_verified_2026-09-13.json)
73
+ reports **11/11 plan-valid, 5/5 grounding, and 3/6 abstention** on rebuilt
74
+ fp16 merges and the published fp32 merge. The owner fixed a decoding
75
+ harness that returned prompt characters instead of generated output;
76
+ **all prior fp16 scores produced by that buggy harness are void**.
77
+ The corrected runs are separate owner records and do not promote the model.
78
+
79
+ No signed R2 eval receipt in this atelier. The linked owner-run records
80
+ are not an independent evaluation or public leaderboard. GPU **UNAVAILABLE**
81
+ describes the CPU-only re-verification record and the earlier card state;
82
+ no current hardware availability was tested. Publication and autonomy
83
+ eligibility remain **false**.
84
+
85
+ The original Khipu **2/6** abstention record and R2's **3/6** record remain
86
+ separate. No broad quality score or general safety guarantee follows.
87
+
88
+ ## Historical training
89
+
90
+ The prior card and [training receipt](https://huggingface.co/SZLHOLDINGS/KHIPU-R2/blob/9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52/training_receipt.json)
91
+ describe QLoRA r=32, α=64, seed 11, learning rate 2e-4 and 45 epochs,
92
+ on 15 navigation rows plus 8 abstention rows oversampled four times.
93
+ The reported train loss **0.017188…** is a training metric, not evaluation.
94
+ The historical adapter digest is
95
+ `e44d53f29f2d443598e06d6c0441557fd3a5010888c7aa97b56ec3c0e050d349`;
96
+ it was not recomputed here. The earlier card records successful job
97
+ `6a91bf11984507d9db4ea104` and prior error `6a91ba2c45686a1580c12020`
98
+ (Trackio 404). This review did not query those jobs or rerun training.
99
+
100
+ ## Adapter usage
101
+
102
+ This example is **untested in this review**. An owner-verified immutable
103
+ base revision is required; none is invented here. The blank base revision
104
+ fails before imports or remote loading. The adapter repository is pinned
105
+ to the reviewed documentation and metadata snapshot; this is not an
106
+ evaluation binding or release approval.
107
 
108
+ ```python
109
+ import re
 
 
110
 
111
+ BASE_REVISION = "" # Supply an owner-verified immutable base commit.
112
+ if not re.fullmatch(r"[0-9a-f]{40}", BASE_REVISION):
113
+ raise ValueError("An owner-verified immutable base revision is required")
114
 
 
115
  from peft import PeftModel
116
  from transformers import AutoModelForCausalLM, AutoTokenizer
117
 
118
  base_id = "Qwen/Qwen2.5-1.5B-Instruct"
119
+ adapter_id = "SZLHOLDINGS/KHIPU-R2"
120
+ adapter_revision = "9fc2f7bebeaf4b3d6d26f7a2a1788a27f8c9ed52"
121
+ tok = AutoTokenizer.from_pretrained(base_id, revision=BASE_REVISION)
122
+ base = AutoModelForCausalLM.from_pretrained(base_id, revision=BASE_REVISION)
123
+ model = PeftModel.from_pretrained(base, adapter_id, revision=adapter_revision)
124
  ```
125
 
126
+ Outputs are proposals requiring external validation and approval. Lab load
127
+ remains forbidden. [A11OY-MINI](https://huggingface.co/SZLHOLDINGS/A11OY-MINI)
128
+ contains separately scoped legacy and R2 evidence and inherits no KHIPU-R2
129
+ score or qualification.
130
+
131
+ Apache-2.0 is declared in metadata. No standalone `LICENSE` is listed at
132
+ the reviewed revision; artifact license coverage was not independently
133
+ verified. A license addition requires source-owner review of that coverage.
134
+
135
+ Canonical card authoring source: [khipu-r2/card/README.md](https://github.com/szl-holdings/szl-forge/blob/6f4ac90ff503265cec9c0436587f086e52d6124e/khipu-r2/card/README.md).
136
+ Doctrine v11 LOCKED 749/14/163. Λ = Conjecture 1, advisory, never a theorem.
szl-source-binding.json CHANGED
@@ -18,8 +18,8 @@
18
  "source": {
19
  "assets": {
20
  "README.md": {
21
- "bytes": 6292,
22
- "sha256": "cbd25e918a0e955a49440fcdddddb0ccbe94eb996ccfd2eb97a1815d3930a85e"
23
  },
24
  "holo-banner.svg": {
25
  "bytes": 1516,
@@ -27,7 +27,7 @@
27
  }
28
  },
29
  "repository": "szl-holdings/szl-forge",
30
- "revision": "a2480040b37e0ee2cc036eda175ccd096aefb93f"
31
  },
32
  "target": {
33
  "controlled_paths": [
 
18
  "source": {
19
  "assets": {
20
  "README.md": {
21
+ "bytes": 6157,
22
+ "sha256": "2d65c2346bfefbad4dd843c334624935ee3fd5fbd28844fa09e8dbf9c7a4da50"
23
  },
24
  "holo-banner.svg": {
25
  "bytes": 1516,
 
27
  }
28
  },
29
  "repository": "szl-holdings/szl-forge",
30
+ "revision": "72544fd0be1c8a312660c57d8460648c87df2d47"
31
  },
32
  "target": {
33
  "controlled_paths": [