Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

DATA_PROVENANCE_DRAFT.md

@@ -0,0 +1,87 @@
+# Kaiju Coder 7 by Kiyomi - Data Provenance Draft
+
+This draft records the current data boundary for release review.
+
+## Policy
+
+Kaiju Coder training data must be legally usable for a commercial derivative model.
+
+Allowed:
+
+- RMDW-authored examples.
+- RMDW-owned repository diffs and documentation.
+- Human-reviewed examples created specifically for Kaiju.
+- Public permissive data only when license review confirms compatibility.
+
+Not allowed:
+
+- Closed-model answers from OpenAI, Anthropic, Gemini, or similar services as supervised completions.
+- Unreviewed customer data.
+- Private customer code without consent.
+- Secrets, tokens, credentials, cookies, or private keys.
+- Unlicensed scraped code.
+
+## v0.1 Dataset Snapshot
+
+- Total reviewed examples: 575
+- Dataset build: `datasets/build/kaiju-sft-v0.1.jsonl`
+- Candidate sources:
+  - `datasets/candidates/rmdw-git-patches.jsonl`
+  - `datasets/candidates/v0.1-safe-git-backlog.jsonl`
+  - `datasets/candidates/v0.1-file-level-git.jsonl`
+  - `datasets/candidates/v0.1-wiki-strategy-business-identity.jsonl`
+
+## v1.7 Business-Owner Suite Addendum
+
+- Date prepared: 2026-06-03
+- Reviewed examples: 8
+- Candidate file: `datasets/candidates/v1.7-rmdw-business-owner-suite.jsonl`
+- Addendum-only SFT build: `datasets/build/kaiju-sft-v1.7-business-owner-suite.jsonl`
+- Training SFT build: `datasets/build/kaiju-sft-v1.7-business-owner-oversampled.jsonl`
+- Training config: `training/configs/qwen36-27b-lora-v1.7.example.json`
+- v1.8 training config: `training/configs/qwen36-27b-lora-v1.8-business-owner.example.json`
+- New task type: `business_suite`
+- Source inventory: `release/SOURCE_INVENTORY.md`, refreshed from GitHub source-of-truth repositories and the requested local RMDW wiki snapshot.
+
+This addendum targets Kiyomi 7.7.7 style business-owner work: complete AI-company build packs, premium service websites, intake and CRM flows, sales follow-up, proposals, ROI dashboards, operator handbooks, and Workshop golden-run automations.
+
+Every row includes:
+
+- `source_repos`
+- `source_paths`
+- `provenance_notes`
+- `reviewed: true`
+- `license: RMDW-owned`
+
+For the v1.7 LoRA run, the 8 reviewed business-owner rows are oversampled 24 times by `scripts/build_v17_business_owner_sft_dataset.py`. Repeated rows receive unique IDs ending in `__v17_business_repeat_NN` and preserve the original source repository, source path, and provenance metadata.
+
+Client-site repositories are used only as eval and generalized pattern sources unless a row is explicitly reviewed for training eligibility. Do not bulk-train on client-specific text, contact details, contracts, or private business data.
+
+The local wiki path `/Users/richardecholsai7/Documents/RMDW-Wiki` is present but is not a git checkout. It is recorded as `RMDW-Wiki-local`, `selective-reference-only`, with `credentials.md`, `customers.md`, `customers/`, and `raw/` excluded. The GitHub `RichardEchols/rmdw-agent-wiki` repo remains the authoritative wiki source for training/eval provenance unless a reviewer documents a local exception.
+
+## Category Mix
+
+The v0.1 category gate passed:
+
+- Website/UI: at least 75 examples
+- Coding: at least 75 examples
+- Debugging: at least 50 examples
+- Automation: at least 50 examples
+- Tool-use: at least 50 examples
+- Strategy: at least 25 examples
+- Business: at least 15 examples
+- Identity: at least 10 examples
+
+## Release Review Checklist
+
+Before public release:
+
+- Re-run dataset validation.
+- Re-run source inventory against the current GitHub source-of-truth SHAs.
+- Spot-check examples for secrets and private data.
+- Confirm client-site rows are generalized pattern examples or eval-only.
+- Confirm closed-model outputs are not used as supervised completions.
+- Record exact base model revision.
+- Attach upstream license and notices.
+- Attach eval summary.
+- Document known limitations and unsafe use boundaries.

EVAL_SCOREBOARD.md

@@ -0,0 +1,70 @@
+# Kaiju Coder 7 Business-Owner Eval Scoreboard
+
+This scoreboard tracks the current release-candidate evidence. Do not publish weights or paid API claims until every required row has a dated result and reviewer.
+
+## Completed Local Gates
+
+| Gate | Command | Result | Date |
+|---|---|---:|---|
+| Source inventory refresh | `python3 scripts/build_source_inventory.py` | Passed | 2026-06-03 |
+| Candidate validation | `python3 scripts/validate_training_data.py --min-examples 350` | 1,689 examples / passed | 2026-06-03 |
+| v1.7 category targets | `python3 scripts/check_dataset_targets.py --targets datasets/v1.7-targets.json` | Passed | 2026-06-03 |
+| Business-owner SFT build | `python3 scripts/build_v17_business_owner_sft_dataset.py` | 1,881 rows / 192 repeats | 2026-06-03 |
+| Router hard harness | `python3 evals/run_router_harness_eval.py --tasks evals/tasks/router-hard-harness.jsonl` | 23/23 | 2026-06-03 |
+| Router static checks | `python3 evals/run_router_static_checks.py runs/evals/20260603T103915Z-kaiju_router_harness/results.jsonl` | 23/23 | 2026-06-03 |
+| Business-suite prompts | Included in router hard harness | 2/2 | 2026-06-03 |
+| Deterministic API harness smoke | `python3 scripts/run_kaiju_api_harness_smoke.py` | Passed: website + business-suite API artifacts | 2026-06-03 |
+| Direct business-suite artifact | `python3 scripts/run_kaiju_router.py --prompt "...Kiyomi 7.7.7 AI company operating pack..." --print-manifest` | 19 files / passed | 2026-06-03 |
+| Full local RC smoke gate | `python3 scripts/run_kaiju_business_owner_rc_smoke.py` | Passed; latest router/static run `20260603T103915Z-kaiju_router_harness` | 2026-06-03 |
+| v1.7 LoRA train | `./scripts/run-gojira-b-qwen36-lora-train.sh` | Finished; runtime `1663.7101s`, train loss `1.7260706673065822`, adapter present | 2026-06-03 |
+| v1.7 SGLang serve | `./scripts/start-qwen36-lora-sglang.sh` with `KAIJU_QWEN36_LORA_CONTEXT=4096`, `KAIJU_QWEN36_LORA_MEM_FRACTION=0.90` | `/v1/models` returned `kaiju_v17_business_owner` | 2026-06-03 |
+| Raw served adapter smoke: website | `python3 evals/run_openai_compat_smoke.py --base-url http://100.109.109.14:18083/v1 --model kaiju_v17_business_owner --tasks evals/tasks/smoke.jsonl --max-tasks 1 --disable-thinking` | Passed; `20260603T031300Z-kaiju_v17_business_owner`, 2,726 chars in 174.49s | 2026-06-03 |
+| Raw served adapter smoke: proposal | `python3 evals/run_openai_compat_smoke.py --base-url http://100.109.109.14:18083/v1 --model kaiju_v17_business_owner --tasks /tmp/kaiju-proposal-smoke.jsonl --system-prompt-file prompts/kaiju-coder-api-system.md --disable-thinking` | Passed; `20260603T032107Z-kaiju_v17_business_owner`, 4,306 chars in 232.27s | 2026-06-03 |
+| Raw served adapter quality: website | `python3 evals/score_quality_gate.py runs/evals/20260603T033825Z-kaiju_v17_business_owner/results.jsonl` | Failed paid-ready: `3.71/4.0`, missing complete HTML after 12,706 chars / 793.96s | 2026-06-03 |
+| Raw served adapter quality: proposal | `python3 evals/score_quality_gate.py runs/evals/20260603T032107Z-kaiju_v17_business_owner/results.jsonl` | Passed paid-ready: `4.0/4.0` | 2026-06-03 |
+| Raw served adapter quality: Jah credits | `python3 evals/score_quality_gate.py runs/evals/20260603T035612Z-kaiju_v17_business_owner/results.jsonl` | Passed paid-ready: `4.0/4.0` | 2026-06-03 |
+| Base Qwen comparison: proposal | `python3 evals/compare_quality_runs.py runs/quality-gates/20260603T035200Z-qwen36-27b/scores.jsonl runs/quality-gates/20260603T032107Z-kaiju_v17_business_owner/scores.jsonl` | Tie: base `4.0/4.0`, Kaiju v1.7 `4.0/4.0` | 2026-06-03 |
+| Base Qwen comparison: Jah credits | `python3 evals/compare_quality_runs.py runs/quality-gates/20260603T040140Z-qwen36-27b/scores.jsonl runs/quality-gates/20260603T035612Z-kaiju_v17_business_owner/scores.jsonl` | Tie: base `4.0/4.0`, Kaiju v1.7 `4.0/4.0`; deterministic outputs were byte-identical | 2026-06-03 |
+| Raw adapter differentiation probe | Identity and Jah probes comparing `qwen36-27b` to `kaiju_v17_business_owner` | Current v1.7 SGLang outputs can be byte-identical to base on deterministic prompts; 24-step v1.7 is too weak as a raw-weight differentiator | 2026-06-03 |
+| v1.8 stronger LoRA train | `KAIJU_LORA_CONFIG=training/configs/qwen36-27b-lora-v1.8-business-owner.example.json KAIJU_SFT_DATASET=datasets/build/kaiju-sft-v1.7-business-owner-oversampled.jsonl KAIJU_LORA_RUN_DIR=runs/qwen36-27b-lora-v1.8-business-owner KAIJU_MIN_TRAIN_EXAMPLES=350 KAIJU_SKIP_DATASET_BUILD=1 KAIJU_TRAIN_BACKGROUND=1 ./scripts/run-gojira-b-qwen36-lora-train.sh` | Finished; runtime `11666.7564s`, train loss `0.9281658741335074`, adapter present | 2026-06-03 |
+| v1.8 SGLang dynamic LoRA serve | `./scripts/start-qwen36-lora-sglang.sh` with v1.8 adapter, `KAIJU_QWEN36_LORA_CONTEXT=8192`, `KAIJU_QWEN36_LORA_MEM_FRACTION=0.90` | Historical only: `/v1/models` listed `kaiju_v18_business_owner`, but adapter-name-only output can be base-equivalent; not release evidence | 2026-06-03 |
+| Corrected v1.8 dynamic LoRA selector | Model selector `qwen36-27b:kaiju_v18_business_owner` under SGLang with fused target modules | Fails: `LoRA buffer shape torch.Size([8192, 16]) does not match weight shape torch.Size([14336, 16])`; dynamic LoRA is not the release path | 2026-06-03 |
+| v1.8 LoRA merge | `KAIJU_LORA_ADAPTER=/workspace/kaiju-coder/runs/qwen36-27b-lora-v1.8-business-owner/adapter ./scripts/run-gojira-b-qwen36-lora-merge.sh` | Passed; merged full model at `/home/richardecholsai5/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged`, `51G`, `14` shards | 2026-06-03 |
+| Kaiju Coder 7 merged SGLang serve | `./scripts/start-qwen36-merged-sglang.sh` with `KAIJU_QWEN36_MERGED_CONTEXT=32768`, `KAIJU_QWEN36_MERGED_MEM_FRACTION=0.90` | `/v1/models` returned `kaiju-coder-7`, max model len `32768`; 12k/16k/24k/32k evidence is recorded in `release/SERVING_BENCHMARKS.md` | 2026-06-03 |
+| Kaiju Coder 7 restored 32k direct API smoke | `python3 scripts/benchmark_kaiju_serving.py --contexts 32768 --prompts identity business_doc --max-tokens 768 --timeout 420` | Passed; `/v1/models` returned `kaiju-coder-7`, max model len `32768`; identity `2.92s`; business proposal `94.28s`, `1,737` chars | 2026-06-03 |
+| Kaiju Coder 7 restored 32k OpenCode one-file smoke | `opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 --dir /tmp/kaiju-opencode-32k-final-smoke 'Create hello.txt with exactly: Kaiju Coder 7 final 32k ok'` | Passed; wrote `hello.txt` with exactly `Kaiju Coder 7 final 32k ok` | 2026-06-03 |
+| Kaiju Coder 7 current restored 16k direct API smoke | `python3 scripts/benchmark_kaiju_serving.py --contexts 16384 --prompts identity --max-tokens 64 --timeout 120` | Passed; latest run `runs/benchmarks/20260603T174545Z-kaiju-coder-7-serving/summary.md`, identity `2.3s`, `26` chars | 2026-06-03 |
+| Kaiju Coder 7 current restored 16k OpenCode one-file smoke | `mkdir -p /tmp/kaiju-opencode-fresh-public-smoke && opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 --dir /tmp/kaiju-opencode-fresh-public-smoke --dangerously-skip-permissions 'Create hello.txt with exactly: Kaiju Coder 7 fresh public smoke ok'` | Passed; `/v1/models` returned `kaiju-coder-7`, max model len `16384`; wrote `hello.txt` with exactly `Kaiju Coder 7 fresh public smoke ok` | 2026-06-03 |
+| Kaiju Coder 7 packaged public OpenCode smoke | `python3 scripts/run_kaiju_public_opencode_smoke.py --timeout 900 --keep-dir` | Passed; latest run `runs/public-opencode-smoke/20260603T182222Z/summary.md`, `4/4` checks passed; installer dry-run, OpenCode `1.15.13`, live 16k model, and file written only in the requested temp workspace | 2026-06-03 |
+| Kaiju Coder 7 loop-guarded OpenCode install | `python3 scripts/install_kaiju_opencode_profile.py`; `opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 --dir /tmp/kaiju-opencode-loopguard-smoke --dangerously-skip-permissions 'Create loopguard.txt with exactly: Kaiju Coder 7 loop guard installed'` | Passed; config includes `/Users/richardecholsai7/.config/opencode/kaiju-no-autocontinue.mjs`; wrote `loopguard.txt` with exact requested content and exited cleanly | 2026-06-03 |
+| Current harnessed OpenCode customer-readiness pack | `python3 scripts/run_kaiju_opencode_customer_pack.py --mode harnessed` | Passed; latest run `runs/opencode-customer-readiness/20260603T185835Z/summary.md`, `4/4` tasks passed and `28/28` required files written, including release provenance and safety review | 2026-06-03 |
+| Paid API Worker scaffold | `cd gateway/cloudflare-worker && npm run check && npm run preflight` | Passed `16/16` Worker tests and `17` scaffold preflight checks; covers bearer auth, inactive keys, insufficient credits, debit/refund, rate limit before debit, model `kaiju-coder-7` enforcement, stream/thinking/token caps, secret-content rejection without logging, signed Stripe Checkout top-up idempotency, origin-only R2 artifact upload, account-scoped artifact download, guarded Cloudflare resource prep, Wrangler dry-run deploy, sanitized paid-launch evidence template packaging, reviewed Cloudflare bindings template, binding applier guardrails, and sanitized evidence collection helper | 2026-06-03 |
+| Kaiju Coder 7 merged vLLM serve | `KAIJU_VLLM_CONTEXT=16384 ./scripts/run-gojira-b-vllm-serving-benchmark.sh` | Passed at 16k with Gojira nightly vLLM after `pandas` preinstall and `--language-model-only`; identity `19.99s`, code patch `28.8s`; not faster enough to replace SGLang | 2026-06-03 |
+| Kaiju Coder 7 runtime-quantized vLLM serve | `KAIJU_VLLM_CONTEXT=16384 KAIJU_VLLM_QUANTIZATION=bitsandbytes KAIJU_VLLM_LOAD_FORMAT=bitsandbytes ./scripts/run-gojira-b-vllm-serving-benchmark.sh` | Passed at 8k and 16k; 16k identity `19.51s`, code patch `11.3s`; vLLM log reported about `17.8 GiB` model memory | 2026-06-03 |
+| Kaiju Coder 7 runtime-quantized business-doc smoke | `KAIJU_VLLM_CONTEXT=16384 KAIJU_VLLM_QUANTIZATION=bitsandbytes KAIJU_VLLM_LOAD_FORMAT=bitsandbytes KAIJU_VLLM_PROMPTS=business_doc KAIJU_VLLM_MAX_TOKENS=768 KAIJU_VLLM_PROMPT_TIMEOUT=420 ./scripts/run-gojira-b-vllm-serving-benchmark.sh` | Passed; business proposal `53.44s`, `1,610` chars, `30.127` chars/s; wrapper restored SGLang after completion | 2026-06-03 |
+| Kaiju Coder 7 runtime-quantized OpenCode one-file smoke | `bash scripts/run_kaiju_quantized_opencode_smoke.sh` | Passed at 16k after vLLM `--enable-auto-tool-choice`; OpenCode wrote `hello.txt` with exactly `Kaiju Coder 7 quantized runtime ok` | 2026-06-03 |
+| Hugging Face CLI install/auth check | `hf version && hf auth whoami && hf auth list` | `hf` installed locally at version `1.17.0`; auth user `restokes92`; token name `gojirakiyomikode` | 2026-06-03 |
+| Hugging Face private repo create attempt | `KAIJU_HF_UPLOAD_APPLY=1 bash scripts/upload_hf_release_staging.sh` with namespaces `RichardEchols`, `RMDWLLC`, and `restokes92` | Blocked by Hugging Face `403 Forbidden`; current token cannot create model repos in those namespaces | 2026-06-03 |
+| Hugging Face merged-model metadata and upload boundary | `bash scripts/prepare_hf_merged_model_metadata.sh`; `KAIJU_MERGED_METADATA_APPLY=1 bash scripts/prepare_hf_merged_model_metadata.sh`; `bash scripts/upload_hf_merged_model_from_gojira_b.sh`; `KAIJU_HF_UPLOAD_APPLY=1 bash scripts/upload_hf_merged_model_from_gojira_b.sh` | Metadata prep synced model card, quickstarts, provenance, benchmarks, evals, paid API status, final report, upstream license, and `MERGED_MODEL_RELEASE_MANIFEST.json` to Gojira-B; sudo rsync handled the root-owned merged folder; upload dry run confirmed metadata plus the `51G`/`14`-shard merged model before printing `hf upload-large-folder`; apply remains blocked by human review and Hugging Face namespace permission before any large upload | 2026-06-03 |
+| v1.8 merged endpoint probe | Direct OpenAI-compatible chat request with top-level `chat_template_kwargs` disabling thinking | Passed; `1,155` visible chars in `60.17s`, normal `content` response | 2026-06-03 |
+| Kaiju Coder 7 merged focused proposal eval | `python3 evals/run_openai_compat_smoke.py --model kaiju-coder-7 --tasks evals/tasks/business-owner-v18-comparison.jsonl --max-tasks 1 --max-tokens 1800 ...` then `python3 evals/score_quality_gate.py <results.jsonl>` | Passed: `1/1` paid-ready, `4.0/4.0`, `4,014` chars, `212.72s` | 2026-06-03 |
+| Kaiju Coder 7 merged focused Jah credits eval | `python3 evals/run_openai_compat_smoke.py --model kaiju-coder-7 --tasks evals/tasks/business-owner-v18-comparison.jsonl ...` then `python3 evals/score_quality_gate.py <results.jsonl>` | Passed: `4.0/4.0`, `9,718` chars, `566.36s` | 2026-06-03 |
+| Full local RC smoke gate | `python3 scripts/run_kaiju_business_owner_rc_smoke.py` | Passed; latest router/static run `20260603T103915Z-kaiju_router_harness` | 2026-06-03 |
+
+## Required Before Release
+
+| Gate | Required result | Status |
+|---|---|---|
+| v1.7 LoRA train | Finished metrics and adapter under `runs/qwen36-27b-lora-v1.7-business-owner` | Passed |
+| v1.8 stronger LoRA train | Finished metrics and adapter under `runs/qwen36-27b-lora-v1.8-business-owner` | Passed |
+| v1.8 merged focused smoke | `python3 evals/run_openai_compat_smoke.py --tasks evals/tasks/business-owner-v18-comparison.jsonl --model kaiju-coder-7 ...` then `python3 evals/score_quality_gate.py` | Passed for proposal rerun and Jah credits backend; broader sweep pending |
+| Direct commercial eval | No critical failures, scored summary attached | Passed for targeted high-value tasks when using the product harness plus 8k raw website mode; broader task sweep still pending |
+| Base Qwen comparison | Kaiju beats base Qwen on RMDW/Kiyomi practical tasks | Not yet: raw deterministic identity still matches base; compare broader tasks before model-level improvement claims |
+| GLM comparison | Kaiju is near or above GLM on highest-value business-owner tasks | Pending |
+| Local inference smoke | OpenAI-compatible endpoint returns usable business-owner artifact | Passed for v1.8 merged SGLang endpoint and product harness |
+| Human review | Richard reviews artifacts for usefulness, privacy, and sellability | Pending |
+| Release package | Model card, provenance, license notes, eval summary, limitations, Hugging Face draft, completion audit, and run instructions complete | Staged and upload-scripted; upload blocked by HF token permissions and human/public-review decision |
+
+## Decision Rule
+
+The v1.8 adapter is a completed local checkpoint and the merged full model is the current served raw-model path. The business-owner product should still be published honestly as merged model plus deterministic harness plus verifier. Raw merged v1.8 is useful on business documents and Jah credits but slow on this SGLang stack. Do not claim raw-weight superiority until broader base/GLM and raw website comparisons pass.

FINAL_RELEASE_REPORT.md

@@ -0,0 +1,269 @@
+# Kaiju Coder 7 Final Release Report
+
+Generated: `2026-06-03T20:03:02Z`
+
+Product name: `Kaiju Coder 7`
+Public model id: `kaiju-coder-7`
+Current source branch: `codex/kaiju-business-owner-rc`
+Current HEAD: `3d57eae92ad523519473f0ff3eca6661a9736de3`
+Current `origin/main`: `3d57eae92ad523519473f0ff3eca6661a9736de3`
+
+## Current Verdict
+
+Kaiju Coder 7 is a local public-testing release candidate, not a fully public
+commercial launch yet. The local model path, OpenCode profile, harnessed
+business-owner evals, Hugging Face staging package, runtime-quantized recipe,
+and paid API scaffold are in place. Public release still requires human
+approval, a write-capable Hugging Face namespace/token, and live paid API
+resources before the hosted API can be sold.
+
+## Runtime
+
+| Field | Value |
+|---|---|
+| Status | `pass` |
+| Base URL | `http://100.109.109.14:18083/v1` |
+| Model id | `kaiju-coder-7` |
+| Max model length | `16384` |
+| Detail | `` |
+
+Recommended default today: `16k` context through `kaiju-coder-7`. Higher
+context has benchmark evidence, but the currently parked default is 16k for
+stability and speed.
+
+## Readiness Summary
+
+| Area | Result |
+|---|---|
+| Local public-testing readiness | `ready=True pass=23 fail=0 manual=1 rc=0` |
+| Hugging Face release readiness | `ready=True pass=23 fail=0 manual=1 rc=0` |
+| Public launch readiness | `ready=False pass=23 fail=1 manual=0 rc=1` |
+| Hugging Face staging integrity | `ready=True pass=6 fail=0 manual=0 rc=0` |
+| Paid API launch readiness | `ready=False pass=17 fail=3 manual=7 rc=1` |
+
+## Hugging Face Release Blockers
+
+| Status | Check | Detail |
+|---|---|---|
+| manual | paid API launch preflight | 17 pass, 3 fail, 7 manual |
+
+## Public Launch Blockers
+
+| Status | Check | Detail |
+|---|---|---|
+| fail | paid API launch preflight | 17 pass, 3 fail, 7 manual |
+
+## Paid API Launch Blockers
+
+| Status | Check | Detail |
+|---|---|---|
+| fail | live D1 binding | KAIJU_BILLING_DB is missing or still placeholder/commented |
+| fail | live KV binding | KAIJU_RATE_LIMIT_KV is missing or still placeholder/commented |
+| fail | artifact R2 binding | KAIJU_ARTIFACT_BUCKET is missing; artifact routes cannot launch |
+| manual | public route mode | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `public_route_mode` |
+| manual | wrangler secret list confirms KAIJU_ORIGIN_URL, KAIJU_ORIGIN_SECRET, and KAIJU_STRIPE_WEBHOOK_SECRET | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `wrangler_secrets_verified` |
+| manual | D1 migration 0001_paid_api.sql applied to the live billing database | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `d1_migration_applied` |
+| manual | Stripe Checkout top-up products and webhook endpoint tested with metadata.kaiju_api_key_id | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `stripe_checkout_topup_staging` |
+| manual | staging request passed through Worker to Gojira-B origin with model=kaiju-coder-7 | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `worker_to_gojira_staging_request` |
+| manual | rollback command or route switch was exercised and recorded | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `rollback_exercised` |
+| manual | p95 latency for paid routes is recorded after staging traffic | attach sanitized evidence in /Users/richardecholsai7/Apps/kaiju-coder/release/paid-api-launch-evidence.json key `paid_route_latency` |
+
+## Evidence Paths
+
+| Evidence | Path |
+|---|---|
+| Completion audit | `release/COMPLETION_AUDIT.md` |
+| Goal completion audit | `release/GOAL_COMPLETION_AUDIT.md` |
+| Release evidence refresh runner | `scripts/refresh_kaiju_release_evidence.py` |
+| Eval scoreboard | `release/EVAL_SCOREBOARD.md` |
+| Public testing quickstart | `release/PUBLIC_TESTING_QUICKSTART.md` |
+| Serving benchmarks | `release/SERVING_BENCHMARKS.md` |
+| Hugging Face release draft | `release/HUGGINGFACE_RELEASE_DRAFT.md` |
+| Hugging Face release bundle | `release/bundles/LATEST.md` |
+| Hugging Face bundle integrity checker | `scripts/check_hf_release_bundle_integrity.py` |
+| Hugging Face permission evidence template | `release/hf-release-permission-evidence.example.json` |
+| Hugging Face permission evidence collector | `scripts/collect_hf_release_permission_evidence.py` |
+| Hugging Face permission evidence checker | `scripts/check_hf_release_permission_evidence.py` |
+| Merged-model metadata prep | `scripts/prepare_hf_merged_model_metadata.sh` |
+| Human release review gate | `release/HUMAN_RELEASE_REVIEW.md` |
+| Paid API readiness | `release/PAID_API_READINESS.md` |
+| Paid API evidence collector | `scripts/collect_paid_api_launch_evidence.py` |
+| Paid API launch evidence template | `release/paid-api-launch-evidence.example.json` |
+| Cloudflare bindings template | `release/cloudflare-bindings.example.json` |
+| Cloudflare bindings applier | `scripts/apply_paid_api_cloudflare_bindings.py` |
+| Latest direct API smoke | `runs/benchmarks/20260603T193000Z-kaiju-coder-7-serving/summary.md` |
+| Latest OpenCode customer pack | `runs/opencode-customer-readiness/20260603T185835Z/summary.md` |
+| Latest public OpenCode smoke | `runs/public-opencode-smoke` |
+
+## What Richard Should Test First
+
+```bash
+python3 scripts/check_kaiju_public_release_readiness.py --mode local
+python3 scripts/install_kaiju_opencode_profile.py
+mkdir -p /tmp/kaiju-public-smoke
+opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 --dir /tmp/kaiju-public-smoke --dangerously-skip-permissions 'Create hello.txt with exactly: Kaiju Coder 7 public smoke ok'
+python3 scripts/run_kaiju_public_opencode_smoke.py
+python3 scripts/run_kaiju_opencode_customer_pack.py --mode harnessed
+bash scripts/prepare_hf_merged_model_metadata.sh
+bash scripts/prepare_hf_release_staging.sh
+python3 scripts/check_hf_staging_integrity.py --require-checksums
+python3 scripts/create_hf_release_bundle.py
+python3 scripts/check_hf_release_bundle_integrity.py
+python3 scripts/check_kaiju_goal_completion.py --write
+python3 scripts/refresh_kaiju_release_evidence.py --skip-opencode-smoke
+python3 scripts/collect_hf_release_permission_evidence.py
+# After HF repo-create permission is fixed:
+python3 scripts/collect_hf_release_permission_evidence.py --apply --write
+python3 scripts/check_hf_release_permission_evidence.py
+python3 scripts/check_kaiju_public_release_readiness.py --mode hf-release
+python3 scripts/check_kaiju_public_release_readiness.py --mode public
+cp release/cloudflare-bindings.example.json release/cloudflare-bindings.json
+# Replace placeholder D1/KV IDs in release/cloudflare-bindings.json first.
+python3 scripts/apply_paid_api_cloudflare_bindings.py --bindings-file release/cloudflare-bindings.json
+cp release/paid-api-launch-evidence.example.json release/paid-api-launch-evidence.json
+python3 scripts/collect_paid_api_launch_evidence.py --help
+python3 scripts/check_paid_api_readiness.py --mode launch --evidence-file release/paid-api-launch-evidence.json
+```
+
+Do not expose the paid hosted API until `python3
+scripts/check_paid_api_readiness.py --mode launch` has no failures and the
+human release review explicitly approves public paid API launch.
+
+## Changed Files
+
+`git status --short` currently reports `112` changed paths.
+
+| State | Path |
+|---|---|
+| M | `.gitignore` |
+| M | `LICENSE_NOTES.md` |
+| M | `README.md` |
+| M | `datasets/schema.json` |
+| M | `docs/custom-harness.md` |
+| M | `evals/BAKEOFF_CURRENT.md` |
+| M | `evals/run_openai_compat_smoke.py` |
+| M | `evals/run_router_static_checks.py` |
+| M | `evals/tasks/router-hard-harness.jsonl` |
+| M | `gateway/README.md` |
+| M | `gateway/cloudflare-worker/README.md` |
+| M | `gateway/cloudflare-worker/migrations/0001_paid_api.sql` |
+| M | `gateway/cloudflare-worker/package.json` |
+| M | `gateway/cloudflare-worker/src/index.js` |
+| M | `gateway/cloudflare-worker/test/index.test.js` |
+| M | `kaiju_harness/router.py` |
+| M | `kaiju_harness/verification.py` |
+| D | `models/README.md` |
+| D | `models/qwen3.6-27b-base.md` |
+| D | `models/qwen3.6-27b-fp8.md` |
+| M | `prompts/kaiju-coder-api-system.md` |
+| M | `prompts/kaiju-coder-speed-system.md` |
+| M | `release/DATA_PROVENANCE_DRAFT.md` |
+| M | `release/MODEL_CARD_DRAFT.md` |
+| M | `scripts/build_sft_dataset.py` |
+| M | `scripts/check-gojira-b-capacity.sh` |
+| M | `scripts/run-gojira-b-qwen36-lora-eval.sh` |
+| M | `scripts/run-gojira-b-qwen36-lora-sglang-eval.sh` |
+| M | `scripts/run-gojira-b-qwen36-lora-train.sh` |
+| M | `scripts/run_kaiju_api_harness_smoke.py` |
+| M | `scripts/start-qwen36-lora-sglang.sh` |
+| M | `scripts/stop-qwen36-lora-sglang.sh` |
+| M | `scripts/validate_training_data.py` |
+| M | `scripts/watch-gojira-b-qwen36-lora-train.sh` |
+| ?? | `.opencode/` |
+| ?? | `datasets/candidates/v1.7-rmdw-business-owner-suite.jsonl` |
+| ?? | `datasets/v1.7-targets.json` |
+| ?? | `evals/tasks/business-owner-v18-comparison.jsonl` |
+| ?? | `evals/tasks/business-owner-v18-smoke.jsonl` |
+| ?? | `evals/tasks/opencode-customer-readiness.jsonl` |
+| ?? | `kaiju_harness/business_suite.py` |
+| ?? | `release/COMPLETION_AUDIT.md` |
+| ?? | `release/EVAL_SCOREBOARD.md` |
+| ?? | `release/FINAL_RELEASE_REPORT.md` |
+| ?? | `release/GOAL_COMPLETION_AUDIT.md` |
+| ?? | `release/HF_ADAPTER_MODEL_CARD.md` |
+| ?? | `release/HUGGINGFACE_RELEASE_DRAFT.md` |
+| ?? | `release/HUMAN_RELEASE_REVIEW.md` |
+| ?? | `release/LOCAL_TEST_INSTRUCTIONS.md` |
+| ?? | `release/PAID_API_READINESS.md` |
+| ?? | `release/PUBLIC_TESTING_QUICKSTART.md` |
+| ?? | `release/QUANTIZATION_PLAN.md` |
+| ?? | `release/SERVING_BENCHMARKS.md` |
+| ?? | `release/SOURCE_INVENTORY.md` |
+| ?? | `release/UPSTREAM_LICENSE_CHECK.md` |
+| ?? | `release/bundles/` |
+| ?? | `release/cloudflare-bindings.example.json` |
+| ?? | `release/hf-release-permission-evidence.example.json` |
+| ?? | `release/hf-release-permission-evidence.json` |
+| ?? | `release/huggingface/` |
+| ?? | `release/opencode/` |
+| ?? | `release/paid-api-launch-evidence.example.json` |
+| ?? | `release/quantized-runtime/` |
+| ?? | `release/source-inventory.json` |
+| ?? | `release/upstream/` |
+| ?? | `scripts/apply_paid_api_cloudflare_bindings.py` |
+| ?? | `scripts/benchmark_kaiju_serving.py` |
+| ?? | `scripts/build_source_inventory.py` |
+| ?? | `scripts/build_v17_business_owner_sft_dataset.py` |
+| ?? | `scripts/check_hf_release_bundle_integrity.py` |
+| ?? | `scripts/check_hf_release_permission_evidence.py` |
+| ?? | `scripts/check_hf_release_permissions.sh` |
+| ?? | `scripts/check_hf_staging_integrity.py` |
+| ?? | `scripts/check_hf_uploaded_release.py` |
+| ?? | `scripts/check_human_release_review.py` |
+| ?? | `scripts/check_kaiju_goal_completion.py` |
+| ?? | `scripts/check_kaiju_public_release_readiness.py` |
+| ?? | `scripts/check_kaiju_quantization_prereqs.py` |
+| ?? | `scripts/check_paid_api_readiness.py` |
+| ?? | `scripts/collect_hf_release_permission_evidence.py` |
+| ?? | `scripts/collect_paid_api_launch_evidence.py` |
+| ?? | `scripts/create_hf_release_bundle.py` |
+| ?? | `scripts/generate_kaiju_final_report.py` |
+| ?? | `scripts/gojira-b-ssh-lib.sh` |
+| ?? | `scripts/install_kaiju_opencode_profile.py` |
+| ?? | `scripts/opencode-kaiju-no-autocontinue.mjs` |
+| ?? | `scripts/prepare_hf_merged_model_metadata.sh` |
+| ?? | `scripts/prepare_hf_release_staging.sh` |
+| ?? | `scripts/prepare_paid_api_cloudflare_resources.sh` |
+| ?? | `scripts/probe-gojira-b-kaiju-quantization.sh` |
+| ?? | `scripts/refresh_kaiju_release_evidence.py` |
+| ?? | `scripts/run-gojira-b-qwen36-lora-merge.sh` |
+| ?? | `scripts/run-gojira-b-vllm-serving-benchmark.sh` |
+| ?? | `scripts/run_kaiju_business_owner_rc_smoke.py` |
+| ?? | `scripts/run_kaiju_opencode_customer_pack.py` |
+| ?? | `scripts/run_kaiju_public_opencode_smoke.py` |
+| ?? | `scripts/run_kaiju_quantized_opencode_smoke.sh` |
+| ?? | `scripts/start-qwen36-merged-sglang.sh` |
+| ?? | `scripts/start-qwen36-merged-vllm.sh` |
+| ?? | `scripts/stop-qwen36-merged-sglang.sh` |
+| ?? | `scripts/stop-qwen36-merged-vllm.sh` |
+| ?? | `scripts/upload_hf_merged_model_from_gojira_b.sh` |
+| ?? | `scripts/upload_hf_release_staging.sh` |
+| ?? | `tests/test_kiyomi_business_suite.py` |
+| ?? | `tests/test_release_package.py` |
+| ?? | `tests/test_source_inventory.py` |
+| ?? | `tests/test_training_provenance.py` |
+| ?? | `tests/test_v17_business_dataset.py` |
+| ?? | `training/configs/qwen36-27b-lora-v1.7.example.json` |
+| ?? | `training/configs/qwen36-27b-lora-v1.8-business-owner.example.json` |
+| ?? | `training/scripts/qwen36_lora_merge.py` |
+| ?? | `training/v1.7-business-owner-runbook.md` |
+
+## Commands Run During Report Generation
+
+| Label | Command | Return code |
+|---|---|---|
+| git branch | `git branch --show-current` | 0 |
+| git HEAD | `git rev-parse HEAD` | 0 |
+| git origin/main | `git rev-parse origin/main` | 0 |
+| git status | `git status --short` | 0 |
+| local readiness | `/opt/homebrew/opt/python@3.14/bin/python3.14 scripts/check_kaiju_public_release_readiness.py --mode local --json --base-url http://100.109.109.14:18083/v1 --live-timeout 5 --staging-dir /tmp/kaiju-coder-7-hf-staging` | 0 |
+| HF release readiness | `/opt/homebrew/opt/python@3.14/bin/python3.14 scripts/check_kaiju_public_release_readiness.py --mode hf-release --json --base-url http://100.109.109.14:18083/v1 --live-timeout 5 --staging-dir /tmp/kaiju-coder-7-hf-staging` | 0 |
+| public readiness | `/opt/homebrew/opt/python@3.14/bin/python3.14 scripts/check_kaiju_public_release_readiness.py --mode public --json --base-url http://100.109.109.14:18083/v1 --live-timeout 5 --staging-dir /tmp/kaiju-coder-7-hf-staging` | 1 |
+| HF staging integrity | `/opt/homebrew/opt/python@3.14/bin/python3.14 scripts/check_hf_staging_integrity.py --staging-dir /tmp/kaiju-coder-7-hf-staging --require-checksums --json` | 0 |
+| paid API launch readiness | `/opt/homebrew/opt/python@3.14/bin/python3.14 scripts/check_paid_api_readiness.py --mode launch --json` | 1 |
+
+## Report Safety
+
+This generator intentionally avoids secret-bearing commands such as auth token
+lists, environment dumps, process command-line scans, Wrangler secret lists, and
+payment-provider credential output.

GOAL_COMPLETION_AUDIT.md

@@ -0,0 +1,60 @@
+# Kaiju Coder 7 Goal Completion Audit
+
+Generated: `2026-06-03T20:03:23Z`
+
+Overall: `not complete`
+Summary: `16 passed / 1 blocked / 0 manual`
+
+This audit maps the active Kaiju Coder 7 objective to current evidence. It is stricter than local readiness: local public testing can pass while Hugging Face upload, human review, and paid API launch remain blocked.
+
+## Readiness Commands
+
+| Check | Ready | Return Code |
+|---|---:|---:|
+| Local public-testing readiness | `True` | `0` |
+| Hugging Face release readiness | `True` | `0` |
+| Public launch readiness | `False` | `1` |
+| Paid API scaffold | `True` | `0` |
+| Paid API launch | `False` | `1` |
+| HF staging integrity | `True` | `0` |
+| HF namespace permission evidence | `True` | `0` |
+| Human public review | `True` | `0` |
+
+## Requirement Audit
+
+| Area | Requirement | Status | Evidence | Blocker |
+|---|---|---|---|---|
+| Identity | Product name is Kaiju Coder 7 and public/API model id is kaiju-coder-7. | `passed` | scripts/check_kaiju_public_release_readiness.py --mode local; release/PUBLIC_TESTING_QUICKSTART.md |  |
+| OpenCode | Lean Kaiju-specific OpenCode config/agent minimizes prompt overhead and disables synthetic auto-continue loops. | `passed` | .opencode/agents/kaiju-coder-7.md; scripts/opencode-kaiju-no-autocontinue.mjs; scripts/install_kaiju_opencode_profile.py |  |
+| OpenCode | opencode -m kaiju/kaiju-coder-7 works from this Mac with the recommended config. | `passed` | runs/public-opencode-smoke latest passing summary; scripts/run_kaiju_public_opencode_smoke.py |  |
+| OpenCode | Customer-readiness pack passes without wrong-directory output, fake compaction completion, missing files, or secret leakage. | `passed` | runs/opencode-customer-readiness/20260603T185835Z/summary.md |  |
+| Runtime | Direct API smoke passes using model=kaiju-coder-7. | `passed` | runs/benchmarks/20260603T193000Z-kaiju-coder-7-serving/summary.md |  |
+| Runtime | 12k, 16k, 24k, and 32k context benchmarks are recorded with a recommended default. | `passed` | release/SERVING_BENCHMARKS.md records 12288, 16384, 24576, 32768 and recommends 16k live default |  |
+| Runtime | SGLang and vLLM/practical faster serving path are benchmarked honestly. | `passed` | release/SERVING_BENCHMARKS.md; release/quantized-runtime/README.md |  |
+| Runtime | At least one public-friendly quantized/local candidate is working or clearly documented as blocked with evidence. | `passed` | release/quantized-runtime/README.md documents vLLM bitsandbytes runtime candidate and persisted-weights limitation |  |
+| Hugging Face | Public-friendly HF release structure is staged with adapter, OpenCode helper, runtime-quantized helper, model cards, provenance, evals, and docs. | `passed` | python3 scripts/check_hf_staging_integrity.py --require-checksums |  |
+| Hugging Face | At least one public Hugging Face release path is ready to upload or uploaded. | `passed` | python3 scripts/check_kaiju_public_release_readiness.py --mode hf-release |  |
+| Hugging Face | Merged 51GB model repo upload is guarded and ready after human review/namespace permission. | `passed` | scripts/prepare_hf_merged_model_metadata.sh; scripts/upload_hf_merged_model_from_gojira_b.sh dry run |  |
+| Quality | Customer-style evals cover website, proposal, Stripe/payment, CRM/reporting, CSV/parser, Kiyomi operating pack, and safety/provenance. | `passed` | evals/tasks/opencode-customer-readiness.jsonl; runs/opencode-customer-readiness/20260603T185835Z/summary.md |  |
+| Quality | Model/harness prompts produce file-oriented business-owner artifacts rather than vague advice. | `passed` | kaiju_harness/business_suite.py; release/EVAL_SCOREBOARD.md |  |
+| Provenance | Training/eval provenance is preserved and public docs avoid internal checkpoint naming except license/provenance attribution. | `passed` | release/SOURCE_INVENTORY.md; release/DATA_PROVENANCE_DRAFT.md; release/PUBLIC_TESTING_QUICKSTART.md |  |
+| Paid API | Paid API scaffold covers API keys, Stripe billing, rate limits, logging controls, abuse controls, rollback plan, and pricing assumptions. | `passed` | python3 scripts/check_paid_api_readiness.py --mode scaffold; gateway/cloudflare-worker tests |  |
+| Paid API | Paid API is ready for public charging. | `blocked` | python3 scripts/check_paid_api_readiness.py --mode launch | Requires live D1/KV/R2 bindings, Wrangler secrets, Stripe staging evidence, Worker-to-Gojira staging request, rollback proof, latency evidence, and human approval. |
+| Final Report | Final report includes exact commands run, eval results, changed files, remaining risks, and what Richard should test first. | `passed` | release/FINAL_RELEASE_REPORT.md |  |
+
+## Blocking Items
+
+- Paid API: Paid API is ready for public charging.: Requires live D1/KV/R2 bindings, Wrangler secrets, Stripe staging evidence, Worker-to-Gojira staging request, rollback proof, latency evidence, and human approval.
+
+## Commands To Re-run
+
+```bash
+python3 scripts/check_kaiju_public_release_readiness.py --mode local
+python3 scripts/check_kaiju_public_release_readiness.py --mode hf-release
+python3 scripts/check_kaiju_public_release_readiness.py --mode public
+python3 scripts/check_paid_api_readiness.py --mode scaffold
+python3 scripts/check_paid_api_readiness.py --mode launch
+python3 scripts/check_hf_staging_integrity.py --require-checksums
+python3 scripts/check_hf_release_permission_evidence.py
+python3 scripts/check_human_release_review.py --mode public
+```

LOCAL_TEST_INSTRUCTIONS.md

@@ -0,0 +1,147 @@
+# Kaiju Coder 7 Local Test Instructions
+
+Use these commands from the repo root. The public release name is Kaiju Coder 7. Internally, this build is backed by the v1.8 adapter under `runs/qwen36-27b-lora-v1.8-business-owner/adapter`. The release-candidate raw model path is the merged full model on Gojira B at `/home/richardecholsai5/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged`. The deterministic harness commands work locally now; the SGLang commands require Gojira B over Tailscale.
+
+## Run The Local Release-Candidate Gate
+
+```bash
+python3 scripts/run_kaiju_business_owner_rc_smoke.py
+```
+
+This validates reviewed data, checks v1.7 targets, builds the oversampled business-owner SFT file, smokes the local OpenAI-compatible harness API, runs the hard router suite, and runs static artifact checks.
+
+For release status, read `release/COMPLETION_AUDIT.md` and `release/HUGGINGFACE_RELEASE_DRAFT.md`.
+
+## Merge The v1.8 Adapter
+
+Use this if the merged full model must be rebuilt:
+
+```bash
+KAIJU_LORA_ADAPTER=/workspace/kaiju-coder/runs/qwen36-27b-lora-v1.8-business-owner/adapter \
+KAIJU_MERGED_MODEL_DIR=/workspace/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged \
+  ./scripts/run-gojira-b-qwen36-lora-merge.sh
+```
+
+## Start Kaiju Coder 7 Serving
+
+Use this for the current model-side candidate:
+
+```bash
+KAIJU_QWEN36_MERGED_PORT=18083 \
+KAIJU_QWEN36_MERGED_SESSION=kaiju_qwen36_v18_merged_sglang \
+KAIJU_QWEN36_MERGED_CONTEXT=16384 \
+KAIJU_QWEN36_MERGED_MEM_FRACTION=0.85 \
+  ./scripts/start-qwen36-merged-sglang.sh
+```
+
+Confirm readiness:
+
+```bash
+curl http://100.109.109.14:18083/v1/models
+```
+
+The high-context `32768` target has benchmark evidence in
+`release/SERVING_BENCHMARKS.md`, but the current restored Gojira-B endpoint is
+parked at `16384` for reliable local/OpenCode testing after the quantized-vLLM
+smoke work.
+
+## Prepare Merged-Model Hugging Face Metadata
+
+Use this before any full merged-model upload review. It syncs release metadata
+into the Gojira-B model folder but does not upload or read Hugging Face tokens.
+If the remote merged folder is root-owned, the helper automatically uses
+passwordless sudo for rsync without changing model ownership:
+
+```bash
+bash scripts/prepare_hf_merged_model_metadata.sh
+KAIJU_MERGED_METADATA_APPLY=1 bash scripts/prepare_hf_merged_model_metadata.sh
+bash scripts/upload_hf_merged_model_from_gojira_b.sh
+```
+
+## Install And Smoke OpenCode
+
+```bash
+python3 scripts/install_kaiju_opencode_profile.py
+opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 \
+  --dir /tmp/kaiju-opencode-loopguard-smoke \
+  --dangerously-skip-permissions \
+  'Create loopguard.txt with exactly: Kaiju Coder 7 loop guard installed'
+```
+
+The installer writes the `kaiju` provider, the lean `kaiju-coder-7` agent, and
+the scoped no-autocontinue plugin at
+`~/.config/opencode/kaiju-no-autocontinue.mjs`.
+
+## Run The Deterministic Harness Smoke
+
+```bash
+python3 scripts/run_kaiju_api_harness_smoke.py
+```
+
+## Run A Direct Model Eval
+
+```bash
+python3 evals/run_openai_compat_smoke.py \
+  --base-url http://100.109.109.14:18083/v1 \
+  --model kaiju-coder-7 \
+  --tasks evals/tasks/smoke.jsonl \
+  --max-tasks 1 \
+  --timeout 300 \
+  --max-tokens 768 \
+  --temperature 0 \
+  --disable-thinking \
+  --system-prompt-file prompts/kaiju-coder-api-system.md
+```
+
+For the selected final business-owner checkpoint, run the focused v1.8
+business-owner pack and then score it. Raw merged model generation is slow, so
+use the harness for practical paid website delivery until broader raw website
+evals pass at acceptable latency:
+
+```bash
+python3 evals/run_openai_compat_smoke.py \
+  --base-url http://100.109.109.14:18083/v1 \
+  --model kaiju-coder-7 \
+  --tasks evals/tasks/business-owner-v18-comparison.jsonl \
+  --timeout 900 \
+  --max-tokens 2500 \
+  --temperature 0 \
+  --disable-thinking \
+  --stream \
+  --system-prompt-file prompts/kaiju-coder-api-system.md
+
+python3 evals/score_quality_gate.py runs/evals/<merged-v18-run>/results.jsonl
+```
+
+Current merged evidence:
+
+- Probe: `1,155` visible chars in `60.17s`.
+- Proposal rerun: `1/1` paid-ready, `4.0/4.0`, `4,014` chars in `212.72s`.
+- Jah credits backend: `4.0/4.0`, `9,718` chars in `566.36s`.
+
+## Dynamic LoRA Serving Caveat
+
+Do not use dynamic SGLang LoRA serving as release evidence for v1.8. The adapter-name-only path can be base-equivalent, and the corrected selector `qwen36-27b:kaiju_v18_business_owner` crashes this SGLang build with a fused-module LoRA buffer shape mismatch. Use the merged full-model path above.
+
+## Run The Business-Owner Harness
+
+```bash
+python3 evals/run_router_harness_eval.py --tasks evals/tasks/router-hard-harness.jsonl
+python3 evals/run_router_static_checks.py runs/evals/<router-run>/results.jsonl
+```
+
+## Manual Prompt To Try First
+
+```text
+Build me the full Kiyomi 7.7.7 AI company operating pack for a local business owner. I need the launch kit, website, content engine, connector checklist, intake CRM, money report, automations, operator handbook, lead generator, sales closer, ROI dashboard, and Workshop golden run. Make it owner-ready with no developer setup required.
+```
+
+Expected shape:
+
+- A project folder with multiple files, not advice only.
+- Complete HTML where HTML is requested.
+- Lead/sales CSVs.
+- Connector verification gates.
+- ROI audit gate.
+- Workshop golden-run gate.
+- Clear owner commands such as `/kiyomi` and `/kiyomi-do`.

MERGED_MODEL_RELEASE_MANIFEST.json

@@ -0,0 +1,11 @@
+{
+  "product": "Kaiju Coder 7",
+  "model_id": "kaiju-coder-7",
+  "remote_model_dir": "/home/richardecholsai5/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged",
+  "metadata_status": "prepared_for_huggingface_review",
+  "notes": [
+    "Local metadata sync only; no Hugging Face upload performed.",
+    "Qwen attribution belongs in README/provenance/license notes, not the product model id.",
+    "Public paid API launch remains blocked until live launch preflight and human review pass."
+  ]
+}

PAID_API_READINESS.md

@@ -0,0 +1,266 @@
+# Kaiju Coder 7 Paid API Readiness
+
+Do not sell the hosted API as generally available until the gates below pass.
+
+## Current Position
+
+Kaiju Coder 7 can be served locally through an OpenAI-compatible SGLang
+endpoint. The reliable commercial product path is:
+
+```text
+Kaiju Coder 7 model + deterministic business-owner harness + verifier + gateway controls
+```
+
+Raw multi-file OpenCode generation is not yet fast enough to be the paid API
+promise by itself. The harnessed customer-readiness pack passes and should be
+the paid-route baseline until raw-agent generation improves.
+
+## Required Gateway Behavior
+
+- Use model id `kaiju-coder-7`.
+- Disable hidden thinking where the serving stack supports it.
+- Stream responses for long outputs.
+- Cap max output by route.
+- Reject requests with secret-looking prompt content when possible.
+- Never log API keys, bearer tokens, OAuth tokens, payment credentials, or full
+  private customer prompts by default.
+- Keep request ids, customer id, route, token counts, latency, status, and coarse
+  failure reason.
+
+## Billing And Access
+
+- API keys must be scoped per customer/account.
+- Stripe subscription or prepaid credit balance must be checked before serving.
+- Rate limits must be per key and per account.
+- Failed auth and rate-limit events should be logged without prompt content.
+- Admin override keys must be separate from customer keys.
+
+## Current Gateway Scaffold Evidence
+
+Local Worker scaffold:
+
+- `gateway/cloudflare-worker/src/index.js`
+- `gateway/cloudflare-worker/migrations/0001_paid_api.sql`
+- `gateway/cloudflare-worker/test/index.test.js`
+
+Verified on 2026-06-03 with:
+
+```bash
+cd gateway/cloudflare-worker
+npm run check
+npm run preflight
+```
+
+Result: `16/16` Worker tests passed and `17` paid API scaffold preflight checks
+passed.
+The scaffold preflight also checks that the guarded Cloudflare resource-prep
+script, `scripts/prepare_paid_api_cloudflare_resources.sh`, is wired through
+`npm run prepare:cloudflare`, and that the reviewed binding template is present.
+
+Covered locally:
+
+- missing bearer token returns `401`
+- inactive API key returns `403`
+- insufficient credits return `402` before origin fetch
+- successful chat request forwards `x-kaiju-origin-secret` and debits credits
+- origin fetch failure refunds credits
+- fixed-window rate limit blocks before debit
+- public chat payload is forced to model `kaiju-coder-7`, streaming, thinking
+  disabled, and token capped
+- unsupported model is rejected before debit
+- secret-looking prompt content is rejected before debit, origin fetch, or logs
+- signed Stripe Checkout webhook credits prepaid balance
+- duplicate Stripe Checkout webhook does not double-credit
+- invalid Stripe signature is rejected
+- origin-only artifact upload stores bounded text artifacts in R2
+- authenticated artifact download is scoped to the caller's account namespace
+- unsafe artifact paths are rejected before R2 storage
+- secret-looking artifact content is rejected before R2 storage
+
+Executable preflight:
+
+```bash
+python3 scripts/check_kaiju_public_release_readiness.py --mode local
+python3 scripts/check_kaiju_public_release_readiness.py --mode hf-release
+python3 scripts/check_kaiju_public_release_readiness.py --mode public
+python3 scripts/generate_kaiju_final_report.py
+python3 scripts/check_kaiju_goal_completion.py --write
+python3 scripts/refresh_kaiju_release_evidence.py --skip-opencode-smoke
+python3 scripts/check_hf_staging_integrity.py
+python3 scripts/check_hf_release_bundle_integrity.py
+python3 scripts/collect_hf_release_permission_evidence.py
+python3 scripts/check_hf_release_permission_evidence.py
+python3 scripts/check_human_release_review.py --mode local
+python3 scripts/check_human_release_review.py --mode public
+cd gateway/cloudflare-worker
+npm run prepare:cloudflare
+cd ../..
+cp release/cloudflare-bindings.example.json release/cloudflare-bindings.json
+# Replace placeholder D1/KV IDs in release/cloudflare-bindings.json first.
+python3 scripts/apply_paid_api_cloudflare_bindings.py --bindings-file release/cloudflare-bindings.json
+python3 scripts/check_paid_api_readiness.py --mode scaffold
+python3 scripts/check_paid_api_readiness.py --mode launch
+```
+
+`check_kaiju_public_release_readiness.py --mode local` is the consolidated
+public-testing readiness command. It can pass while public upload and paid API
+launch remain manual blockers. `--mode hf-release` checks the downloadable
+model/helper release and requires sanitized Hugging Face namespace permission
+evidence plus human review while keeping paid API launch manual. `--mode public`
+must remain red until Hugging Face write permissions, live Cloudflare resources,
+Stripe staging evidence, rollback proof, and human review are complete.
+
+`generate_kaiju_final_report.py` writes `release/FINAL_RELEASE_REPORT.md` with
+the current local/public readiness summaries, launch blockers, changed files,
+commands run, and first commands Richard should test. It is part of the release
+packet and does not inspect tokens, environment variables, or process command
+lines.
+
+`check_kaiju_goal_completion.py --write` writes
+`release/GOAL_COMPLETION_AUDIT.md`, a stricter objective-level audit. It should
+remain red while Hugging Face upload, human review, or live paid API launch
+evidence are missing.
+
+`refresh_kaiju_release_evidence.py` is a safe local refresh runner. It updates
+direct API smoke evidence, goal audit, final report, HF staging, local bundle,
+merged-model metadata on Gojira-B, and dry-run upload previews without reading
+tokens or uploading anything.
+
+`check_hf_staging_integrity.py` validates the staged Hugging Face package for
+required files, public naming hygiene, raw secret-looking values, and staging
+checksums. It does not upload, create repos, or print matched secret values.
+
+`check_hf_release_permission_evidence.py` validates sanitized Hugging Face
+repo-create evidence in `release/hf-release-permission-evidence.json`. Start
+from `release/hf-release-permission-evidence.example.json` only after the
+private permission probe succeeds, or use
+`scripts/collect_hf_release_permission_evidence.py --apply --write` to run the
+probe and write the sanitized evidence automatically. Never include raw auth
+output or tokens.
+
+`check_human_release_review.py` reads `release/HUMAN_RELEASE_REVIEW.md`. Local
+mode may pass with pending/manual review fields; public mode must fail until
+Richard changes the signoff fields to approved decisions.
+
+`npm run prepare:cloudflare` is dry-run safe by default. It prints the exact
+Wrangler commands for creating `KAIJU_BILLING_DB`, `KAIJU_RATE_LIMIT_KV`, and
+`KAIJU_ARTIFACT_BUCKET`, applying the D1 migration, setting required secrets,
+deploying, listing deployments, and exercising rollback. `npm run check` also
+runs `npx wrangler deploy --dry-run` so the current Worker build path is validated
+without publishing. Set
+`KAIJU_CF_RESOURCE_APPLY=1` only when the intended Cloudflare account is active.
+
+After real D1/KV/R2 resources exist, copy
+`release/cloudflare-bindings.example.json` to `release/cloudflare-bindings.json`,
+replace the placeholder IDs, and preview the reviewed config update:
+
+```bash
+python3 scripts/apply_paid_api_cloudflare_bindings.py \
+  --bindings-file release/cloudflare-bindings.json
+```
+
+The applier refuses placeholder values and secret-looking input. Only after the
+preview is reviewed should it update `gateway/cloudflare-worker/wrangler.jsonc`:
+
+```bash
+python3 scripts/apply_paid_api_cloudflare_bindings.py \
+  --bindings-file release/cloudflare-bindings.json \
+  --write
+```
+
+`--mode scaffold` verifies the local gateway implementation and should pass.
+`--mode launch` is stricter and should fail until real Cloudflare bindings,
+Wrangler secrets, Stripe webhook evidence, staging traffic, latency evidence,
+and rollback proof are attached.
+
+Launch evidence is attached through a sanitized JSON file:
+
+```bash
+cp release/paid-api-launch-evidence.example.json release/paid-api-launch-evidence.json
+python3 scripts/collect_paid_api_launch_evidence.py --help
+python3 scripts/check_paid_api_readiness.py --mode launch \
+  --evidence-file release/paid-api-launch-evidence.json
+```
+
+Use `scripts/collect_paid_api_launch_evidence.py` to preview or write sanitized
+launch evidence after staging resources exist. It can read the staging API key
+from an environment variable for live probes, but it never writes the key, full
+prompt, or model response to the evidence file. By default it prints a preview;
+pass `--write` only after reviewing the target file path.
+
+Only record secret names, route names, request ids, coarse latency numbers, and
+pass/fail facts. Do not put raw API keys, bearer tokens, OAuth tokens, Stripe
+secret keys, webhook signing secrets, tunnel credentials, full private prompts,
+or customer private data in the evidence file. The checker scans the evidence
+file for common secret-looking values and fails launch readiness if it finds
+them.
+
+## Minimum API Gates
+
+| Gate | Required Evidence |
+| --- | --- |
+| Auth | Unauthorized requests fail; valid test key works |
+| Billing | Unpaid/suspended account is denied before model call |
+| Rate limit | Burst and daily caps work per key |
+| Logging | Logs omit secrets and full private prompts |
+| Abuse control | Secret-looking payloads and obviously unsafe automation requests are rejected or redacted |
+| Artifacts | Origin-only R2 upload and account-scoped artifact download pass |
+| Rollback | One command can route traffic back to previous stable model/harness |
+| Latency | p95 for paid routes is documented and acceptable |
+| Quality | Business-owner eval pack passes with complete files/artifacts |
+
+Current quality evidence:
+
+- Harnessed customer-readiness pack:
+  `runs/opencode-customer-readiness/20260603T185835Z/summary.md`, `4/4`
+  passed, `28/28` required files written, including the release provenance and
+  safety review task.
+- Restored 32k SGLang direct API smoke:
+  `runs/benchmarks/20260603T155233Z-kaiju-coder-7-serving/summary.md`,
+  identity passed in `2.92s`; business proposal passed in `94.28s` with
+  `1,737` chars.
+- Runtime-quantized vLLM OpenCode smoke:
+  `bash scripts/run_kaiju_quantized_opencode_smoke.sh` passed at 16k after
+  vLLM launched with `--enable-auto-tool-choice`; OpenCode wrote
+  `hello.txt` with exactly `Kaiju Coder 7 quantized runtime ok`.
+- Current restored 16k SGLang direct API smoke:
+  `runs/benchmarks/20260603T174545Z-kaiju-coder-7-serving/summary.md`,
+  identity passed in `2.3s`.
+- Raw OpenCode multi-file pack remains a blocker for raw-agent claims.
+
+## Pricing Assumptions To Validate
+
+- Raw model tokens are slow and expensive enough that per-token pricing alone is
+  not the right first product.
+- Better first API product: priced business-owner routes such as website pack,
+  proposal pack, ROI/report pack, and Kiyomi operating pack.
+- Charge for complete artifacts and verified workflow output, with token usage
+  as an internal cost-control metric.
+
+## Release Blockers
+
+- Raw OpenCode customer-readiness task currently times out on multi-file work.
+- Harnessed customer-readiness route passes; paid API must route through that
+  deterministic product path until a faster raw/quantized path passes.
+- Context-size benchmarks passed at 12k, 16k, 24k, and 32k, but the current
+  parked Gojira-B/OpenCode profile is 16k. Treat 32k as the high-context target
+  to re-confirm after restart before using it as a public default.
+- Restored 32k business-document direct API smoke passed, but the `94.28s`
+  latency is too slow for ungated paid API use without streaming, queueing,
+  and route-level caps.
+- vLLM serving has been tested at 16k, but it is not clearly faster than SGLang
+  and needs the Gojira nightly image plus text-only launch flags.
+- Runtime-quantized vLLM bitsandbytes has passed 8k and 16k identity/code
+  smoke tests, passed a 16k business-document smoke in `53.44s`, and reduces
+  model memory to about `17.8 GiB`; its OpenCode one-file smoke now passes.
+- Persisted quantized public weights are still pending.
+- Hosted gateway scaffold now has local-tested API key, D1 prepaid credits,
+  fixed-window rate limit, model enforcement, secret-content rejection, and
+  signed Stripe webhook top-up behavior. It also has a sanitized launch-evidence
+  collector for the remaining staging proof. It is not live-paid ready until real
+  Cloudflare resources, Stripe products/webhook endpoint, deployment secrets,
+  sanitized launch evidence, and staging end-to-end requests pass.
+- `python3 scripts/check_paid_api_readiness.py --mode launch` currently fails
+  by design because live D1/KV/R2 bindings and manual launch evidence are not
+  attached. This prevents local scaffold readiness from being mistaken for
+  paid public launch approval.

PUBLIC_TESTING_QUICKSTART.md

@@ -0,0 +1,149 @@
+# Kaiju Coder 7 Public Testing Quickstart
+
+Kaiju Coder 7 is the public model name. The OpenAI-compatible model id is:
+
+```text
+kaiju-coder-7
+```
+
+Use this guide for serious public testing. It avoids internal checkpoint names
+and keeps the current limitations clear.
+
+## Pick A Test Path
+
+### Path 1: OpenCode Against An Existing Endpoint
+
+Use this if you already have Kaiju Coder 7 served at an OpenAI-compatible
+`/v1` endpoint.
+
+```bash
+git clone https://huggingface.co/RMDWLLC/kaiju-coder-7-opencode
+cd kaiju-coder-7-opencode
+python3 scripts/install_kaiju_opencode_profile.py --base-url http://127.0.0.1:18083/v1
+```
+
+Then run OpenCode inside the project you want to edit:
+
+```bash
+opencode -m kaiju/kaiju-coder-7 --agent kaiju-coder-7
+```
+
+For a bounded smoke test:
+
+```bash
+mkdir -p /tmp/kaiju-public-smoke
+opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 \
+  --dir /tmp/kaiju-public-smoke \
+  "Create hello.txt with exactly: Kaiju Coder 7 is ready"
+```
+
+Or run the packaged verifier, which checks the installer, live model endpoint,
+OpenCode binary, actual file creation, and wrong-directory behavior:
+
+```bash
+python3 scripts/run_kaiju_public_opencode_smoke.py
+```
+
+The helper installer adds:
+
+- the `kaiju` OpenAI-compatible provider
+- the lean `kaiju-coder-7` OpenCode agent
+- a scoped no-autocontinue plugin that prevents false completion loops after
+  compaction or output limits
+
+### Path 2: Full Local Weights
+
+Use this if the full `RMDWLLC/kaiju-coder-7` Hugging Face repo has been
+uploaded and you have suitable local GPU hardware.
+
+```bash
+hf download RMDWLLC/kaiju-coder-7 --local-dir ./kaiju-coder-7
+```
+
+Serve the downloaded folder with an OpenAI-compatible local server. Configure
+the server to expose:
+
+```text
+model id: kaiju-coder-7
+base URL: http://127.0.0.1:18083/v1
+context: 16384
+```
+
+Then install the OpenCode helper with:
+
+```bash
+git clone https://huggingface.co/RMDWLLC/kaiju-coder-7-opencode
+cd kaiju-coder-7-opencode
+python3 scripts/install_kaiju_opencode_profile.py --base-url http://127.0.0.1:18083/v1
+```
+
+### Path 3: Runtime-Quantized Local Candidate
+
+Use this only if you are comfortable with advanced serving setups. The current
+working quantized option is a runtime bitsandbytes recipe, not a separate
+persisted quantized weights repo.
+
+```bash
+git clone https://huggingface.co/RMDWLLC/kaiju-coder-7-quantized-runtime
+cd kaiju-coder-7-quantized-runtime
+```
+
+Read `README.md` in that repo before serving. This path can reduce model memory
+at runtime, but it still depends on access to the full Kaiju Coder 7 weights.
+
+## Recommended Test Prompt
+
+Run this from an empty project folder:
+
+```text
+Build a launch-ready local service business website and operating pack. Include
+index.html, a Stripe checkout safety plan, a CSV parser with tests, a simple CRM
+schema, a weekly money report, and a safety/provenance note. Write the files,
+not just advice.
+```
+
+Expected result:
+
+- files are written in the requested project folder
+- `index.html` is complete HTML
+- business docs start with Markdown H1 headings
+- code includes a test or smoke-check command where practical
+- no fake API keys, OAuth tokens, payment secrets, or private customer data
+
+## Current Recommended Defaults
+
+- Public model id: `kaiju-coder-7`
+- OpenCode context: `16384`
+- Output cap for public testing: `2500`
+- Current reliable product path: model plus deterministic business-owner
+  harness plus verifier
+- Raw multi-file OpenCode generation: still too slow for broad paid API claims
+- Paid API: not public until launch preflight passes
+
+## What Not To Claim Yet
+
+Do not claim:
+
+- that raw model weights alone reliably build every business-owner artifact
+- that a paid hosted API is generally available
+- that persisted quantized weights exist
+- that 32k context is the current live default
+
+Do claim:
+
+- Kaiju Coder 7 has a working local/OpenCode release candidate
+- the current tested OpenCode default is 16k context
+- the helper package includes a lean agent and compaction loop guard
+- the paid API scaffold has tests and a launch preflight, but is not yet public
+- the packaged public smoke verifies a fresh OpenCode one-file write before
+  public claims are refreshed
+
+## Current Blockers Before Public Release
+
+- Hugging Face repo creation still requires a write-capable token or namespace.
+- Full merged model upload has not completed; the merged folder must first have
+  the metadata packet synced by `prepare_hf_merged_model_metadata.sh`.
+- Public paid API launch needs real Cloudflare D1/KV/R2 bindings, Wrangler
+  secret verification, Stripe webhook staging evidence, staging traffic, latency
+  evidence, and rollback proof.
+- Human review is still required before public upload.

README.md

@@ -0,0 +1,160 @@
+# Kaiju Coder 7 by Kiyomi - Model Card Draft
+
+This is a draft. Do not publish until the current eval gate passes, final license files are attached, and the exact trained checkpoint is recorded.
+
+## Model Summary
+
+Kaiju Coder 7 by Kiyomi is an RMDW fine-tuned coding and builder model for solo entrepreneurs and local-first AI users.
+
+Primary intended work:
+
+- Build complete websites and landing pages.
+- Build Kiyomi-style AI-company launch packs for business owners.
+- Write scripts, small apps, and automation flows.
+- Reason about Stripe, licensing, auth proxies, and release workflows.
+- Draft practical business documents such as proposals, launch plans, support notes, operator handbooks, and follow-up sequences.
+- Produce intake/CRM schemas, lead lists, ROI dashboards, and reporting artifacts.
+- Help builders avoid overbuilt architecture and ship useful artifacts.
+
+## Base Model
+
+- Base candidate: `Qwen/Qwen3.6-27B`
+- Base model URL: `https://huggingface.co/Qwen/Qwen3.6-27B`
+- Checked revision: `6a9e13bd6fc8f0983b9b99948120bc37f49c13e9`
+- License tag checked: `apache-2.0` on 2026-06-03
+- Upstream license copy: `release/upstream/qwen3.6-27b/LICENSE`
+- Upstream license check: `release/UPSTREAM_LICENSE_CHECK.md`
+
+Required before release:
+
+- Include upstream Apache 2.0 license.
+- Include upstream notices if present.
+- Do not imply Qwen or Alibaba endorsement.
+- Use attribution language only: "Fine-tuned from Qwen under Apache 2.0."
+
+## Fine-Tuning
+
+- Method: LoRA
+- Existing full run lineage: `qwen36-27b-lora-v0.1` through current Kaiju adapters
+- Training hardware: Gojira B, 128GB NVIDIA Spark
+- v0.1 training examples: 575 reviewed examples
+- v1.7 training file: `datasets/build/kaiju-sft-v1.7-business-owner-oversampled.jsonl`
+- v1.7 raw reviewed examples: 1,689
+- v1.7 training rows after business-owner oversampling: 1,881
+- v1.7 business-owner addendum: 8 reviewed examples, oversampled 24 times for the next run
+- v1.7 config: `training/configs/qwen36-27b-lora-v1.7.example.json`
+- v1.7 run scope: 1,024-token context, 24 steps, intended as a testable business-owner adapter rather than a final long-context bakeoff
+- v1.7 train runtime: `1663.7101s`
+- v1.7 train loss: `1.7260706673065822`
+- v1.7 train/eval examples: `1,769` / `112`
+- v1.7 adapter path: `runs/qwen36-27b-lora-v1.7-business-owner/adapter`
+- v1.8 config: `training/configs/qwen36-27b-lora-v1.8-business-owner.example.json`
+- v1.8 scope: 2,048-token context, 96 max steps, same reviewed/oversampled v1.7 business-owner SFT rows
+- v1.8 train runtime: `11666.7564s`
+- v1.8 train loss: `0.9281658741335074`
+- v1.8 train/eval examples: `1,769` / `112`
+- v1.8 adapter path: `runs/qwen36-27b-lora-v1.8-business-owner/adapter`
+- v1.8 status: completed on 2026-06-03 and merged into a full local model for serving; do not publish externally until human review, upstream notices, broader comparison evals, and raw website limitation language are complete
+- Trainable parameters: approximately 79.7M
+- Base parameters: approximately 27.0B
+- Merged full-model artifact: `/home/richardecholsai5/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged`, `51G`, `14` safetensor shards plus tokenizer/config sidecars
+
+Release note: Kaiju's current product path may combine a compact model planner with deterministic harnesses and verifier checks. If the shipped experience uses that harness path, release copy must say so plainly instead of implying the raw model weights alone create every artifact.
+
+## Data
+
+The dataset is source-backed and RMDW-owned or RMDW-authored. The current source inventory is tracked in `release/SOURCE_INVENTORY.md`.
+
+High-level categories:
+
+- Website/UI
+- Coding
+- Debugging
+- Automation
+- Tool-use
+- Strategy
+- Business
+- Business-suite
+- Identity
+
+Excluded data:
+
+- Closed-model outputs from OpenAI, Anthropic, Gemini, or similar providers as supervised training completions.
+- Customer private code without explicit permission.
+- Client-specific website text, contact details, contracts, or private business details unless explicitly reviewed and approved.
+- Secrets, credentials, private keys, tokens, cookies, and raw support logs containing personal data.
+
+## Evaluation
+
+Required bakeoff before release:
+
+- Base Qwen 3.6 27B
+- Kaiju Coder LoRA
+- GLM 4.7 production baseline
+
+Current local harness evidence:
+
+- 2026-06-03 Kiyomi business-suite router hard gate: `23/23` passed.
+- Business-suite prompts: `2/2` passed.
+- Static artifact checks: `23/23` passed.
+- Dataset validation: `1,689` reviewed candidate examples across `14` files.
+- v1.7 target gate: all category minimums met, including `business_suite` and `proposal`.
+- v1.7 served adapter smoke:
+  - Website task `website-barber-001`: passed, 2,726 chars in 174.49s.
+  - Proposal task `proposal-001` with Kaiju API system prompt: passed, 4,306 chars in 232.27s.
+- v1.7 serving config: SGLang over Tailscale at `http://100.109.109.14:18083/v1`, model `kaiju_v17_business_owner`, context `4096`, memory fraction `0.90`.
+- v1.8 training metrics: runtime `11666.7564s`, train loss `0.9281658741335074`, adapter present.
+- v1.8 dynamic SGLang LoRA caveat:
+  - Adapter-name-only serving can be base-equivalent.
+  - Corrected selector `qwen36-27b:kaiju_v18_business_owner` crashes with `LoRA buffer shape torch.Size([8192, 16]) does not match weight shape torch.Size([14336, 16])`.
+  - Dynamic LoRA is not the release serving path for this checkpoint.
+- Kaiju Coder 7 serving config: SGLang over Tailscale at `http://100.109.109.14:18083/v1`, model `kaiju-coder-7`, current parked Gojira-B/OpenCode context `16384`, tested high-context target `32768`, memory fraction `0.90`.
+- v1.8 merged endpoint probe: `1,155` visible chars in `60.17s`.
+- v1.8 merged focused eval:
+  - Proposal rerun: `1/1` paid-ready, `4.0/4.0`, `4,014` chars in `212.72s`.
+  - Jah credits backend: `4.0/4.0`, `9,718` chars in `566.36s`.
+- Broader base-Qwen, GLM, and raw website comparisons are still pending.
+
+Sellable-candidate gate:
+
+- Beats base Qwen on RMDW practical evals.
+- Near or above GLM 4.7 on highest-value customer tasks.
+- No critical safety failures.
+- Produces complete artifacts instead of plans only.
+- Produces owner-ready Kiyomi/RMDW artifacts for websites, connector packs, CRM, reporting, leads, sales, ROI, and operator training.
+- Distinct useful voice without becoming gimmicky.
+
+## Limitations
+
+Known limitations:
+
+- Not a general frontier model.
+- May be weaker than large cloud frontier models on broad reasoning and uncommon programming domains.
+- Needs a strong harness for tool use, file editing, and long-running work.
+- Raw merged serving is slow on this SGLang stack.
+- Dynamic SGLang LoRA serving is not release-quality for this adapter; use the merged model path.
+- Business-owner performance depends on source-backed evals, provenance controls, and deterministic artifact verification.
+- Hosted API release requires billing, rate limits, abuse controls, logs, and rollback.
+
+## Intended Use
+
+Good fit:
+
+- Solo-founder product work.
+- Small-business websites and automations.
+- Kiyomi-style local AI product workflows.
+- Practical coding and deployment assistance.
+
+Not a fit:
+
+- High-risk medical, legal, financial, or safety-critical decisions without expert review.
+- Secret handling without a secure app layer.
+- Claims of guaranteed correctness.
+
+## Release Status
+
+Current status: business-owner release-candidate preparation.
+
+Fresh v1.7 and v1.8 LoRA training finished on 2026-06-03 after clearing old ComfyUI/Ollama workloads from Gojira B. The current completed testable product path is the v1.8 merged model plus the deterministic business-owner harness and verifier. Raw merged model testing works for focused business-owner documents and backend automations, but the paid website path remains harness-first until broader raw website evals pass.
+
+Do not publish weights or sell hosted API access until the eval and release checklist pass.

SERVING_BENCHMARKS.md

@@ -0,0 +1,358 @@
+# Kaiju Coder 7 Serving Benchmarks
+
+This file records serving evidence for public download and paid API decisions.
+The model id must remain `kaiju-coder-7`.
+
+## Current Live Runtime
+
+- Host: Gojira-B over Tailscale
+- Base URL: `http://100.109.109.14:18083/v1`
+- Serving stack: SGLang merged full model
+- Current verified post-quantization restored context: `16384`
+- Tested high-context target: `32768`
+- Current container: `qwen36-merged-sglang-18083`
+- Current caveat: direct raw generation is slow for multi-file OpenCode work.
+
+## Benchmark Command
+
+For current-context latency without restart:
+
+```bash
+python3 scripts/benchmark_kaiju_serving.py \
+  --contexts 12288 \
+  --prompts identity business_doc code_patch \
+  --max-tokens 768 \
+  --timeout 420
+```
+
+For context restart benchmarking:
+
+```bash
+python3 scripts/benchmark_kaiju_serving.py \
+  --restart \
+  --contexts 12288 16384 24576 32768 \
+  --prompts identity business_doc \
+  --max-tokens 768 \
+  --timeout 420 \
+  --ready-timeout 1200
+```
+
+Use `--contexts 16384` for the current restored Gojira-B endpoint. Use
+`32768` when explicitly testing the high-context target; it has passed earlier
+benchmarks but should be re-confirmed after a fresh restart before calling it
+the live default.
+
+## Current 12k Direct API Benchmark
+
+Command:
+
+```bash
+python3 scripts/benchmark_kaiju_serving.py \
+  --contexts 12288 \
+  --prompts identity code_patch \
+  --max-tokens 256 \
+  --timeout 300
+```
+
+Run: `runs/benchmarks/20260603T135017Z-kaiju-coder-7-serving/summary.md`
+
+| Context | Prompt | OK | Seconds | Chars | Chars/s |
+| --- | --- | --- | ---: | ---: | ---: |
+| 12288 | identity | True | 2.41 | 26 | 10.788 |
+| 12288 | code_patch | True | 57.61 | 860 | 14.928 |
+
+Interpretation: direct API calls are usable for short tasks, but latency is too
+high for a paid raw-code API unless outputs are streamed and route-specific
+limits are enforced.
+
+## 16k Context Benchmark
+
+16k was tested to reduce OpenCode compaction pressure.
+
+Commands:
+
+```bash
+python3 scripts/benchmark_kaiju_serving.py \
+  --restart \
+  --contexts 16384 \
+  --prompts identity \
+  --max-tokens 128 \
+  --timeout 300 \
+  --ready-timeout 1200
+
+python3 scripts/benchmark_kaiju_serving.py \
+  --contexts 16384 \
+  --prompts code_patch \
+  --max-tokens 128 \
+  --timeout 300
+```
+
+Runs:
+
+- `runs/benchmarks/20260603T135651Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T140318Z-kaiju-coder-7-serving/summary.md`
+
+| Context | Prompt | OK | Load Wait | Seconds | Chars | Chars/s |
+| --- | --- | --- | ---: | ---: | ---: | ---: |
+| 16384 | identity | True | 354.16 | 14.9 | 26 | 1.745 |
+| 16384 | code_patch | True | n/a | 28.99 | 416 | 14.35 |
+
+Interpretation: `16384` is a stable lower-load fallback and still leaves more
+room above OpenCode's prompt/tool overhead than the original 12k setting.
+
+## 24k And 32k Context Benchmarks
+
+24k and 32k were tested after 16k proved stable. Both loaded and returned the
+same code-patch latency profile as 16k on the short patch benchmark.
+
+Commands:
+
+```bash
+python3 scripts/benchmark_kaiju_serving.py \
+  --restart \
+  --contexts 24576 \
+  --prompts identity \
+  --max-tokens 128 \
+  --timeout 300 \
+  --ready-timeout 1200
+
+python3 scripts/benchmark_kaiju_serving.py \
+  --contexts 24576 \
+  --prompts code_patch \
+  --max-tokens 128 \
+  --timeout 300
+
+python3 scripts/benchmark_kaiju_serving.py \
+  --restart \
+  --contexts 32768 \
+  --prompts identity \
+  --max-tokens 64 \
+  --timeout 300 \
+  --ready-timeout 1200
+
+python3 scripts/benchmark_kaiju_serving.py \
+  --contexts 32768 \
+  --prompts code_patch \
+  --max-tokens 128 \
+  --timeout 300
+```
+
+Runs:
+
+- `runs/benchmarks/20260603T141559Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T142354Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T142439Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T143256Z-kaiju-coder-7-serving/summary.md`
+
+| Context | Prompt | OK | Load Wait | Seconds | Chars | Chars/s |
+| --- | --- | --- | ---: | ---: | ---: | ---: |
+| 24576 | identity | True | 439.54 | 16.84 | 26 | 1.544 |
+| 24576 | code_patch | True | n/a | 29.03 | 416 | 14.33 |
+| 32768 | identity | True | 386.53 | 16.27 | 26 | 1.598 |
+| 32768 | code_patch | True | n/a | 28.99 | 416 | 14.35 |
+
+Interpretation: `32768` is a proven high-context target from this benchmark set,
+but it is not the currently parked live endpoint after the later
+quantized-runtime testing. The current Gojira-B/OpenCode profile should stay at
+`16384` until `32768` is freshly restarted and re-confirmed. Keep `12288` for
+direct API smoke tests and constrained hardware.
+
+Restored-service 32k direct API smoke after vLLM testing:
+
+- Run: `runs/benchmarks/20260603T155233Z-kaiju-coder-7-serving/summary.md`
+- `/v1/models`: `kaiju-coder-7`, max model len `32768`
+
+| Context | Prompt | OK | Seconds | Chars | Chars/s |
+| --- | --- | --- | ---: | ---: | ---: |
+| 32768 | identity | True | 2.92 | 26 | 8.904 |
+| 32768 | business_doc | True | 94.28 | 1737 | 18.424 |
+
+Interpretation: the restored default endpoint is usable for business-owner
+document work, but a long proposal response still takes about 94 seconds. Paid
+routes must stream, cap output, queue carefully, and prefer verified
+artifact routes over raw open-ended generation.
+
+## OpenCode Customer-Readiness Evidence
+
+Final restored-service small OpenCode smoke:
+
+```bash
+opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 \
+  --dir /tmp/kaiju-opencode-32k-final-smoke \
+  'Create hello.txt with exactly: Kaiju Coder 7 final 32k ok'
+```
+
+Result: passed. OpenCode wrote `hello.txt` with exactly
+`Kaiju Coder 7 final 32k ok`.
+
+Current restored 16k OpenCode smoke after quantized-vLLM testing:
+
+```bash
+mkdir -p /tmp/kaiju-opencode-fresh-public-smoke
+opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 \
+  --dir /tmp/kaiju-opencode-fresh-public-smoke \
+  --dangerously-skip-permissions \
+  'Create hello.txt with exactly: Kaiju Coder 7 fresh public smoke ok'
+```
+
+Result: passed. OpenCode wrote `hello.txt` with exactly
+`Kaiju Coder 7 fresh public smoke ok` in
+`/tmp/kaiju-opencode-fresh-public-smoke`, and `/v1/models` returned
+`kaiju-coder-7` with max model len `16384`.
+
+Current restored 16k direct API identity smoke:
+
+- Run: `runs/benchmarks/20260603T174545Z-kaiju-coder-7-serving/summary.md`
+- `/v1/models`: `kaiju-coder-7`, max model len `16384`
+
+| Context | Prompt | OK | Seconds | Chars | Chars/s |
+| --- | --- | --- | ---: | ---: | ---: |
+| 16384 | identity | True | 2.3 | 26 | 11.304 |
+
+Command:
+
+```bash
+python3 scripts/run_kaiju_opencode_customer_pack.py
+```
+
+Latest harnessed product-path result on 2026-06-03:
+
+- Run: `runs/opencode-customer-readiness/20260603T185835Z/summary.md`
+- Mode: `harnessed`
+- Status: `4/4` passed
+- Tasks:
+  - `fade-flow-service-site`
+  - `kiyomi-owner-operating-pack`
+  - `paid-api-safety-scaffold`
+  - `release-provenance-safety-review`
+- Required files written: `28/28`
+- Forbidden secret-looking tokens: none found by verifier
+
+Loop-guarded OpenCode install smoke:
+
+- Command: `python3 scripts/install_kaiju_opencode_profile.py`, then
+  `opencode run -m kaiju/kaiju-coder-7 --agent kaiju-coder-7 --dir /tmp/kaiju-opencode-loopguard-smoke --dangerously-skip-permissions 'Create loopguard.txt with exactly: Kaiju Coder 7 loop guard installed'`
+- Result: passed. OpenCode wrote `loopguard.txt` in the requested directory with
+  exactly `Kaiju Coder 7 loop guard installed` and exited cleanly.
+- Installed guard: `/Users/richardecholsai7/.config/opencode/kaiju-no-autocontinue.mjs`
+
+Raw OpenCode-agent result on 2026-06-03:
+
+- Task: `fade-flow-service-site`
+- Status: timed out after `900s`
+- Required files written: `0`
+- Observed Gojira-B decode throughput while running: about `4.4` tokens/sec
+- Follow-up runner fix: workspaces now run outside the repo and pass `opencode
+  run --dir <workspace>` explicitly.
+- Structured follow-up run:
+  `runs/opencode-customer-readiness/20260603T135520Z/results.jsonl`
+  timed out after `60s`, wrote `0` files, and recorded `pwd` as the intended
+  temp workspace.
+- 16k/stricter-agent follow-up runs:
+  - `runs/opencode-customer-readiness/20260603T140650Z/results.jsonl`
+    timed out after `120s`, wrote `0` files, and recorded the intended temp
+    workspace.
+  - `runs/opencode-customer-readiness/20260603T140908Z/results.jsonl`
+    timed out after `120s`, wrote `0` files after adding stricter "write first
+    file immediately" prompt guidance.
+- Interpretation: the lean OpenCode agent fits and can write small files.
+  Harnessed file-plan delivery passes the customer pack. Current raw multi-file
+  OpenCode generation is still not public/API ready, so public and paid claims
+  must describe the reliable product path as model plus deterministic harness
+  and verifier.
+
+## Recommendation Until Faster Serving Is Proven
+
+- Public local release can proceed only with clear speed/hardware caveats.
+- Paid API should route business-owner deliverables through deterministic
+  harnesses and verifiers, not raw OpenCode multi-file generation.
+- Quantized candidates and/or a smaller distilled variant are required for
+  broad public OpenCode usability.
+
+## vLLM Serving Probe
+
+vLLM was tested as the practical alternative serving path after SGLang. The
+standard `vllm/vllm-openai:latest` image cannot read the merged checkpoint's
+`qwen3_5` config. The Gojira nightly image can read it, but needed two launch
+fixes for this checkpoint:
+
+- preinstall `pandas`, because the Qwen3.5 model path imports it in this image
+- pass `--language-model-only`, because the merged text-serving checkpoint does
+  not include the visual encoder weights expected by the multimodal config
+
+Guarded benchmark command:
+
+```bash
+KAIJU_VLLM_CONTEXT=16384 KAIJU_VLLM_READY_TIMEOUT=900 \
+  ./scripts/run-gojira-b-vllm-serving-benchmark.sh
+```
+
+Run: `runs/benchmarks/20260603T151244Z-kaiju-coder-7-serving/summary.md`
+
+| Stack | Context | Prompt | OK | Seconds | Chars | Chars/s |
+| --- | ---: | --- | --- | ---: | ---: | ---: |
+| vLLM nightly | 16384 | identity | True | 19.99 | 26 | 1.301 |
+| vLLM nightly | 16384 | code_patch | True | 28.8 | 416 | 14.444 |
+
+Interpretation: vLLM now runs Kaiju Coder 7 at 16k, but it is not clearly
+faster than SGLang on the current smoke prompts. Keep SGLang as the recommended
+runtime because it has stable OpenCode smoke evidence, a simpler launch path,
+and historical 32k proof. Keep the live/default OpenCode profile at 16k until
+32k is freshly re-confirmed. Keep the vLLM scripts for future nightly-image or
+quantized-weight testing.
+
+## vLLM bitsandbytes Runtime-Quantized Candidate
+
+The first working quantized local variant is a runtime bitsandbytes vLLM path.
+It does not create separate quantized weights yet; it loads the full merged
+model through vLLM's bitsandbytes loader.
+
+Command:
+
+```bash
+KAIJU_VLLM_CONTEXT=16384 \
+KAIJU_VLLM_READY_TIMEOUT=1200 \
+KAIJU_VLLM_QUANTIZATION=bitsandbytes \
+KAIJU_VLLM_LOAD_FORMAT=bitsandbytes \
+  ./scripts/run-gojira-b-vllm-serving-benchmark.sh
+```
+
+Runs:
+
+- `runs/benchmarks/20260603T153257Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T154450Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T161316Z-kaiju-coder-7-serving/summary.md`
+- `runs/benchmarks/20260603T165512Z-kaiju-coder-7-serving/summary.md`
+
+| Stack | Context | Prompt | OK | Seconds | Chars | Chars/s |
+| --- | ---: | --- | --- | ---: | ---: | ---: |
+| vLLM bitsandbytes | 8192 | identity | True | 21.19 | 26 | 1.227 |
+| vLLM bitsandbytes | 8192 | code_patch | True | 11.31 | 424 | 37.489 |
+| vLLM bitsandbytes | 16384 | identity | True | 19.51 | 26 | 1.333 |
+| vLLM bitsandbytes | 16384 | code_patch | True | 11.3 | 416 | 36.814 |
+| vLLM bitsandbytes | 16384 | business_doc | True | 53.44 | 1610 | 30.127 |
+| vLLM bitsandbytes | 16384 | identity | True | 19.65 | 26 | 1.323 |
+
+Gojira-B vLLM logs reported about `17.8 GiB` model memory for the bitsandbytes
+load at both 8k and 16k, compared with about `50.22 GiB` for the unquantized
+vLLM load. Code-patch latency improved materially on this smoke prompt.
+Business-document latency improved versus the restored 32k SGLang business-doc
+smoke (`53.44s` at 16k vLLM bitsandbytes versus `94.28s` at 32k SGLang).
+Identity latency remains slower than SGLang.
+
+Quantized OpenCode one-file smoke passed after launching vLLM with
+`--enable-auto-tool-choice` plus `--tool-call-parser qwen3_coder` and running:
+
+```bash
+bash scripts/run_kaiju_quantized_opencode_smoke.sh
+```
+
+Result: OpenCode wrote `/tmp/kaiju-opencode-quantized-smoke/hello.txt` with
+exactly `Kaiju Coder 7 quantized runtime ok`.
+
+Recommendation: keep SGLang as the default public/OpenCode runtime and keep the
+currently installed OpenCode profile at 16k unless the 32k target has just been
+restarted and re-confirmed. Treat vLLM bitsandbytes as the current working
+quantized local candidate for advanced GPU users and future paid API speed
+experiments. It now has direct identity/code/business-doc evidence plus an
+OpenCode one-file smoke, but it is not a persisted quantized-weights repo.

SOURCE_INVENTORY.md

@@ -0,0 +1,41 @@
+# Kaiju Source Inventory
+
+Generated from GitHub source-of-truth repositories plus the requested local RMDW wiki snapshot. This inventory defines what may become Kaiju training data, what is eval-only, and what must stay excluded.
+
+## Global Training Rules
+
+- Do not train on raw secrets, API keys, OAuth tokens, cookies, private keys, or credential files.
+- Do not train on closed-model responses from OpenAI, Anthropic, Gemini, or similar providers unless the terms clearly allow it.
+- Do not train on client-specific private data without explicit review and consent.
+- Preserve repository name, commit SHA, source path, license, and reviewer status for every promoted dataset row.
+
+## GitHub Repository Inventory
+
+| Repo | SHA | Role | Training use | Required gates | Exclusions | Notes |
+|---|---|---|---|---|---|---|
+| [RichardEchols/kaiju-coder](https://github.com/RichardEchols/kaiju-coder) | `3d57eae92ad5` | model lab, harness, evals, training scripts | candidate-after-review | secret-scan, closed-model-output-check, license-review | runs, models, .secrets, private datasets, raw logs | Use repo-owned harnesses, evals, docs, scripts, and curated datasets. Exclude weights, generated runs, and local secrets. |
+| [RichardEchols/Kiyomi-7.7.7](https://github.com/RichardEchols/Kiyomi-7.7.7) | `294b31008135` | business-owner AI-company module contracts | candidate-after-review | secret-scan, closed-model-output-check, private-data-review | credentials, tokens, private client state, closed-model transcripts | Use module contracts, templates, acceptance gates, and owner-facing task structure as high-signal business-owner curriculum. |
+| [RichardEchols/kiyomi-agent](https://github.com/RichardEchols/kiyomi-agent) | `b192c910f3f7` | business OS wrapper and local-agent patterns | candidate-after-review | secret-scan, closed-model-output-check, private-data-review | credentials, tokens, local runtime state, private support logs | Use architecture, docs, scripts, and safe wrapper patterns. Do not train on runtime secrets or private logs. |
+| [RichardEchols/rmdw-site](https://github.com/RichardEchols/rmdw-site) | `df089dc3b2d3` | public RMDW offer, site, and conversion surface | candidate-after-review | secret-scan, closed-model-output-check, public-copy-review | environment files, deployment secrets, analytics tokens | Use public offer copy, app structure, pricing/CTA patterns, and website implementation patterns. |
+| [RichardEchols/makotoair](https://github.com/RichardEchols/makotoair) | `7568f07fea6e` | client website implementation pattern | eval-and-patterns-only | secret-scan, client-data-review, consent-review | client-specific, contact data, contracts, private business details | Use as eval/pattern inspiration for local service business sites. Do not bulk-train on client-specific text without explicit review. |
+| [RichardEchols/Mezzal-Construction](https://github.com/RichardEchols/Mezzal-Construction) | `e8f2eede0405` | client website implementation pattern | eval-and-patterns-only | secret-scan, client-data-review, consent-review | client-specific, contact data, contracts, private business details | Use as eval/pattern inspiration for premium contractor site work. Do not bulk-train on client-specific text without explicit review. |
+| [RichardEchols/rmdw-agent-wiki](https://github.com/RichardEchols/rmdw-agent-wiki) | `ae1b8e85d3fe` | RMDW/Kiyomi operational wiki | selective-reference-only | secret-scan, credentials-redaction, private-data-review, closed-model-output-check | credentials.md, customers.md, raw, contracts, private client notes, support logs | Use only redacted strategy/product notes and documented decisions. Never use raw credentials or private client data. |
+
+## Local Source Inventory
+
+Local files are context snapshots, not the source of truth. Promote local wiki material into training only after explicit review, redaction, and either sync/diff against the GitHub wiki or a documented reviewer exception.
+
+| Source | Path | Git repo | Files | Training use | Required gates | Excluded paths present | Safe reference candidates | Notes |
+|---|---|---:|---:|---|---|---|---|---|
+| RMDW-Wiki-local | `/Users/richardecholsai7/Documents/RMDW-Wiki` | no | 93 | selective-reference-only | secret-scan, credentials-redaction, private-data-review, sync-or-diff-against-github | credentials.md, customers.md, customers/, raw/ | README.md, kaiju-coder-build-log.md, kaiju-coder-business-plan.md, kaiju-coder-soul.md, kiyomi-agent-build-log.md, pricing-history.md, product/kiyomi-private-ai-workstation.md, ops/product-ops-automation.md, client-acquisition-engine/README.md | Use as a local context snapshot only after explicit row-level review. Do not treat unsynced local files as the authoritative training source. |
+
+## Training Eligibility Meaning
+
+- `candidate-after-review`: source can produce training or eval examples only after secret scanning, closed-model-output review, and row-level provenance.
+- `eval-and-patterns-only`: use for hard eval prompts, harness behavior, screenshots, or generalized patterns. Do not bulk-train on client-specific source text.
+- `selective-reference-only`: use narrowly after redaction. Treat credentials, customer notes, and raw operational data as excluded by default.
+- Local snapshots require review against the GitHub source of truth before promotion into dataset rows.
+
+## Next Dataset Step
+
+Generate candidate examples only from reviewed paths, attach this inventory SHA or local snapshot data to each row, then run `scripts/validate_training_data.py` before any training run.

UPSTREAM_LICENSE_CHECK.md

@@ -0,0 +1,38 @@
+# Upstream License Check
+
+Date: 2026-06-03
+
+This is an engineering release check, not legal advice.
+
+## Base Model
+
+- Upstream model: `Qwen/Qwen3.6-27B`
+- Hugging Face URL: `https://huggingface.co/Qwen/Qwen3.6-27B`
+- Checked revision from Hugging Face API: `6a9e13bd6fc8f0983b9b99948120bc37f49c13e9`
+- Hugging Face license metadata: `apache-2.0`
+- Local license copy: `release/upstream/qwen3.6-27b/LICENSE`
+- Common upstream notice files checked: `NOTICE`, `NOTICE.txt`, `NOTICE.md`
+- Notice result: no common notice file found at the checked upstream paths
+
+## Release Obligations To Preserve
+
+- Include the upstream Apache 2.0 license with the adapter release package.
+- Keep the upstream base model name and revision in the model card.
+- State that Kaiju Coder is fine-tuned from Qwen; do not imply Qwen, Alibaba, or upstream-author endorsement.
+- Include a modification note for the LoRA adapter and RMDW/Kiyomi training/eval package.
+- Retain warranty and limitation language through the included Apache 2.0 license.
+
+## Current Packaging Status
+
+Passed for release review:
+
+- Upstream license file copied locally.
+- Upstream revision recorded.
+- Upstream license metadata recorded.
+- Notice check recorded.
+
+Still requires human release review:
+
+- Confirm no upstream files changed before upload.
+- Confirm the final Hugging Face repository includes the copied license file and model card.
+- Confirm public wording avoids endorsement or trademark confusion.

chat_template.jinja

@@ -0,0 +1,154 @@
+{%- set image_count = namespace(value=0) %}
+{%- set video_count = namespace(value=0) %}
+{%- macro render_content(content, do_vision_count, is_system_content=false) %}
+    {%- if content is string %}
+        {{- content }}
+    {%- elif content is iterable and content is not mapping %}
+        {%- for item in content %}
+            {%- if 'image' in item or 'image_url' in item or item.type == 'image' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain images.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set image_count.value = image_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Picture ' ~ image_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|image_pad|><|vision_end|>' }}
+            {%- elif 'video' in item or item.type == 'video' %}
+                {%- if is_system_content %}
+                    {{- raise_exception('System message cannot contain videos.') }}
+                {%- endif %}
+                {%- if do_vision_count %}
+                    {%- set video_count.value = video_count.value + 1 %}
+                {%- endif %}
+                {%- if add_vision_id %}
+                    {{- 'Video ' ~ video_count.value ~ ': ' }}
+                {%- endif %}
+                {{- '<|vision_start|><|video_pad|><|vision_end|>' }}
+            {%- elif 'text' in item %}
+                {{- item.text }}
+            {%- else %}
+                {{- raise_exception('Unexpected item type in content.') }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif content is none or content is undefined %}
+        {{- '' }}
+    {%- else %}
+        {{- raise_exception('Unexpected content type.') }}
+    {%- endif %}
+{%- endmacro %}
+{%- if not messages %}
+    {{- raise_exception('No messages provided.') }}
+{%- endif %}
+{%- if tools and tools is iterable and tools is not mapping %}
+    {{- '<|im_start|>system\n' }}
+    {{- "# Tools\n\nYou have access to the following functions:\n\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>" }}
+    {{- '\n\nIf you choose to call a function ONLY reply in the following format with NO suffix:\n\n<tool_call>\n<function=example_function_name>\n<parameter=example_parameter_1>\nvalue_1\n</parameter>\n<parameter=example_parameter_2>\nThis is the value for the second parameter\nthat can span\nmultiple lines\n</parameter>\n</function>\n</tool_call>\n\n<IMPORTANT>\nReminder:\n- Function calls MUST follow the specified format: an inner <function=...></function> block must be nested within <tool_call></tool_call> XML tags\n- Required parameters MUST be specified\n- You may provide optional reasoning for your function call in natural language BEFORE the function call, but NOT after\n- If there is no function call available, answer the question like normal with your current knowledge and do not tell the user about function calls\n</IMPORTANT>' }}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {%- if content %}
+            {{- '\n\n' + content }}
+        {%- endif %}
+    {%- endif %}
+    {{- '<|im_end|>\n' }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {%- set content = render_content(messages[0].content, false, true)|trim %}
+        {{- '<|im_start|>system\n' + content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for message in messages[::-1] %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- if ns.multi_step_tool and message.role == "user" %}
+        {%- set content = render_content(message.content, false)|trim %}
+        {%- if not(content.startswith('<tool_response>') and content.endswith('</tool_response>')) %}
+            {%- set ns.multi_step_tool = false %}
+            {%- set ns.last_query_index = index %}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if ns.multi_step_tool %}
+    {{- raise_exception('No user query found in messages.') }}
+{%- endif %}
+{%- for message in messages %}
+    {%- set content = render_content(message.content, true)|trim %}
+    {%- if message.role == "system" %}
+        {%- if not loop.first %}
+            {{- raise_exception('System message must be at the beginning.') }}
+        {%- endif %}
+    {%- elif message.role == "user" %}
+        {{- '<|im_start|>' + message.role + '\n' + content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is string %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in content %}
+                {%- set reasoning_content = content.split('</think>')[0].rstrip('\n').split('<think>')[-1].lstrip('\n') %}
+                {%- set content = content.split('</think>')[-1].lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- set reasoning_content = reasoning_content|trim %}
+        {%- if (preserve_thinking is defined and preserve_thinking is true) or (loop.index0 > ns.last_query_index) %}
+            {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content + '\n</think>\n\n' + content }}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls and message.tool_calls is iterable and message.tool_calls is not mapping %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if tool_call.function is defined %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {%- if loop.first %}
+                    {%- if content|trim %}
+                        {{- '\n\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- else %}
+                        {{- '<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                    {%- endif %}
+                {%- else %}
+                    {{- '\n<tool_call>\n<function=' + tool_call.name + '>\n' }}
+                {%- endif %}
+                {%- if tool_call.arguments is defined %}
+                    {%- for args_name, args_value in tool_call.arguments|items %}
+                        {{- '<parameter=' + args_name + '>\n' }}
+                        {%- set args_value = args_value | string if args_value is string else args_value | tojson | safe %}
+                        {{- args_value }}
+                        {{- '\n</parameter>\n' }}
+                    {%- endfor %}
+                {%- endif %}
+                {{- '</function>\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.previtem and loop.previtem.role != "tool" %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- content }}
+        {{- '\n</tool_response>' }}
+        {%- if not loop.last and loop.nextitem.role != "tool" %}
+            {{- '<|im_end|>\n' }}
+        {%- elif loop.last %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- else %}
+        {{- raise_exception('Unexpected message role.') }}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- else %}
+        {{- '<think>\n' }}
+    {%- endif %}
+{%- endif %}

config.json

@@ -0,0 +1,140 @@
+{
+  "architectures": [
+    "Qwen3_5ForConditionalGeneration"
+  ],
+  "image_token_id": 248056,
+  "language_model_only": false,
+  "model_type": "qwen3_5",
+  "text_config": {
+    "attention_bias": false,
+    "attention_dropout": 0.0,
+    "attn_output_gate": true,
+    "bos_token_id": 248044,
+    "dtype": "bfloat16",
+    "eos_token_id": 248044,
+    "full_attention_interval": 4,
+    "head_dim": 256,
+    "hidden_act": "silu",
+    "hidden_size": 5120,
+    "initializer_range": 0.02,
+    "intermediate_size": 17408,
+    "layer_types": [
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention",
+      "linear_attention",
+      "linear_attention",
+      "linear_attention",
+      "full_attention"
+    ],
+    "linear_conv_kernel_dim": 4,
+    "linear_key_head_dim": 128,
+    "linear_num_key_heads": 16,
+    "linear_num_value_heads": 48,
+    "linear_value_head_dim": 128,
+    "mamba_ssm_dtype": "float32",
+    "max_position_embeddings": 262144,
+    "model_type": "qwen3_5_text",
+    "mtp_num_hidden_layers": 1,
+    "mtp_use_dedicated_embeddings": false,
+    "num_attention_heads": 24,
+    "num_hidden_layers": 64,
+    "num_key_value_heads": 4,
+    "output_gate_type": "swish",
+    "pad_token_id": null,
+    "partial_rotary_factor": 0.25,
+    "rms_norm_eps": 1e-06,
+    "rope_parameters": {
+      "mrope_interleaved": true,
+      "mrope_section": [
+        11,
+        11,
+        10
+      ],
+      "partial_rotary_factor": 0.25,
+      "rope_theta": 10000000,
+      "rope_type": "default"
+    },
+    "tie_word_embeddings": false,
+    "use_cache": true,
+    "vocab_size": 248320
+  },
+  "tie_word_embeddings": false,
+  "transformers_version": "4.57.1",
+  "video_token_id": 248057,
+  "vision_config": {
+    "deepstack_visual_indexes": [],
+    "depth": 27,
+    "hidden_act": "gelu_pytorch_tanh",
+    "hidden_size": 1152,
+    "in_channels": 3,
+    "initializer_range": 0.02,
+    "intermediate_size": 4304,
+    "model_type": "qwen3_5",
+    "num_heads": 16,
+    "num_position_embeddings": 2304,
+    "out_hidden_size": 5120,
+    "patch_size": 16,
+    "spatial_merge_size": 2,
+    "temporal_patch_size": 2
+  },
+  "vision_end_token_id": 248054,
+  "vision_start_token_id": 248053
+}

configuration.json

@@ -0,0 +1 @@
+{"framework":"Pytorch","task":"image-text-to-text"}

generation_config.json

@@ -0,0 +1,13 @@
+{
+  "bos_token_id": 248044,
+  "do_sample": true,
+  "eos_token_id": [
+    248046,
+    248044
+  ],
+  "pad_token_id": 248044,
+  "temperature": 1.0,
+  "top_k": 20,
+  "top_p": 0.95,
+  "transformers_version": "5.9.0"
+}

kaiju-merge-manifest.json

@@ -0,0 +1,17 @@
+{
+  "adapter": "/workspace/kaiju-coder/runs/qwen36-27b-lora-v1.8-business-owner/adapter",
+  "attn_implementation": "sdpa",
+  "base_model": "/workspace/kaiju-coder/models/Qwen3.6-27B",
+  "copied_base_sidecars": [
+    "preprocessor_config.json",
+    "video_preprocessor_config.json",
+    "vocab.json",
+    "merges.txt",
+    "configuration.json"
+  ],
+  "device_map": "auto",
+  "dtype": "torch.bfloat16",
+  "max_shard_size": "4GB",
+  "output_dir": "/workspace/kaiju-coder/models/Kaiju-Coder-Qwen3.6-27B-v1.8-merged",
+  "preserved_base_config": true
+}

model-00001-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:994d372da0812952c05a3fb1093db5b1245e314385290892f0dce3883f4c2643
+size 2542796928

model-00002-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4878748a25512bacb544e85e40836a4fcecb3743a3e692271b80034bc95c0349
+size 3897624936

model-00003-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:353ff0b588a1bcf7036b3dcd389f4e1dbeb331649cc4fb3a536ac1c530a07c7f
+size 3988983480

model-00004-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2dc161642c42bce8c857d30fe116a30fbec1e9759fc0ff99226ba4249d949ab9
+size 3957507000

model-00005-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e0ba05394a91e792be56d53b9d617bae38ae4153d410b2adae38b9680e3cd6d
+size 3873619464

model-00006-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db1fea86bcaca2f1eeaa393b3e9ed3612058acc07982605966ca11e4a48067f6
+size 3988962816

model-00007-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:991d211462416f84603bcad3709bb2cb39ca4e739d2cc85ea2b97e9e23bdbe91
+size 3945964456

model-00008-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3483733b734e5b83aa1416f5d77511599fad67a47311be48c6cc521e5b4656b
+size 3831666800

model-00009-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e6a20e6662125b644c0e8eb98f0ed0c0256909487a4000185658c96b7bb2ce3
+size 3990049344

model-00010-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:73de119646ab221c1ee39c4bbf6c3434253d8660f033536f0419801eadf3750b
+size 3987897024

model-00011-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de6b00388b22b8a4a3ab10ca8784f7ff4c0bdf60e6614d6c008893c5d91d29cd
+size 3842163712

model-00012-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:980e5afe6cf660e15c3ced9f79c429dd778d5cc180cf4712d33475162c1f827e
+size 3988962816

model-00013-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9befeac4d999cd15fa085d4a1a70fc2292446ceb839bbcb0a3953057ce08f86e
+size 3988962816

model-00014-of-00014.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3ddb6acc0578997b79761e66b223a4024db3e6341718a2bfb8ec56311d8d3801
+size 3966947216

model.safetensors.index.json

@@ -0,0 +1,859 @@
+{
+  "metadata": {
+    "total_parameters": 26895998464,
+    "total_size": 53791996928
+  },
+  "weight_map": {
+    "lm_head.weight": "model-00001-of-00014.safetensors",
+    "model.language_model.embed_tokens.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.input_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.A_log": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.conv1d.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.dt_bias": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.in_proj_a.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.in_proj_b.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.in_proj_qkv.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.in_proj_z.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.norm.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.linear_attn.out_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.mlp.up_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.0.post_attention_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.input_layernorm.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.A_log": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.conv1d.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.dt_bias": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.in_proj_a.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.in_proj_b.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.in_proj_qkv.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.in_proj_z.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.norm.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.linear_attn.out_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.mlp.down_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.mlp.gate_proj.weight": "model-00002-of-00014.safetensors",
+    "model.language_model.layers.1.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.1.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.10.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.A_log": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.conv1d.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.dt_bias": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.in_proj_a.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.in_proj_b.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.in_proj_qkv.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.in_proj_z.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.linear_attn.out_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.10.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.11.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.A_log": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.conv1d.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.dt_bias": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.in_proj_a.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.in_proj_b.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.in_proj_qkv.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.in_proj_z.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.12.linear_attn.out_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.12.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.12.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.12.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.12.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.A_log": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.conv1d.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.dt_bias": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.in_proj_a.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.in_proj_b.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.in_proj_qkv.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.in_proj_z.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.linear_attn.out_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.13.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.A_log": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.conv1d.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.dt_bias": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.in_proj_a.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.in_proj_b.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.in_proj_qkv.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.in_proj_z.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.linear_attn.out_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.14.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.k_norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.k_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.o_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.q_norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.q_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.15.self_attn.v_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.A_log": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.conv1d.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.dt_bias": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.in_proj_a.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.in_proj_b.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.in_proj_qkv.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.in_proj_z.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.linear_attn.out_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.mlp.down_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.mlp.gate_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.mlp.up_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.16.post_attention_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.input_layernorm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.A_log": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.conv1d.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.dt_bias": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.in_proj_a.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.in_proj_b.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.in_proj_qkv.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.in_proj_z.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.norm.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.linear_attn.out_proj.weight": "model-00005-of-00014.safetensors",
+    "model.language_model.layers.17.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.17.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.17.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.17.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.A_log": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.conv1d.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.dt_bias": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.in_proj_a.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.in_proj_b.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.in_proj_qkv.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.in_proj_z.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.linear_attn.out_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.18.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.k_norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.k_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.o_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.q_norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.q_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.19.self_attn.v_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.2.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.A_log": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.conv1d.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.dt_bias": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.in_proj_a.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.in_proj_b.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.in_proj_qkv.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.in_proj_z.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.linear_attn.out_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.2.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.20.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.A_log": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.conv1d.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.dt_bias": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.in_proj_a.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.in_proj_b.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.in_proj_qkv.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.in_proj_z.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.linear_attn.out_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.20.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.A_log": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.conv1d.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.dt_bias": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.in_proj_a.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.in_proj_b.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.in_proj_qkv.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.in_proj_z.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.linear_attn.out_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.mlp.gate_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.mlp.up_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.21.post_attention_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.input_layernorm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.A_log": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.conv1d.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.dt_bias": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.in_proj_a.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.in_proj_b.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.in_proj_qkv.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.in_proj_z.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.norm.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.linear_attn.out_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.mlp.down_proj.weight": "model-00006-of-00014.safetensors",
+    "model.language_model.layers.22.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.22.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.22.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.o_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.q_norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.q_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.23.self_attn.v_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.A_log": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.conv1d.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.dt_bias": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.in_proj_a.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.in_proj_b.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.in_proj_qkv.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.in_proj_z.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.linear_attn.out_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.24.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.A_log": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.conv1d.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.dt_bias": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.in_proj_a.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.in_proj_b.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.in_proj_qkv.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.in_proj_z.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.linear_attn.out_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.25.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.A_log": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.conv1d.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.dt_bias": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.in_proj_a.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.in_proj_b.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.in_proj_qkv.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.in_proj_z.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.linear_attn.out_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.26.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.input_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.mlp.down_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.mlp.gate_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.mlp.up_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.post_attention_layernorm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.k_norm.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.k_proj.weight": "model-00007-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.27.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.A_log": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.conv1d.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.dt_bias": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.in_proj_a.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.in_proj_b.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.in_proj_qkv.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.in_proj_z.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.linear_attn.out_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.28.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.A_log": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.conv1d.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.dt_bias": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.in_proj_a.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.in_proj_b.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.in_proj_qkv.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.in_proj_z.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.linear_attn.out_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.29.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.3.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.k_norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.k_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.o_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.q_norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.q_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.3.self_attn.v_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.30.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.A_log": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.conv1d.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.dt_bias": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.in_proj_a.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.in_proj_b.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.in_proj_qkv.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.in_proj_z.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.linear_attn.out_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.30.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.mlp.up_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.post_attention_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.k_norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.k_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.o_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.q_norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.q_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.31.self_attn.v_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.input_layernorm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.A_log": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.conv1d.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.dt_bias": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.in_proj_a.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.in_proj_b.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.in_proj_qkv.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.in_proj_z.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.norm.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.linear_attn.out_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.mlp.down_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.mlp.gate_proj.weight": "model-00008-of-00014.safetensors",
+    "model.language_model.layers.32.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.32.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.A_log": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.conv1d.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.dt_bias": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.in_proj_a.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.in_proj_b.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.in_proj_qkv.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.in_proj_z.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.linear_attn.out_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.33.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.A_log": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.conv1d.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.dt_bias": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.in_proj_a.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.in_proj_b.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.in_proj_qkv.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.in_proj_z.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.linear_attn.out_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.34.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.k_norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.k_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.o_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.q_norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.q_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.35.self_attn.v_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.A_log": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.conv1d.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.dt_bias": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.in_proj_a.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.in_proj_b.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.in_proj_qkv.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.in_proj_z.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.linear_attn.out_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.36.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.A_log": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.conv1d.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.dt_bias": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.in_proj_a.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.in_proj_b.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.in_proj_qkv.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.in_proj_z.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.norm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.linear_attn.out_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.mlp.down_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.mlp.gate_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.mlp.up_proj.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.37.post_attention_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.input_layernorm.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.A_log": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.conv1d.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.dt_bias": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.in_proj_a.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.in_proj_b.weight": "model-00009-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.in_proj_qkv.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.in_proj_z.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.linear_attn.out_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.38.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.k_norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.k_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.o_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.q_norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.q_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.39.self_attn.v_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.4.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.A_log": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.conv1d.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.dt_bias": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.in_proj_a.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.in_proj_b.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.in_proj_qkv.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.in_proj_z.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.linear_attn.out_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.4.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.40.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.A_log": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.conv1d.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.dt_bias": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.in_proj_a.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.in_proj_b.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.in_proj_qkv.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.in_proj_z.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.linear_attn.out_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.40.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.A_log": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.conv1d.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.dt_bias": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.in_proj_a.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.in_proj_b.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.in_proj_qkv.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.in_proj_z.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.linear_attn.out_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.41.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.A_log": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.conv1d.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.dt_bias": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.in_proj_a.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.in_proj_b.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.in_proj_qkv.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.in_proj_z.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.norm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.linear_attn.out_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.mlp.gate_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.mlp.up_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.42.post_attention_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.43.input_layernorm.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.43.mlp.down_proj.weight": "model-00010-of-00014.safetensors",
+    "model.language_model.layers.43.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.43.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.A_log": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.conv1d.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.dt_bias": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.in_proj_a.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.in_proj_b.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.in_proj_qkv.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.in_proj_z.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.linear_attn.out_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.44.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.A_log": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.conv1d.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.dt_bias": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.in_proj_a.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.in_proj_b.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.in_proj_qkv.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.in_proj_z.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.linear_attn.out_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.45.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.A_log": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.conv1d.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.dt_bias": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.in_proj_a.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.in_proj_b.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.in_proj_qkv.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.in_proj_z.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.linear_attn.out_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.46.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.mlp.down_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.mlp.gate_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.mlp.up_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.post_attention_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.k_norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.k_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.o_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.q_norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.q_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.47.self_attn.v_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.input_layernorm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.A_log": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.conv1d.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.dt_bias": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.in_proj_a.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.in_proj_b.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.in_proj_qkv.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.in_proj_z.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.norm.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.linear_attn.out_proj.weight": "model-00011-of-00014.safetensors",
+    "model.language_model.layers.48.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.48.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.48.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.48.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.A_log": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.conv1d.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.dt_bias": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.in_proj_a.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.in_proj_b.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.in_proj_qkv.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.in_proj_z.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.linear_attn.out_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.49.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.5.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.A_log": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.conv1d.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.dt_bias": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.in_proj_a.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.in_proj_b.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.in_proj_qkv.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.in_proj_z.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.linear_attn.out_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.5.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.50.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.A_log": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.conv1d.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.dt_bias": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.in_proj_a.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.in_proj_b.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.in_proj_qkv.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.in_proj_z.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.linear_attn.out_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.50.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.k_norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.k_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.o_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.q_norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.q_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.51.self_attn.v_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.A_log": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.conv1d.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.dt_bias": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.in_proj_a.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.in_proj_b.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.in_proj_qkv.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.in_proj_z.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.linear_attn.out_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.mlp.gate_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.mlp.up_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.52.post_attention_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.input_layernorm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.A_log": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.conv1d.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.dt_bias": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.in_proj_a.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.in_proj_b.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.in_proj_qkv.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.in_proj_z.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.norm.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.linear_attn.out_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.mlp.down_proj.weight": "model-00012-of-00014.safetensors",
+    "model.language_model.layers.53.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.53.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.53.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.A_log": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.conv1d.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.dt_bias": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.in_proj_a.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.in_proj_b.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.in_proj_qkv.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.in_proj_z.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.linear_attn.out_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.54.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.k_norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.k_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.o_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.q_norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.q_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.55.self_attn.v_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.A_log": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.conv1d.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.dt_bias": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.in_proj_a.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.in_proj_b.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.in_proj_qkv.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.in_proj_z.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.linear_attn.out_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.56.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.A_log": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.conv1d.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.dt_bias": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.in_proj_a.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.in_proj_b.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.in_proj_qkv.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.in_proj_z.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.linear_attn.out_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.mlp.up_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.57.post_attention_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.input_layernorm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.A_log": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.conv1d.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.dt_bias": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.in_proj_a.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.in_proj_b.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.in_proj_qkv.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.in_proj_z.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.norm.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.linear_attn.out_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.mlp.down_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.mlp.gate_proj.weight": "model-00013-of-00014.safetensors",
+    "model.language_model.layers.58.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.58.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.mlp.gate_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.k_norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.k_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.o_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.q_norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.q_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.59.self_attn.v_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.6.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.A_log": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.conv1d.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.dt_bias": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.in_proj_a.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.in_proj_b.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.in_proj_qkv.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.in_proj_z.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.norm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.linear_attn.out_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.mlp.down_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.mlp.gate_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.mlp.up_proj.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.6.post_attention_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.60.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.A_log": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.conv1d.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.dt_bias": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.in_proj_a.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.in_proj_b.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.in_proj_qkv.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.in_proj_z.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.linear_attn.out_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.mlp.gate_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.60.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.A_log": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.conv1d.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.dt_bias": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.in_proj_a.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.in_proj_b.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.in_proj_qkv.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.in_proj_z.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.linear_attn.out_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.mlp.gate_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.61.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.A_log": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.conv1d.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.dt_bias": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.in_proj_a.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.in_proj_b.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.in_proj_qkv.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.in_proj_z.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.linear_attn.out_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.mlp.gate_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.62.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.input_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.mlp.down_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.mlp.gate_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.mlp.up_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.post_attention_layernorm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.k_norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.k_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.o_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.q_norm.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.q_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.63.self_attn.v_proj.weight": "model-00014-of-00014.safetensors",
+    "model.language_model.layers.7.input_layernorm.weight": "model-00003-of-00014.safetensors",
+    "model.language_model.layers.7.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.k_norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.k_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.o_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.q_norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.q_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.7.self_attn.v_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.A_log": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.conv1d.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.dt_bias": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.in_proj_a.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.in_proj_b.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.in_proj_qkv.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.in_proj_z.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.linear_attn.out_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.8.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.input_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.A_log": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.conv1d.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.dt_bias": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.in_proj_a.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.in_proj_b.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.in_proj_qkv.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.in_proj_z.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.norm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.linear_attn.out_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.mlp.down_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.mlp.gate_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.mlp.up_proj.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.layers.9.post_attention_layernorm.weight": "model-00004-of-00014.safetensors",
+    "model.language_model.norm.weight": "model-00014-of-00014.safetensors"
+  }
+}

preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+    "size": {
+        "longest_edge": 16777216,
+        "shortest_edge": 65536
+    },
+    "patch_size": 16,
+    "temporal_patch_size": 2,
+    "merge_size": 2,
+    "image_mean": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "image_std": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "processor_class": "Qwen3VLProcessor",
+    "image_processor_type": "Qwen2VLImageProcessorFast"
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f399b3cd12fa270d51457bb749fb30863521e8359b8a27059c71b6c2f7d6dd6c
+size 19989424

tokenizer_config.json

@@ -0,0 +1,36 @@
+{
+  "add_prefix_space": false,
+  "audio_bos_token": "<|audio_start|>",
+  "audio_eos_token": "<|audio_end|>",
+  "audio_token": "<|audio_pad|>",
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "image_token": "<|image_pad|>",
+  "is_local": true,
+  "local_files_only": false,
+  "max_length": 2048,
+  "model_max_length": 262144,
+  "model_specific_special_tokens": {
+    "audio_bos_token": "<|audio_start|>",
+    "audio_eos_token": "<|audio_end|>",
+    "audio_token": "<|audio_pad|>",
+    "image_token": "<|image_pad|>",
+    "video_token": "<|video_pad|>",
+    "vision_bos_token": "<|vision_start|>",
+    "vision_eos_token": "<|vision_end|>"
+  },
+  "pad_token": "<|endoftext|>",
+  "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+  "split_special_tokens": false,
+  "stride": 0,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "truncation_side": "right",
+  "truncation_strategy": "longest_first",
+  "unk_token": null,
+  "video_token": "<|video_pad|>",
+  "vision_bos_token": "<|vision_start|>",
+  "vision_eos_token": "<|vision_end|>"
+}

upstream/qwen3.6-27b/LICENSE

@@ -0,0 +1,202 @@
+
+                                 Apache License
+                           Version 2.0, January 2004
+                        http://www.apache.org/licenses/
+
+   TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
+
+   1. Definitions.
+
+      "License" shall mean the terms and conditions for use, reproduction,
+      and distribution as defined by Sections 1 through 9 of this document.
+
+      "Licensor" shall mean the copyright owner or entity authorized by
+      the copyright owner that is granting the License.
+
+      "Legal Entity" shall mean the union of the acting entity and all
+      other entities that control, are controlled by, or are under common
+      control with that entity. For the purposes of this definition,
+      "control" means (i) the power, direct or indirect, to cause the
+      direction or management of such entity, whether by contract or
+      otherwise, or (ii) ownership of fifty percent (50%) or more of the
+      outstanding shares, or (iii) beneficial ownership of such entity.
+
+      "You" (or "Your") shall mean an individual or Legal Entity
+      exercising permissions granted by this License.
+
+      "Source" form shall mean the preferred form for making modifications,
+      including but not limited to software source code, documentation
+      source, and configuration files.
+
+      "Object" form shall mean any form resulting from mechanical
+      transformation or translation of a Source form, including but
+      not limited to compiled object code, generated documentation,
+      and conversions to other media types.
+
+      "Work" shall mean the work of authorship, whether in Source or
+      Object form, made available under the License, as indicated by a
+      copyright notice that is included in or attached to the work
+      (an example is provided in the Appendix below).
+
+      "Derivative Works" shall mean any work, whether in Source or Object
+      form, that is based on (or derived from) the Work and for which the
+      editorial revisions, annotations, elaborations, or other modifications
+      represent, as a whole, an original work of authorship. For the purposes
+      of this License, Derivative Works shall not include works that remain
+      separable from, or merely link (or bind by name) to the interfaces of,
+      the Work and Derivative Works thereof.
+
+      "Contribution" shall mean any work of authorship, including
+      the original version of the Work and any modifications or additions
+      to that Work or Derivative Works thereof, that is intentionally
+      submitted to Licensor for inclusion in the Work by the copyright owner
+      or by an individual or Legal Entity authorized to submit on behalf of
+      the copyright owner. For the purposes of this definition, "submitted"
+      means any form of electronic, verbal, or written communication sent
+      to the Licensor or its representatives, including but not limited to
+      communication on electronic mailing lists, source code control systems,
+      and issue tracking systems that are managed by, or on behalf of, the
+      Licensor for the purpose of discussing and improving the Work, but
+      excluding communication that is conspicuously marked or otherwise
+      designated in writing by the copyright owner as "Not a Contribution."
+
+      "Contributor" shall mean Licensor and any individual or Legal Entity
+      on behalf of whom a Contribution has been received by Licensor and
+      subsequently incorporated within the Work.
+
+   2. Grant of Copyright License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      copyright license to reproduce, prepare Derivative Works of,
+      publicly display, publicly perform, sublicense, and distribute the
+      Work and such Derivative Works in Source or Object form.
+
+   3. Grant of Patent License. Subject to the terms and conditions of
+      this License, each Contributor hereby grants to You a perpetual,
+      worldwide, non-exclusive, no-charge, royalty-free, irrevocable
+      (except as stated in this section) patent license to make, have made,
+      use, offer to sell, sell, import, and otherwise transfer the Work,
+      where such license applies only to those patent claims licensable
+      by such Contributor that are necessarily infringed by their
+      Contribution(s) alone or by combination of their Contribution(s)
+      with the Work to which such Contribution(s) was submitted. If You
+      institute patent litigation against any entity (including a
+      cross-claim or counterclaim in a lawsuit) alleging that the Work
+      or a Contribution incorporated within the Work constitutes direct
+      or contributory patent infringement, then any patent licenses
+      granted to You under this License for that Work shall terminate
+      as of the date such litigation is filed.
+
+   4. Redistribution. You may reproduce and distribute copies of the
+      Work or Derivative Works thereof in any medium, with or without
+      modifications, and in Source or Object form, provided that You
+      meet the following conditions:
+
+      (a) You must give any other recipients of the Work or
+          Derivative Works a copy of this License; and
+
+      (b) You must cause any modified files to carry prominent notices
+          stating that You changed the files; and
+
+      (c) You must retain, in the Source form of any Derivative Works
+          that You distribute, all copyright, patent, trademark, and
+          attribution notices from the Source form of the Work,
+          excluding those notices that do not pertain to any part of
+          the Derivative Works; and
+
+      (d) If the Work includes a "NOTICE" text file as part of its
+          distribution, then any Derivative Works that You distribute must
+          include a readable copy of the attribution notices contained
+          within such NOTICE file, excluding those notices that do not
+          pertain to any part of the Derivative Works, in at least one
+          of the following places: within a NOTICE text file distributed
+          as part of the Derivative Works; within the Source form or
+          documentation, if provided along with the Derivative Works; or,
+          within a display generated by the Derivative Works, if and
+          wherever such third-party notices normally appear. The contents
+          of the NOTICE file are for informational purposes only and
+          do not modify the License. You may add Your own attribution
+          notices within Derivative Works that You distribute, alongside
+          or as an addendum to the NOTICE text from the Work, provided
+          that such additional attribution notices cannot be construed
+          as modifying the License.
+
+      You may add Your own copyright statement to Your modifications and
+      may provide additional or different license terms and conditions
+      for use, reproduction, or distribution of Your modifications, or
+      for any such Derivative Works as a whole, provided Your use,
+      reproduction, and distribution of the Work otherwise complies with
+      the conditions stated in this License.
+
+   5. Submission of Contributions. Unless You explicitly state otherwise,
+      any Contribution intentionally submitted for inclusion in the Work
+      by You to the Licensor shall be under the terms and conditions of
+      this License, without any additional terms or conditions.
+      Notwithstanding the above, nothing herein shall supersede or modify
+      the terms of any separate license agreement you may have executed
+      with Licensor regarding such Contributions.
+
+   6. Trademarks. This License does not grant permission to use the trade
+      names, trademarks, service marks, or product names of the Licensor,
+      except as required for reasonable and customary use in describing the
+      origin of the Work and reproducing the content of the NOTICE file.
+
+   7. Disclaimer of Warranty. Unless required by applicable law or
+      agreed to in writing, Licensor provides the Work (and each
+      Contributor provides its Contributions) on an "AS IS" BASIS,
+      WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
+      implied, including, without limitation, any warranties or conditions
+      of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
+      PARTICULAR PURPOSE. You are solely responsible for determining the
+      appropriateness of using or redistributing the Work and assume any
+      risks associated with Your exercise of permissions under this License.
+
+   8. Limitation of Liability. In no event and under no legal theory,
+      whether in tort (including negligence), contract, or otherwise,
+      unless required by applicable law (such as deliberate and grossly
+      negligent acts) or agreed to in writing, shall any Contributor be
+      liable to You for damages, including any direct, indirect, special,
+      incidental, or consequential damages of any character arising as a
+      result of this License or out of the use or inability to use the
+      Work (including but not limited to damages for loss of goodwill,
+      work stoppage, computer failure or malfunction, or any and all
+      other commercial damages or losses), even if such Contributor
+      has been advised of the possibility of such damages.
+
+   9. Accepting Warranty or Additional Liability. While redistributing
+      the Work or Derivative Works thereof, You may choose to offer,
+      and charge a fee for, acceptance of support, warranty, indemnity,
+      or other liability obligations and/or rights consistent with this
+      License. However, in accepting such obligations, You may act only
+      on Your own behalf and on Your sole responsibility, not on behalf
+      of any other Contributor, and only if You agree to indemnify,
+      defend, and hold each Contributor harmless for any liability
+      incurred by, or claims asserted against, such Contributor by reason
+      of your accepting any such warranty or additional liability.
+
+   END OF TERMS AND CONDITIONS
+
+   APPENDIX: How to apply the Apache License to your work.
+
+      To apply the Apache License to your work, attach the following
+      boilerplate notice, with the fields enclosed by brackets "[]"
+      replaced with your own identifying information. (Don't include
+      the brackets!)  The text should be enclosed in the appropriate
+      comment syntax for the file format. We also recommend that a
+      file or class name and description of purpose be included on the
+      same "printed page" as the copyright notice for easier
+      identification within third-party archives.
+
+   Copyright 2026 Alibaba Cloud
+
+   Licensed under the Apache License, Version 2.0 (the "License");
+   you may not use this file except in compliance with the License.
+   You may obtain a copy of the License at
+
+       http://www.apache.org/licenses/LICENSE-2.0
+
+   Unless required by applicable law or agreed to in writing, software
+   distributed under the License is distributed on an "AS IS" BASIS,
+   WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+   See the License for the specific language governing permissions and
+   limitations under the License.

video_preprocessor_config.json

@@ -0,0 +1,21 @@
+{
+    "size": {
+        "longest_edge": 25165824,
+        "shortest_edge": 4096
+    },
+    "patch_size": 16,
+    "temporal_patch_size": 2,
+    "merge_size": 2,
+    "image_mean": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "image_std": [
+        0.5,
+        0.5,
+        0.5
+    ],
+    "processor_class": "Qwen3VLProcessor",
+    "video_processor_type": "Qwen3VLVideoProcessor"
+}