File size: 3,648 Bytes
1ba301a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 | === NPC Reason - Dispatch 4: Packaging + Card ===
GGUF: f16 / q8_0 / q4_K_M of the shipped RL model (rl/merged), built with llama.cpp (CUDA).
Decision-fidelity vs bf16 on 100 frozen-eval problems (greedy, frozen verifier d5d146cf):
f16 dVC +0.0 OK
q8_0 dVC +0.0 OK <- RECOMMENDED (behaviorally lossless, 1.9 GB)
q4_K_M dVC +6.0 DRIFTS (exceeds +/-2pp) -> flagged, NOT recommended
The Fin Nano lesson reproduced: q4 is structurally valid but changes decisions under quant
noise. Do not pick a quant on file size alone. (reports/gguf_fidelity.md)
Card: MODEL_CARD.md - full base/SFT/RL arc (verifiable 0 -> 76.8 -> 76.2; v&c 0 -> 58.0 -> 59.6;
accuracy 61.6 -> 65.8 -> 66.6), distillation-did-the-heavy-lifting, RLVR-stable-but-small
(~tied with SFT), 90% verifiable bar NOT met (stated as the open limitation), verifier
d5d146cf documented as BOTH the metric AND the reward, MIT/V4 lineage, attribution
Rama Krishna Bachu / Bottensor / ORCID 0009-0000-1298-0681. No overclaiming, no em dashes.
USAGE.md - format prompt + vLLM/GGUF run + how to run the verifier on outputs.
Release tree (release/, 22 curated text files; model + GGUF binaries referenced separately):
MODEL_CARD.md, USAGE.md
verifier/ (step_verifier.py + VERIFIER.lock) <- the product: users verify chains
eval/ (run_eval.py, eval_set.jsonl, _eval_meta.json, EVAL.lock)
tests/ (test_verifier.py)
prereg/ (PREREG.md + PREREG.lock)
locks/ (BASELINE / TRAINSET / SFT_RESULT / RL_RESULT .lock)
reports/ (baseline, sft_result, dispatch1/2/3_complete, gguf_fidelity, fidelity_result.json)
MODEL BINARIES (push-time): rl/merged/ (bf16, shipped) + gguf/{f16,q8_0,q4_K_M}.
EXCLUDED (de-link / methodology / secrets-touching): decisions.md, data/generate_v4.py
(DeepSeek API code), all *.sh run/build scripts, raw logs, reward_stats, training scripts.
Credential scan: CLEAN (HARD-HALT gate PASSED). Adversarial multi-angle audit (5 independent
auditors + reconciling synthesizer, all CLEAN, independently re-verified on the host):
- strict secret regex (sk-/hf_/ghp_/gho_/AKIA/xox*/AIza/BEGIN PRIVATE KEY): zero matches.
- all 5 known chat-leaked key prefixes (DeepSeek / HF x2 / CoinGecko / OpenAI-style): absent.
- "DEEPSEEK_API_KEY" string: absent from release/ (only in excluded generate_v4.py + decisions.md).
- release .py files: local model-load + SymPy only, no os.environ/network/auth.
- false-positives dismissed: SHA-256 hashes, env-var NAMES, tokenizer vocab tokens, a GSM8K
"secret seasoning" word problem.
Push: NOT done (prep only, per dispatch). Preconditions before a push dispatch runs:
1. Operator supplies HF org/repo name and confirms PRIVATE.
2. Operator ROTATES the DeepSeek key (still outstanding; it passed through chat).
3. At push time, re-confirm a FULL (not sampled) credential scan against the EXACT push
manifest IF model binaries (gguf/safetensors) are bundled (they live outside release/
and were sampled-clean: safetensors header no-secret, gguf strings clean).
4. Apply the same de-link discipline used for the BigBugAI HF push (no lineage docs).
Decisions np-015..np-018 logged. 7 frozen locks intact (no training/eval-logic changes this dispatch).
Project complete: base 0% -> SFT 76.8% -> RL 76.2%/59.6% v&c, verifier-grounded, honestly reported.
|