Commit History
-
Spike v0.0 laydown + spike 001 VALIDATED
Decompose v0.0 into 4 risk-ordered sub-spikes: - 001 teacher-replay-cost (kill-switch, ✅ EXECUTED + VALIDATED in this commit) - 002a trace-collection-trl (planned) - 002b trace-collection-prime-rl (comparison-spike) - 003 dpo-pairs-from-disagreement (planned) - 004 ab-train-grpo-vs-trace-replay-dpo (terminal experiment) Spike 001 result (real, not scaffolding): - 150 teacher API calls (Opus 4.7 + GPT-5 + DeepSeek V4 Pro via OpenRouter) - 50 synthesized agentic-coding states as fixture - 0 errors, total spend $0.98 - Mean per-trace cost: $0.98 (target: <$5) ✅ — 5x headroom - p95 step latency: 20.5s (target: <30s) ✅ - p99 step latency: 23.2s (target: <60s) ✅ - Cost composition: Opus dominates ($0.81 of $0.98); DeepSeek + GPT-5 essentially free This validates the framework's central economic claim. Even ungated (no VOI, no tiered teachers), cost is ~$1/trace not $64/trace. With VOI gating in v0.1 we project ~$0.30/trace. Trace-replay-distillation is economically viable. Files: - spikes…35581fd