Burnmydays Claude Opus 4.8 (1M context) commited on
Commit
e0e2511
·
1 Parent(s): 39fba4e

docs: refresh TODO — completed work to bottom, remaining at top

Browse files

Moves this session's completed items (Codex parser fix, --all, instructions,
10-operator tokscale wild corpus, Supabase migration + board sync) to DONE.
Top is now: deploy/Space secrets, Codex handoff to SunrisesIllNeverSee with
the remaining attributable commits, submission tasks, optional/blocked. Badges
section lists exactly what we're applying for.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

Files changed (1) hide show
  1. TODO.md +62 -50
TODO.md CHANGED
@@ -7,39 +7,43 @@ Completed items are at the BOTTOM. Everything still TO DO is up top.
7
  # ⚡ TO DO — DO NOT FORGET
8
  ═══════════════════════════════════════════════════════════════════
9
 
10
- ### A. Turn persistence ON (HF Space Settings Variables and secrets)
11
- - **Keys live in `SECRETS.local.md`** (gitignored, NOT uploaded). Copy `SUPABASE_URL` + `SUPABASE_ANON_KEY` into the Space secrets.
12
- - Curated mode = set ONLY those two on the public Space (leave `service_role` OFF so visitor pastes stay transient).
13
- - DB verified live: anon read returns 7 rows, anon write blocked (401). Just needs the secrets set on the Space.
14
-
15
- ### B. Blocked on owner (data / quality)
16
- - [ ] FIX 3 re-pull clean tokscale numbers, add "MCH (tokscale read)" as a LABELED instrument-comparison row.
17
- - [ ] FIX 5 — (optional, pre-record) install MiniCPM deps for REAL narration: `.venv/bin/python -m pip install torch transformers accelerate sentencepiece`
18
-
19
- ### C. Reserved for Codex (earns the $10k attribution — do AFTER repo is in the org)
20
- - [ ] Refine 2:1 anchor turn-delta method (keep 2:1 fallback)
21
- - [ ] `test_metrics.py` — lock Υ 18,437 / lev 2042 / X 3.31 / telescoping
22
- - [ ] Real Codex `$/1M` via OpenAI prices in `parse_codex` meta
23
- - [ ] Board visual marker on estimated (Codex) rows
24
-
25
- ### D. NEXT BUILD — automatic importer (her-style, paste = backup)
26
- - [ ] Clean/sleek local importer that auto-reads ccusage (no paste, local-first). Design in SCRATCHPAD.md.
27
-
28
- ### E. Submission (non-negotiable)
29
- - [ ] Move Space into `build-small-hackathon` org
30
- - [ ] Record 60s demo video + paste link in README
31
- - [ ] Social post (X/LinkedIn) + paste link in README
 
 
 
 
32
 
33
  ═══════════════════════════════════════════════════════════════════
34
- # 📋 REFERENCE (for the remaining submission tasks)
35
  ═══════════════════════════════════════════════════════════════════
36
 
37
  ## DEMO VIDEO — 60-sec script (open cold on the board)
38
- 1. (0-10s) Open ON the leaderboard. Don't explain. Let the eye hit the 4-orders Υ gap.
39
  "This is every operator's token usage, ranked by one number."
40
  2. (10-25s) Point at $/1M column. "The operator at the top is also the cheapest.
41
  Efficiency isn't a tradeoff against cost — it IS the cost."
42
- 3. (25-45s) Go to Measure Yourself. Paste a live `ccusage --json`. Hit compute.
43
  New operator drops onto the board in real time with a narrated profile.
44
  4. (45-60s) "Υ = cache × output over input squared. You can't buy rank with volume —
45
  padding input is penalized quadratically. That's the whole game." End on board.
@@ -50,34 +54,42 @@ the token economy. Paste your ccusage output, get ranked by Net Volumetric Yield
50
  the metric where volume can't buy rank. A 0.5B MiniCPM narrates your architecture.
51
  🍄 Thousand Token Wood. [link]"
52
 
53
- ## BADGES IN REACH (mostly engineered — confirm in README/tags)
54
- - [x] Off Brand ($1,500) — custom non-default UI ✓ (theme.py)
55
- - [x] Tiny Titan ($1,500) — ≤4B model ✓ (0.5B)
56
- - [ ] Best Demo ($1,000) — needs the video to land
57
- - [x] Best MiniCPM sponsor ($2,500) — built on MiniCPM ✓
58
- - [ ] Codex sponsor ($10k) — needs Codex-attributed commits (see CODEX.md)
 
59
  - [x] Model ≤32B confirmed (MiniCPM4-0.5B)
60
 
61
  ═══════════════════════════════════════════════════════════════════
62
  # ✅ DONE
63
  ═══════════════════════════════════════════════════════════════════
64
 
65
- ## CODE done
66
- - [x] metrics.py engine, 4 ints in, full ledger (incl Avg $/1M)
67
- - [x] ingest.py — ccusage parser (any shape) + Codex parser (2:1 anchor, clamped, flagged) + four-number fallback
68
- - [x] narrate.py — MiniCPM4-0.5B, non-blocking, template fallback
69
- - [x] theme.py gold/dark CSS, log-scaled Υ bars, 8-col board grid
70
- - [x] app.pyboard_html hero (with $/1M column) on BOTH tabs; profile; measure-yourself
71
- - [x] requirements.txt, README.md
72
- - [x] stress test passes (compile + logic cases)
73
-
74
- ## PERSISTENCE Supabase (this session)
75
- - [x] Table sigrank_operators built + seeded (7 rows), curated RLS, in AppFeeder
76
- - [x] db.py (REST read + service-key upsert) with SEED fallback; app.py wired; requests added
77
- - [x] Verified live: anon read 7 rows, anon write 401-blocked
78
-
79
- ## SEMANTICS fixes (this session)
80
- - [x] FIX 1 persistence-boundary honesty note · FIX 2 cost provenance · FIX 4 species/quadrant reframe · FIX 6 grid check
81
-
82
- ## REPO
83
- - [x] Pushed full build to github.com/Burnmydays/hf- (main = cf4055a)
 
 
 
 
 
 
 
 
7
  # ⚡ TO DO — DO NOT FORGET
8
  ═══════════════════════════════════════════════════════════════════
9
 
10
+ ### A. Deploy to the HF Space (parked until you confirm the Space path)
11
+ - [ ] Confirm how code reaches the Space (HF git remote vs GitHub auto-sync vs manual).
12
+ - [ ] Set Space secrets (Settings Variables and secrets) from `SECRETS.local.md`:
13
+ `SUPABASE_URL` + `SUPABASE_ANON_KEY` (read). Add `SUPABASE_SERVICE_KEY` ONLY if
14
+ you want HF-authed visitor rows to persist (curated demo can leave it off).
15
+ - DB is live and ready: board reads **11 rows** (MO§ES + 10 tokscale) via anon; anon
16
+ write blocked; `sigrank_sessions` table + Greatest Hits read path verified.
17
+
18
+ ### B. Hand off to Codex → upload to github.com/SunrisesIllNeverSee
19
+ - [ ] Codex uploads the repo to your SunrisesIllNeverSee GitHub.
20
+ - [ ] **Codex-attributed commits for the $10k prize** (must be genuinely Codex's work):
21
+ - [ ] `test_metrics.py` — lock Υ 18,437 / lev 2042 / X 3.31 + telescoping for every SEED row.
22
+ - [ ] Real Codex `$/1M` via OpenAI per-1M prices in `parse_codex_submission` meta.
23
+ - NOTE: the 2:1→real-ratio anchor refinement and the estimated-row `~` marker were
24
+ already done this session (Claude), so they're no longer available as Codex commits.
25
+
26
+ ### C. Submission (non-negotiable)
27
+ - [ ] Move Space into `build-small-hackathon` org.
28
+ - [ ] Record 60s demo video (script below) + paste link in README.
29
+ - [ ] Social post (X/LinkedIn, draft below) + paste link in README.
30
+ - [ ] Add a link back to your GitHub (SunrisesIllNeverSee) in the README.
31
+
32
+ ### D. Optional / blocked
33
+ - [ ] FIX 3 — add "MCH (tokscale read)" as a LABELED instrument-comparison row (your re-pull).
34
+ - [ ] FIX 5 — (pre-record only) install MiniCPM deps for REAL narration:
35
+ `.venv/bin/python -m pip install torch transformers accelerate sentencepiece`
36
 
37
  ═══════════════════════════════════════════════════════════════════
38
+ # 📋 REFERENCE
39
  ═══════════════════════════════════════════════════════════════════
40
 
41
  ## DEMO VIDEO — 60-sec script (open cold on the board)
42
+ 1. (0-10s) Open ON the leaderboard. Don't explain. Let the eye hit the ~4-orders Υ gap.
43
  "This is every operator's token usage, ranked by one number."
44
  2. (10-25s) Point at $/1M column. "The operator at the top is also the cheapest.
45
  Efficiency isn't a tradeoff against cost — it IS the cost."
46
+ 3. (25-45s) Go to Clock Your Signal. Run `./sigrank` (or paste `ccusage claude --json`).
47
  New operator drops onto the board in real time with a narrated profile.
48
  4. (45-60s) "Υ = cache × output over input squared. You can't buy rank with volume —
49
  padding input is penalized quadratically. That's the whole game." End on board.
 
54
  the metric where volume can't buy rank. A 0.5B MiniCPM narrates your architecture.
55
  🍄 Thousand Token Wood. [link]"
56
 
57
+ ## BADGES WE'RE APPLYING FOR (confirm this list)
58
+ README tags: `thousand-token-wood` `off-brand` `tiny-titan` `best-demo` `minicpm`
59
+ - [x] **Off Brand** ($1,500) — custom non-default UI ✓ (theme.py gold/dark)
60
+ - [x] **Tiny Titan** ($1,500) — ≤4B model (MiniCPM4-0.5B)
61
+ - [x] **Best MiniCPM** sponsor ($2,500) — built on MiniCPM ✓
62
+ - [ ] **Best Demo** ($1,000) — needs the video to land
63
+ - [ ] **Codex sponsor** ($10k) — needs genuine Codex-attributed commits (see B + CODEX.md)
64
  - [x] Model ≤32B confirmed (MiniCPM4-0.5B)
65
 
66
  ═══════════════════════════════════════════════════════════════════
67
  # ✅ DONE
68
  ═══════════════════════════════════════════════════════════════════
69
 
70
+ ## THIS SESSION (reconcile + importer overhaul + fixes)
71
+ - [x] Reconciled local with Devin's PRs #5/#6 (merged); dropped duplicate claudetodolist.md.
72
+ - [x] **Codex parser fixed** unified Alpha/Beta into one `_codex_input_estimate` helper
73
+ (removed both hardcoded `/9.0` copies). Beta = operator's REAL Claude input/output
74
+ ratio; Alpha = AA 2:1 baseline. Verified both pathways + guard fallback.
75
+ - [x] **`./sigrank --all`** runs each provider in turn; Codex reuses Claude's ratio; one
76
+ failing provider doesn't stop the others.
77
+ - [x] **Instructions sharpened** (app.py Clock Your Signal tab + README How-to-measure):
78
+ measure each provider separately, never bare `ccusage --json`; what/where/where-to-input.
79
+ - [x] **Wild corpus → 10 tokscale.ai operators** (replaces old 6), cited in metrics.py +
80
+ README. All columns populate. MO§ES canonical Υ 18436.98 untouched.
81
+ - [x] **Supabase migration** (via MCP): `submitted_at` + `hf_user` on operators,
82
+ `sigrank_sessions` table + indexes + RLS (anon read / service insert). Verified.
83
+ - [x] **Supabase board synced** to 11 rows (MO§ES + 10 tokscale, real cost stored).
84
+ - [x] Pushed all of the above to github.com/Burnmydays/hf- (main = 39fba4e).
85
+
86
+ ## EARLIER
87
+ - [x] Engine: metrics.py (4 ints → full ledger incl Avg $/1M); telescoping identity.
88
+ - [x] narrate.py MiniCPM4-0.5B, non-blocking, template fallback, @GPU for ZeroGPU.
89
+ - [x] theme.py — gold/dark CSS, log-scaled Υ bars, rarity tiers, board grid.
90
+ - [x] app.py — board hero on both tabs, profile, share card, Greatest Hits, HF login,
91
+ XSS-safe name escaping, `~` estimated marker.
92
+ - [x] db.py — Supabase REST read + service-key upsert + session history, SEED fallback.
93
+ - [x] FIX 1 persistence-boundary honesty · FIX 2 cost provenance · FIX 4 species/quadrant
94
+ reframe · FIX 6 grid check.
95
+ - [x] her-style local importer sigrank.py (auto-reads ccusage, paste = backup).