thundercode commited on
Commit
dfe79b9
·
verified ·
1 Parent(s): ad9cc6a

release: add docs/CHANGELOG.md

Browse files
Files changed (1) hide show
  1. docs/CHANGELOG.md +137 -0
docs/CHANGELOG.md ADDED
@@ -0,0 +1,137 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Changelog
2
+
3
+ All notable changes to SatQuery AI. Dates are ISO-8601. This changelog records **what changed and
4
+ what was verified**, and marks unresolved items honestly rather than omitting them.
5
+
6
+ Status tags: `RESOLVED` · `OPEN` · `CLOSED` · `DEFERRED` · `REJECTED`.
7
+
8
+ ---
9
+
10
+ ## [1.0.0] — 2026-09-25 — Final documentation, model release and archival freeze
11
+
12
+ The release that makes the project legible and citable: repository documentation, research
13
+ documentation, model documentation, a Hugging Face model release, a curated public repository, and a
14
+ verified evidence archive.
15
+
16
+ ### Added
17
+ - **Repository README** (27 sections) — motivation through citation, with the deployed topology, the
18
+ six supported tasks, routing, the eight execution events, measured results, live validation, and
19
+ known limitations.
20
+ - **Research documentation set** — `ARCHITECTURE.md`, `MODELS.md`, `BENCHMARKS.md`, `DATASETS.md`,
21
+ `TRAINING.md`, `EVALUATION.md`, `DEPLOYMENT.md`, `REPRODUCIBILITY.md`, `LIMITATIONS.md`,
22
+ `RESEARCH_NOTES.md`, `CHANGELOG.md`.
23
+ - **Model documentation** — `MODEL_CARD.md`, generated `models/manifest.json` and
24
+ `models/checksums.sha256`.
25
+ - **Hugging Face release** of the six trained artifacts to `thundercode/SatQuery`, with a verification
26
+ record.
27
+ - **Curated public repository** at `Anish-lab-blip/SatQuery-AI` with a release manifest.
28
+ - **Evidence archive** (ZIP64, artifacts verbatim) with an integrity-verified extraction and a
29
+ documented remote location.
30
+ - **Metric verification tool** — `tools/verify_readme_metrics.py`, checking all 20 quoted metrics and
31
+ the status assertions against their artifacts.
32
+
33
+ ### Changed
34
+ - The monorepo `README.md` was **materially stale** and is superseded by this release's README. The
35
+ stale version called the frontend "hermetic — no backend calls", put Render/Codespace as
36
+ "in progress", described a `/v1/*` contract, and pointed at the untracked `deploy/` as the
37
+ deployment source. All four were wrong.
38
+ - `hf/` documentation was **stale** — it asserted the project "does not own any model weights … ships
39
+ no weights, no binaries, and no large artifacts" and "has no Hugging Face credentials". Both were
40
+ false at release time and are corrected.
41
+
42
+ ### Fixed
43
+ - **Router defect** — *"Where are the built-up areas in this image?"* collapsed to `vqa` and answered
44
+ "River". Fixed in the dispatch path and validated across three independent live passes (8/8 each).
45
+ `RESOLVED`.
46
+ - **Live-validation harness false positive** — synthetic CDP key events were silently dropped when the
47
+ window lacked OS focus, so the harness dispatched the page's default query and recorded a false
48
+ pass. Fixed with pre-dispatch form-state assertions. `RESOLVED`.
49
+ - **Bundled EO change pair** — the demo pair differed in shape (726² vs 736²) and errored. Replaced
50
+ with a same-shape pair (both 720×720). `RESOLVED` (supersedes `FINAL_DELIVERY_REPORT.md` §6).
51
+ - **B-01 (Hugging Face header link)** — previously `BLOCKED`; the link is now live on all 11 pages.
52
+ `CLOSED`.
53
+
54
+ ### Known issues at this release
55
+ - **B-07** — transient tunnel-agent gaps; a request can hang or return 504. Patch prepared, **NOT
56
+ deployed**. `OPEN`.
57
+ - **B-02** — `/api/health` `codespace_name` carries a trailing `\n`. Cosmetic. `OPEN`.
58
+ - **No `LICENSE` file** exists. `OPEN`.
59
+ - **No system-level end-to-end benchmark** exists. `NOT RUN`.
60
+ - **Router test split** never scored. `NOT RUN`.
61
+ - **Calibration** worsened ECE (0.013755 → 0.014929). Retained as part of the frozen config only.
62
+ - **VLM adapter** is `ACCEPTANCE-REJECTED` despite usable metrics; the deployed path uses the
63
+ unadapted model.
64
+ - **optical-SAR** and **change-VQA** rulings remain `OPEN`.
65
+
66
+ ### Deployment revisions at this release
67
+ | Component | Revision |
68
+ |---|---|
69
+ | Frontend | `2d7ae53b482d` |
70
+ | Backend | `89d80eaddec5` |
71
+ | Inference | `5a0936ace491` |
72
+ | Public umbrella | `3dcabd32da41` |
73
+
74
+ ---
75
+
76
+ ## [0.9.0] — 2026-09-25 — Router-defect sprint
77
+
78
+ - Diagnosed and fixed the router misroute (region queries → `vqa`).
79
+ - Deployed three commits to the frontend.
80
+ - Ran **3 independent live validation passes**, 8/8 each — 24 live runs, 24 correct dispatches,
81
+ 0 mock nodes, trace fill 94.4444 %.
82
+ - Wrote the delivery report and handoff.
83
+
84
+ ---
85
+
86
+ ## [0.8.0] — 2026-09-24/25 — Deployment hardening
87
+
88
+ - Live topology settled on **Cloudflare Pages → Render → outbound tunnel → Codespace** (CPU).
89
+ - Closed the five historical backend blockers (ASGI stack in requirements; `$PORT` read; `OPTIONS`
90
+ preflight; fail-fast app construction; adapter integrity compared against an expected digest).
91
+ - Documented cold start; `transport_mode: auto` fallthrough recorded.
92
+
93
+ ---
94
+
95
+ ## [0.7.0] — Grounding and change heads
96
+
97
+ - Grounding: trainable head over frozen RemoteCLIP ViT-B/32. Resolution **224 chosen, 448 rejected**
98
+ by a pre-registered paired test.
99
+ - Change: STANet-style Siamese detector on LEVIR-CD-256 — the only `VERIFIED` headline metric.
100
+ - Optical-SAR: CROMA-base fusion head, seed sweep, pre-registered 115-class metric.
101
+
102
+ ---
103
+
104
+ ## [0.6.0] — VLM adaptation
105
+
106
+ - SmolVLM-500M LoRA adapter trained (PEFT 0.19.1, r = 16, α = 32).
107
+ - Metrics usable (exact_match 0.963) but **acceptance-rejected** for promotion. `REJECTED`.
108
+ - Findings F5-1/F5-2/F5-3 recorded (loader class, ~17× processor overrun, chat-template requirement).
109
+
110
+ ---
111
+
112
+ ## [0.5.0] — Router
113
+
114
+ - 50,822-parameter adapter over frozen MiniLM; cached embeddings; CPU-only training (0.28 s for 20
115
+ epochs / 4,096 vectors).
116
+ - Group-based splits with hard negatives in the test split.
117
+
118
+ ---
119
+
120
+ ## [0.1.0] — Foundation
121
+
122
+ - Monorepo, frozen configuration registry (`configs/base.yaml`), config-hash freeze
123
+ (`78f1e3700da15aa1`), nine-state controller, four-endpoint inference contract, evidence schema
124
+ (`Region` / `ChangeRegion`), eight frontend execution events.
125
+
126
+ ---
127
+
128
+ ## Unreleased / open
129
+
130
+ | Item | State |
131
+ |---|---|
132
+ | Deploy the B-07 tunnel-fallthrough fix | prepared, **NOT deployed** |
133
+ | Score the router test split | **NOT RUN** |
134
+ | Build a system-level end-to-end benchmark | **NOT RUN** |
135
+ | Select a licence | **OPEN** |
136
+ | Resolve the optical-SAR and change-VQA rulings | **OPEN** |
137
+ | Plot the calibrated reliability curve | **NOT RUN** |