[KM-644] report: drop Notes/Unresolved/Method sections from rendered markdown (compact report)

Team decision 2026-07-09: the rendered report drops "Notes & Limitations",
"Attempted, Unresolved", and "How This Was Analyzed" (render blocks commented
out, restorable). JSON body unchanged: caveats/open_questions/unresolved/
method_steps still populate AnalysisReport, so the /records curation flow and
exclude_record_ids semantics are unaffected. "Excluded Analyses" stays.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

API_CONTRACT_BE_PYTHON.md

@@ -412,7 +412,7 @@ Response `200`:
 ]
 ```
 
-`substantive: false` means no `analyze_*` step succeeded — that run would land under "Attempted, Unresolved" rather than the findings body. If no runs exist, returns `[]`.
+`substantive: false` means no `analyze_*` step succeeded — that run is listed in the report's `unresolved` JSON field rather than the findings body. (Since 2026-07-09 the rendered markdown is compact and no longer includes "Attempted, Unresolved" / "Notes & Limitations" / "How This Was Analyzed" sections; the JSON fields `unresolved` / `caveats` / `open_questions` / `method_steps` are unchanged.) If no runs exist, returns `[]`.
 
 ### `GET /api/v1/tools/report/{analysis_id}/readiness` (added 2026-07-09)
 

REPO_STATUS.md

@@ -2,7 +2,7 @@
 
 **Audience:** teammates onboarding onto the Python repo (`Agentic-Service-Data-Eyond-Catalog`).
 **Scope:** what the code does **right now** (branch `pr/4`, ticket KM-652). Describes current state only — no roadmap or to-dos.
-**Snapshot date:** 2026-06-25. **Data-layer reconcile 2026-07-01:** §8/§12 updated — dedorch cutover done, `data_catalog` model reconciled. **Query-path fix 2026-07-02:** §8/§13 — dedorch catalogs ship no FKs → Python infers them (`fk_inference.py`); shared-Fernet-key gotcha documented. **Agent-quality fixes 2026-07-08 (pr/13):** from the scoped live-test review — the planner gains an explicit **infeasible** outcome (`TaskList.infeasible_reason` → deterministic EN/ID data-gap reply via `refusals.data_gap_message`; no more force-mapping absent measures like `pa` AS "revenue"), the IR validator rejects bare selects under `group_by` (self-corrects via the planner retry), `analyze_trend` handles integer year/month columns (was collapsing every row into one 1970-01 bucket), planner few-shots add top-N (Example G) + infeasible (Example H), numeric catalog `sample_values` are base64-decoded at read (`catalog/sample_decode.py` — stopgap for Go's byte-marshaling; primary fix is Go-side), traceability no longer emits null source rows for failed retrievals, and `check_data` hides `-1` row counts. **Report v2 + analyze_merge planner support 2026-07-09 (pr/13):** Sofia's `analyze_merge` tool (8abf635, KM-703) is now planner-supported (`_validate_data_source` guards `data_right`, two-retrieve→merge few-shot Example I, planner.md "Two measures per entity" rule); the report gains per-business-question answers (`bq_answers` — drafted by the SAME single LLM call, index-based record refs, deterministic fallback unchanged), "Attempted, Unresolved" + "Excluded Analyses" sections (failed runs are no longer silently dropped), evidence tables copied from `results_snapshot` (table-kind outputs, ≤3/record ≤10 rows ≤8 cols, `check_*` skipped), normalized caveat dedupe with caps (12/10), and single-language output via `detect_reply_language`; the report surface adds `GET /tools/report/{analysis_id}/records` (curation list), `GET …/readiness` (FE delta guard), and `exclude_record_ids` on POST — see API_CONTRACT_BE_PYTHON.md. **Cross-repo update 2026-06-29:** §2/§8/§11/§12 re-verified against
+**Snapshot date:** 2026-06-25. **Data-layer reconcile 2026-07-01:** §8/§12 updated — dedorch cutover done, `data_catalog` model reconciled. **Query-path fix 2026-07-02:** §8/§13 — dedorch catalogs ship no FKs → Python infers them (`fk_inference.py`); shared-Fernet-key gotcha documented. **Agent-quality fixes 2026-07-08 (pr/13):** from the scoped live-test review — the planner gains an explicit **infeasible** outcome (`TaskList.infeasible_reason` → deterministic EN/ID data-gap reply via `refusals.data_gap_message`; no more force-mapping absent measures like `pa` AS "revenue"), the IR validator rejects bare selects under `group_by` (self-corrects via the planner retry), `analyze_trend` handles integer year/month columns (was collapsing every row into one 1970-01 bucket), planner few-shots add top-N (Example G) + infeasible (Example H), numeric catalog `sample_values` are base64-decoded at read (`catalog/sample_decode.py` — stopgap for Go's byte-marshaling; primary fix is Go-side), traceability no longer emits null source rows for failed retrievals, and `check_data` hides `-1` row counts. **Report v2 + analyze_merge planner support 2026-07-09 (pr/13):** Sofia's `analyze_merge` tool (8abf635, KM-703) is now planner-supported (`_validate_data_source` guards `data_right`, two-retrieve→merge few-shot Example I, planner.md "Two measures per entity" rule); the report gains per-business-question answers (`bq_answers` — drafted by the SAME single LLM call, index-based record refs, deterministic fallback unchanged), "Attempted, Unresolved" + "Excluded Analyses" sections (failed runs are no longer silently dropped), evidence tables copied from `results_snapshot` (table-kind outputs, ≤3/record ≤10 rows ≤8 cols, `check_*` skipped), normalized caveat dedupe with caps (12/10), and single-language output via `detect_reply_language`; the report surface adds `GET /tools/report/{analysis_id}/records` (curation list), `GET …/readiness` (FE delta guard), and `exclude_record_ids` on POST — see API_CONTRACT_BE_PYTHON.md. **Report compaction 2026-07-09 (pr/13):** the rendered markdown drops the "Notes & Limitations", "Attempted, Unresolved", and "How This Was Analyzed" sections (team decision — compact report; render blocks commented out in `report/generator.py`, not deleted). The JSON body keeps `caveats`/`open_questions`/`unresolved`/`method_steps` and the curation/records endpoints are unchanged. **Cross-repo update 2026-06-29:** §2/§8/§11/§12 re-verified against
 the **Go source** (`Orchestrator-Agent-Service`), not its docs. The Go service has moved well past its
 own (uncommitted, stale) design docs: it now hosts the **dedorch SQL migrations** in-repo and a full
 **`/api/v1/analyses` + `/api/v1/skills`** REST surface. Go does **not** call Python yet — those skills

src/agents/report/generator.py

@@ -464,23 +464,29 @@ def _render_markdown(report: AnalysisReport) -> str:
             )
         parts.append("\n".join(lines))
 
-    if report.caveats or report.open_questions:
-        lines = ["## Notes & Limitations"]
-        for n in report.caveats:
-            lines.append(f"- {_mdx_escape(n.text)}")
-        for n in report.open_questions:
-            lines.append(f"- Open: {_mdx_escape(n.text)}")
-        parts.append("\n".join(lines))
-
-    if report.unresolved:
-        lines = [
-            "## Attempted, Unresolved",
-            "*These analyses ran but produced no usable evidence;"
-            " they are not reflected in the findings above.*",
-            "",
-        ]
-        lines.extend(f"- {_mdx_escape(n.text)}" for n in report.unresolved)
-        parts.append("\n".join(lines))
+    # ## Notes & Limitations — dropped from the rendered report 2026-07-09 (team
+    # decision: compact report). caveats/open_questions still populate the
+    # AnalysisReport JSON body; only the markdown section is gone.
+    # if report.caveats or report.open_questions:
+    #     lines = ["## Notes & Limitations"]
+    #     for n in report.caveats:
+    #         lines.append(f"- {_mdx_escape(n.text)}")
+    #     for n in report.open_questions:
+    #         lines.append(f"- Open: {_mdx_escape(n.text)}")
+    #     parts.append("\n".join(lines))
+
+    # ## Attempted, Unresolved — dropped from the rendered report 2026-07-09 (team
+    # decision: compact report). Failed runs still populate `report.unresolved`
+    # (JSON body) and the /records curation list; only the markdown section is gone.
+    # if report.unresolved:
+    #     lines = [
+    #         "## Attempted, Unresolved",
+    #         "*These analyses ran but produced no usable evidence;"
+    #         " they are not reflected in the findings above.*",
+    #         "",
+    #     ]
+    #     lines.extend(f"- {_mdx_escape(n.text)}" for n in report.unresolved)
+    #     parts.append("\n".join(lines))
 
     if report.excluded:
         lines = [
@@ -491,18 +497,21 @@ def _render_markdown(report: AnalysisReport) -> str:
         lines.extend(f"- {_mdx_escape(n.text)}" for n in report.excluded)
         parts.append("\n".join(lines))
 
-    if report.method_steps:
-        lines = ["## How This Was Analyzed"]
-        for stage_key, label in _STAGE_LABELS:
-            steps = [s for s in report.method_steps if s.stage == stage_key]
-            if not steps:
-                continue
-            rendered = "; ".join(
-                f"{', '.join(_mdx_escape(t) for t in s.tools_used) or '—'} ({s.status})"
-                for s in steps
-            )
-            lines.append(f"**{label}** — {rendered}")
-        parts.append("\n".join(lines))
+    # ## How This Was Analyzed — dropped from the rendered report 2026-07-09 (team
+    # decision: compact report). method_steps (and _STAGE_LABELS above) stay for the
+    # AnalysisReport JSON body; only the markdown section is gone.
+    # if report.method_steps:
+    #     lines = ["## How This Was Analyzed"]
+    #     for stage_key, label in _STAGE_LABELS:
+    #         steps = [s for s in report.method_steps if s.stage == stage_key]
+    #         if not steps:
+    #             continue
+    #         rendered = "; ".join(
+    #             f"{', '.join(_mdx_escape(t) for t in s.tools_used) or '—'} ({s.status})"
+    #             for s in steps
+    #         )
+    #         lines.append(f"**{label}** — {rendered}")
+    #     parts.append("\n".join(lines))
 
     return "\n\n---\n\n".join(parts)
 
@@ -558,8 +567,9 @@ class ReportGenerator:
         kept = [r for r in all_records if r.record_id not in excluded_ids]
         # The report body reflects only substantive runs — those with a successful
         # analysis step (the same set the report floor validates). Fully-failed runs
-        # can't contradict the real findings, but they are no longer dropped
-        # silently: they surface under "Attempted, Unresolved".
+        # can't contradict the real findings, but they are not dropped silently
+        # either: they surface in the JSON `unresolved` list and the /records
+        # curation endpoint (the rendered markdown section was dropped 2026-07-09).
         records = [r for r in kept if has_successful_analysis(r)]
         unresolved_records = [r for r in kept if not has_successful_analysis(r)]
         if not records:

src/models/api/report.py

@@ -24,8 +24,9 @@ class AnalysisRecordEntry(BaseModel):
 
     The FE shows these before generating so the user can exclude runs
     (`exclude_record_ids` on POST /tools/report). `substantive` mirrors the
-    report's own inclusion rule: non-substantive runs would land under
-    "Attempted, Unresolved" rather than the findings body.
+    report's own inclusion rule: non-substantive runs land in the report's
+    `unresolved` list rather than the findings body (the "Attempted, Unresolved"
+    markdown section was dropped 2026-07-09; the JSON field remains).
     """
 
     record_id: str = Field(..., description="Id to pass in exclude_record_ids.")