calibrate(jury): v1.1+v1.1.1 — fix weighting bugs; recency-position paraphrase clause

rubric: clarify groundedness reference scope (snippets-only) for v1.1 gold (#20)

fix(types): four mypy errors blocking CI

docs(harness,readme): two re-review must-fix items

fix(judges,calibration,harness): three Codex adversarial-review findings

fix(judges,calibration): five review follow-ups (items 5, 6, 7, 9, 10)

fix(judges): four review-blocking bugs (review items 1–4 + 8)

refactor(metrics): delete superseded LLM judges (answer_faithfulness etc.)

refactor(harness): migrate to per-dimension Judge layer (drop faithfulness/correctness)

feat(calibration): generate_kappa_table with strict/warn modes

feat(scripts): run_calibration.py orchestrator for Steps A/C/D

feat(goldens): add source_snippets to 8 FastAPI calibration items

feat(calibration): 30-item stratified calibration_v1 sample

feat(calibration): hand-rolled cohen_kappa, gwets_ac2, bootstrap_ci

feat(variance): PermutedJudge + Jury — N permutations and multi-judge aggregator

feat(judges): CitationFaithfulnessJudge with all-or-nothing aggregation

feat(judges): CompletenessJudge + three-point reference-based rubric

feat(judges): RelevanceJudge + anchored three-point rubric

feat(judges): GroundednessJudge + anchored binary rubric

feat(judges): _call_judge_with_retry helper with strict-reprompt + abstain

feat(judges): MockJudge with LookupError on missing keys

feat(judges): Judge ABC with judge_id derived from model + dimension

feat(judges): Rubric markdown loader with aggressive validation

feat(judges): ScoreResult + abstain-reason constants

feat(eval): Week 1 step 5 — 25-question K8s golden dataset + grounded_refusal fix

feat: K8s pilot corpus — 8 pages + config entry + JSON rewrite

feat: add 6-question K8s golden pilot dataset

feat: extend GoldenQuestion with source_pages and source_sections

feat: support multi-corpus golden dataset schema

fix: comparison framing, mock-specific failure analysis, stale test counts

fix: grounded refusal checks no-sources, reference_answer for judge, mock disclaimer

fix: retrieval metrics use ranked sources, LLM judge wired, report complete

feat: Day 7 — evaluation harness, metrics, report, expanded golden dataset

feat: Day 4 — corpus, ingest script, first 10 golden questions