Spaces:
Sleeping
Sleeping
Commit History
-
Test 6: MBG Keracunan Grobogan — multi-Komisi + sosial sector validation
pebaryan +1: Claude Opus 4.7Sixth live validation, on the most politically substantive topic to date: the Makan Bergizi Gratis (MBG) program post-keracunan incidents (Grobogan 9 Jan 2026, ~1,929 victims across 6 provinces in Jan 2026). Validates the Komisi-portfolio injection (ea8eaf7) on a four-Komisi cross-cut (IX + VIII + X + XI all relevant). Surat reply correctly addressed Komisi IX as primary with X/VIII/XI tembusan, pulling bracketed portfolios verbatim from the injected reference table. Classifier output: 'sektor=sosial_kemasyarakatan' (first run) / 'sektor=kesehatan' (second run) — sixth distinct sector across the test series, both valid framings for cross-cutting MBG topic. Patches: - Added 4 MBG-related canonical probes (Perpres 83/2024 BGN, Perpres 115/2025 MBG ops, UU 18/2012 Pangan, UU 8/1999 Perlindungan Konsumen). All 4 verified berlaku on pasal.id pre-commit. Closes the recurring retrieval-gap pattern that surfaced in Tests 3, 4, 5. - Refreshed scripts/regression_baseline.json: 19 → 23 …ca23118
-
Test 5: Bekasi train+EV taxi accident — transport sector + extractor fixes
pebaryan +1: Claude Opus 4.7Fifth live validation, on the 27 April 2026 KA Argo Bromo Anggrek collision with a stopped KRL involving a Green SM electric taxi at Bekasi Timur Station (16 fatalities, ongoing investigation). Surfaces and fixes three real defects in the same patch. Defects fixed: 1. Extractor missed Kemenhub's "PM <n>" numbering. Permenhub citations like "Permenhub No. PM 94 Tahun 2018" extracted as nothing — verifier never even saw them, so any Permenhub hallucination shipped silently. Added (?:(?:PM|KP|KEP|PER)\.?\s*)? to the regex between optional "Nomor" prefix and the digit group. 2. Extractor broke on parenthetical-aliased citations. "Peraturan Menteri Perhubungan (Permenhub) No. PM 94 Tahun 2018" wouldn't extract because closing paren between label and number wasn't tolerated. Widened the spacer to allow ) ] * _ characters. 3. Greedy ministry-suffix backtracking. "Peraturan Menteri Perhubungan Nomor PM 73 Tahun 2018" extracted as "Permen 3/2018" — the unbounded s…850ff59 -
Add Test 4 — PPDS dan internsip dokter (cross-sector kesehatan validation)
pebaryan +1: Claude Opus 4.7Fourth live validation, designed as a cross-sector health-domain test covering PPDS perundungan, status hukum residen, beban finansial, and internsip placement at DTPK. No _CASE_FACTS entry — the SMALL-model domain classifier is the only domain anchor. Fixture: synthetic joint letter from a Residen Bedah year-3 at RSUP Hasan Sadikin and a Dokter Internsip in Sorong Selatan, on behalf of Forum Komunikasi Dokter Muda Indonesia (FKDMI). Cites UU 17/2023 (Pasal 193), PP 28/2024, Permenkes 7/2022, UU 20/2013 — multiple substantive asks to Komisi IX gabungan Komisi X. Results: - Surat: PT/kesehatan framing intact, cites UU 17/2023 + PP 28/2024 + Pasal 193, three legislator-scoped tindak lanjut, strict-mode passed. - Peneliti: 6 query expansions, 41 unique hits. Strikingly honest — flags 4 distinct retrieval gaps ("tidak ditemukan") rather than fabricating. Surfaces UU 17/2023, Peraturan MA 2/2023, PMK 66/2023. - Penyusun memo: classifier output 'sektor=kesehatan jenjang=- kasus=-' …805f292 -
Add Test 3 — gaji dan tunjangan dosen (PT-domain validation)
pebaryan +1: Claude Opus 4.7Third live validation, designed as the inverse of Test 2 (Kasus Ibam, K-12): this targets a Perguruan Tinggi topic with no _CASE_FACTS entry, so the SMALL-model domain classifier is the only domain anchor in play. Fixture: synthetic letter from a Lektor at UNS Surakarta, writing on behalf of Forum Dosen Indonesia (FDI) wilayah Jawa Tengah. Four substantive concerns: ASN-PTS disparity post-Permendiktisaintek 52/2025, status of dosen kontrak/honorer, RUU Sisdiknas relocation risk for UU 14/2005's tunjangan provisions, slow Serdos disbursement. Results: - Surat: PT framing intact, cites UU 14/2005 + PP 41/2009 + Perpres 19/2025, three legislator-scoped tindak lanjut, strict-mode passed. - Peneliti: 6 query expansions, 45 unique hits. Correctly identifies Permendiktisaintek 52/2025 as new operative regulation, traces evolution from Permendikbudristek 44/2024, cites PP 41/2009 + Permenristekdikti 20/2017 with proper FRBR URIs. Honestly flags that draft RUU Sisdiknas and UU 14/20…de87feb
-
Correct Kasus Ibam case status: tuntutan, not vonis
pebaryan +1: Claude Opus 4.7The 16 April 2026 hearing was the Jaksa Penuntut Umum's tuntutan reading (15 tahun penjara, denda Rp 1 miliar, uang pengganti Rp 16,92 miliar). The vonis hearing was scheduled for 12 Mei 2026 and has not been delivered. As of 2026-05-01 Ibrahim Arief is a TERDAKWA in an ongoing trial, not a terpidana — asas praduga tak bersalah applies. The original _CASE_FACTS block treated him as already convicted, which propagated into every memo this run produced and into the whitepaper. This commit: - Rewrites _CASE_FACTS in agents/penyusun.py to use 'terdakwa' / 'tuntutan' / 'sedang menjalani persidangan' language and explicitly forbids 'terpidana' / 'divonis' / 'dihukum'. - Corrects tests/fixtures/surat-chromebook-sekolah.txt to describe the prosecution's tuntutan reading rather than a fictitious putusan. - Adds an erratum at the top of the Kasus Ibam whitepaper documenting the error, its origin (misread WebSearch summary), and the Indonesian legal terminology that distinguishes tunt…1c88af7 -
Add Kasus Ibam whitepaper — failure analysis, hardening, post-fix validation
pebaryan +1: Claude Opus 4.7Documents the second live validation run end-to-end: - The K-12 procurement corruption case stresses the system on a topic adjacent to (rather than contained in) pasal.id's regulatory corpus. - First-pass exposed five failure modes (domain drift K-12 to PT, date hallucination, content-blind citation verifier, missed canonical Tipikor laws, query-expansion noise). - Ten hardening patches applied (runtime context injection, citation module, strict post-generation verification, bidirectional context capture, acronym expansion, malformed-title guard, UUD whitelist, Permen-with-space regex, domain anchor + case-fact injection, canonical FRBR-URI probes, cache thread-safety). - Post-fix re-run produces a memo that passes strict citation verification with correct K-12 framing, accurate case facts (Ibrahim Arief, vonis 16 April 2026), and proper canonical citations (UU 31/1999 jo UU 20/2001, Perpres 16/2018 jo Perpres 12/2021). Verdict: legawa is fit for staff-augmentation…4291a50
-
Add whitepaper documenting first live validation run
pebaryan +1: Claude Opus 4.7Documents end-to-end test of legawa against a real Indonesian hot topic (outsourcing Permenaker / #BuruhBersuaraBukanAnarkis), including: - Test methodology and scenario selection rationale - Results from Surat (triage + verified reply) and Peneliti (legal research) - Quality assessment against citation discipline, scope, and Bahasa register - Three defects discovered and fixed during the run - Reproduction steps Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>d7fd786