CIU/PSAC union corpus: by-laws suite, PSAC Constitution, VSSAs, guides, 15 decisions; weekly watch extended

New doc_type 'union' (bannered: bargaining-agent documents, not employer
policy): CIU National By-Laws (EN+FR), CIU Regulations, Branch Rules, Local
Modifications, Branch Elections Kit, PSAC Constitution (Nov 2024), the
grievance/EE/transition guides, and all 25 published site VSSAs -- 635
chunks via canlex.ciu. The union's Important Decisions list ingested in
full: 12 FPSLREB/PSLRB decisions (Bartlett scheduling through Guay-Bassett)
plus Jane Doe 2018 FCA 183, Marentette 2024 FC 676 and Fraser 2020 SCC 28
(124 decisions total). refresh.py check_union() diffs upstream
Last-Modified for all 35 union documents; PDI and IRB-guideline currency
rows added; legislation drift advice now includes the French twins; the
weekly SKILL.md rewritten to match (and its wrong error-semantics line
fixed). 40,994 chunks / 44,302 vectors. Gate: legacy 0.77/0.94/0.98/0.99
MRR 0.85; union slice 1.00 Hit@5; holdout 1.00 Hit@3.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

README.md

@@ -39,6 +39,12 @@ The server also publishes an MCP prompt (`us_record_screening`, the guided
 three-step screening flow) and resources (the corpus inventory and the
 conviction/equivalency methodology texts) that any MCP client can use.
 
+The labour side now carries the full union stack alongside the FB collective
+agreement: the CIU National By-Laws (EN/FR), CIU Regulations, Branch Rules
+and local modifications, the Branch Elections Kit, the PSAC Constitution,
+the union's member guides, and every published site VSSA — all bannered as
+bargaining-agent documents, distinct from employer policy.
+
 Retrieval runs fully locally inside the container and needs no API key. The
 optional case citator reads a CanLII key from the `CANLII_API_KEY` environment
 variable. A weekly scheduled staleness check watches upstream sources for

RUNBOOK.md

@@ -10,6 +10,7 @@ Order matters — chunks feed embeddings feed the eval:
 py -m canlex.ingest [--force] [CODES]   # Justice Laws XML -> per-Act JSON (incl. Schedules)
 py -m canlex.ingest --fr                # parallel French corpus (same schema; SOR->DORS URLs)
 py -m canlex.pdi                        # scoped IRCC PDI pages (PR card / Tran)
+py -m canlex.ciu                        # CIU/PSAC union documents + site VSSAs
 py -m canlex.dmemo                      # CBSA D-Memoranda
 py -m canlex.enf                        # ENF operational manuals (canada.ca PDFs)
 py -m canlex.amps                       # AMPS Master Penalty Document

canlex/caselaw.py

@@ -70,6 +70,10 @@ CASES = [
     {"court": "scc", "id": 20081, "short": "Mason",
      "topic": "Inadmissibility under IRPA s. 34(1)(e) for acts of violence "
               "endangering safety in Canada; reasonableness review"},
+    {"court": "scc", "id": 18510, "short": "Fraser",
+     "topic": "Adverse-effect discrimination under Charter s. 15(1); the "
+              "RCMP job-sharing pension rules' disproportionate impact on "
+              "women; substantive equality methodology"},
     {"court": "scc", "id": 16146, "short": "Igloo Vikski",
      "topic": "Customs tariff classification methodology; how the General "
               "Rules for the Interpretation of the Harmonized System apply "
@@ -205,6 +209,14 @@ CASES = [
               "reliability of the evidence before committal"},
 
     # --- Federal Court of Appeal ---
+    {"court": "fca", "id": 345651, "short": "Jane Doe",
+     "topic": "Judicial review of 2017 PSLREB 55; compensation for a "
+              "victim of workplace sexual assault in the federal public "
+              "service; remedial authority of the Board"},
+    {"court": "fc", "id": 525537, "short": "Marentette",
+     "topic": "Workplace violence and harassment investigations under the "
+              "Canada Labour Code; procedural fairness owed to the "
+              "complainant in the investigation process"},
     {"court": "fca", "id": 33278, "short": "Cha",
      "topic": "Scope of s. 44(1) inadmissibility reports and Minister's "
               "delegate removal orders at the port of entry; officers and "
@@ -331,6 +343,40 @@ CASES = [
               "where only part is shown to be of legitimate origin"},
 
     # --- Federal Public Sector Labour Relations and Employment Board ---
+    # The CIU's published "Important Decisions" list (ciu-sdi.ca), ingested
+    # 2026-07-23; topics adapted from the union's own subject lines.
+    {"court": "fpslreb", "id": 358837, "short": "Bartlett",
+     "topic": "Hours of work and variable shift scheduling under the FB "
+              "collective agreement (Border Services officers)"},
+    {"court": "fpslreb", "id": 359582, "short": "Legros",
+     "topic": "Age discrimination grievance against the CBSA"},
+    {"court": "fpslreb", "id": 359605, "short": "Bétournay",
+     "topic": "Breach of trust, disguised disciplinary action and "
+              "termination (CRA)"},
+    {"court": "fpslreb", "id": 359635, "short": "Frezza",
+     "topic": "Bad faith and disguised discipline in the federal public "
+              "service (DND)"},
+    {"court": "fpslreb", "id": 360491, "short": "PSAC v TB (CBSA) 2018-66",
+     "topic": "Policy grievance: interpretation of the FB collective "
+              "agreement (PSAC v Treasury Board / CBSA)"},
+    {"court": "fpslreb", "id": 361700, "short": "PSAC v TB (CBSA) 2018-82",
+     "topic": "Policy grievance: interpretation of the FB collective "
+              "agreement (PSAC v Treasury Board / CBSA)"},
+    {"court": "fpslreb", "id": 361701, "short": "Michaud",
+     "topic": "Suspension grievance in the federal public service (CRA)"},
+    {"court": "fpslreb", "id": 407654, "short": "Hyslop",
+     "topic": "Suspension grievance of a CBSA employee"},
+    {"court": "fpslreb", "id": 407686, "short": "Girard",
+     "topic": "Suspension and the effective date of termination (CRA)"},
+    {"court": "fpslreb", "id": 420718, "short": "Edwards",
+     "topic": "Sick leave, personal-needs leave and disability "
+              "discrimination under the FB collective agreement (CBSA)"},
+    {"court": "fpslreb", "id": 420308, "short": "Touchette",
+     "topic": "Proportionality of discipline; suspension of a CBSA "
+              "employee reduced"},
+    {"court": "fpslreb", "id": 521306, "short": "Guay-Bassett",
+     "topic": "Scheduling, designated paid holidays and sick leave under "
+              "the FB collective agreement (CBSA)"},
     {"court": "fpslreb", "id": 520990, "short": "Menzies",
      "topic": "Progressive discipline of a CBSA border services officer; the "
               "lock-step approach to discipline rejected"},

canlex/ciu.py

@@ -0,0 +1,239 @@
+"""Ingest CIU and PSAC union documents (doc_type='union').
+
+The Customs and Immigration Union is the PSAC component representing the FB
+bargaining unit; its governance instruments and published reference material
+are the union-side counterpart to the FB collective agreement already in the
+corpus. Ingested here, all as public documents from ciu-sdi.ca / psacunion.ca:
+
+- the CIU National By-Laws (EN + FR), CIU Regulations, Branch Rules and the
+  Local Modifications to Branch Rules -- the union's internal law;
+- the PSAC Constitution and Regulations (the parent instrument the by-laws
+  operate under: dues, discipline and appeals bottom out there);
+- the Branch Elections Kit and the members' guides (grievance handling,
+  employment equity, workers in transition);
+- every site-specific Variable Shift Schedule Agreement (VSSA) the union
+  publishes -- the locally negotiated schedule grids for ports of entry.
+
+None of this is employer policy or part of the collective agreement itself;
+_format_section banners doc_type='union' accordingly.
+
+    python -m canlex.ciu
+"""
+import json
+import re
+import urllib.request
+
+from ._common import fetch_cached, norm_ws as _norm, split_lines, uniquify_ids
+from .config import PROCESSED_DIR, RAW_DIR
+
+RAW = RAW_DIR / "ciu"
+VSSA_PAGE = "https://ciu-sdi.ca/en/vssa/"
+_DOCS_BASE = "https://www.ciu-sdi.ca/wp-content/uploads/documents/"
+
+# (code, act_short, act_name, url, lang)
+DOCS = [
+    ("ciu-bylaws", "CIU By-Laws",
+     "CIU National By-Laws (adopted by CIU National Conventions)",
+     _DOCS_BASE + "bylaws_en.pdf", "en"),
+    ("ciu-bylaws", "CIU By-Laws",
+     "Règlements nationaux du SDI (adoptés par les congrès)",
+     _DOCS_BASE + "bylaws_fr.pdf", "fr"),
+    ("ciu-regs", "CIU Regulations",
+     "CIU Regulations (adopted by the CIU National Board of Directors)",
+     _DOCS_BASE + "ciu-regs-en.pdf", "en"),
+    ("ciu-branch-rules", "CIU Branch Rules",
+     "CIU Branch Rules (adopted by the CIU National Board of Directors)",
+     _DOCS_BASE + "branch-rules-en.pdf", "en"),
+    ("ciu-local-mods", "CIU Local Modifications",
+     "Local Modifications to CIU Branch Rules",
+     _DOCS_BASE + "local_mod_branch_rules_en.pdf", "en"),
+    ("ciu-elections-kit", "CIU Elections Kit",
+     "CIU Branch Elections Kit",
+     "https://www.ciu-sdi.ca/wp-content/uploads/elections/2023/EN/"
+     "elections-kit.pdf", "en"),
+    ("psac-constitution", "PSAC Constitution",
+     "PSAC Constitution and Regulations (November 2024 edition)",
+     "https://psacunion.ca/sites/psac/files/"
+     "psac.constitution.november_2024_edition.eng_v002.pdf", "en"),
+    ("ciu-guide-grievance", "CIU Grievance Guide",
+     "CIU Guide to Grievance Handling",
+     "https://ciu-sdi.ca/wp-content/uploads/2012/09/"
+     "guide_to_grievance_handling-e.pdf", "en"),
+    ("ciu-guide-ee", "CIU EE Toolkit",
+     "CIU Employment Equity Toolkit",
+     "https://ciu-sdi.ca/wp-content/uploads/2012/09/"
+     "EMPLOYMENT-EQUITY-Tool-Kit-e.pdf", "en"),
+    ("ciu-guide-transition", "CIU Transition Guide",
+     "Workers in Transition: a practical guide about gender transition",
+     "https://ciu-sdi.ca/wp-content/uploads/2012/09/"
+     "workers_in_transition_guide_-_en_-_web.pdf", "en"),
+]
+
+# Governance headings: "BY-LAW 5", "REGULATION 12", "RULE 3", "ARTICLE 7",
+# "SECTION 25", "PART B" -- at line start, optionally followed by a title.
+_HEADING = re.compile(
+    r"^(BY-?LAW|R[EÈ]GLEMENT|REGULATION|RULE|ARTICLE|SECTION|PART|ANNEX(?:E)?"
+    r"|APPENDIX)\s+([0-9]+[0-9A-Za-z.\-]*|[A-Z])\b\s*[-–—:]?\s*(.{0,80})",
+    re.IGNORECASE)
+_DATE = re.compile(r"\b(20\d{2}|19\d{2})\b")
+
+
+def _pdf_pages(path):
+    from pypdf import PdfReader
+    pages = []
+    for page in PdfReader(str(path)).pages:
+        try:
+            pages.append(page.extract_text() or "")
+        except Exception:
+            pages.append("")
+    return pages
+
+
+def _currency(pages):
+    """Newest adoption/amendment year on the cover pages."""
+    years = _DATE.findall("\n".join(pages[:3]))
+    return max(years) if years else ""
+
+
+def _doc_chunks(code, short, name, url, lang, pages):
+    text = "\n".join(pages)
+    lines = text.split("\n")
+    currency = _currency(pages)
+    marks = []
+    for i, l in enumerate(lines):
+        m = _HEADING.match(l.strip())
+        if m:
+            marks.append((i, f"{m.group(1).title()} {m.group(2)}",
+                          _norm(m.group(3)) or ""))
+    segments = []
+    if len(marks) >= 6:
+        for j, (i, label, title) in enumerate(marks):
+            end = marks[j + 1][0] if j + 1 < len(marks) else len(lines)
+            body = "\n".join(p for p in (_norm(x) for x in lines[i:end]) if p)
+            if len(body) > 120:
+                segments.append((label, title, body))
+    if not segments:
+        for k, piece in enumerate(split_lines(text, 1800), start=1):
+            body = "\n".join(p for p in (_norm(x) for x in piece.split("\n")) if p)
+            if len(body) > 120:
+                segments.append((f"part {k}", "", body))
+    chunks = []
+    fr = "-fr" if lang == "fr" else ""
+    for n, (label, title, body) in enumerate(segments, start=1):
+        pieces = split_lines(body, 1800) if len(body) > 2400 else [body]
+        total = len(pieces)
+        for k, piece in enumerate(pieces, start=1):
+            suffix = "" if total == 1 else f"-p{k}"
+            note = "" if total == 1 else f" (part {k} of {total})"
+            chunk = {
+                "id": f"{code}{fr}-{n}{suffix}",
+                "doc_type": "union",
+                "act_code": code.upper(),
+                "act_short": short,
+                "act_name": name,
+                "section": label,
+                "marginal_note": title,
+                "part": short,
+                "division": "",
+                "heading": "",
+                "text": piece,
+                "history": "",
+                "last_amended": currency,
+                "in_force": "",
+                "status": "in force",
+                "current_to": currency,
+                "citation": f"{short}, {label}"
+                            + (f" ({title})" if title else "") + note,
+                "source_url": url,
+            }
+            if lang == "fr":
+                chunk["lang"] = "fr"
+            chunks.append(chunk)
+    return chunks
+
+
+def _vssa_links():
+    req = urllib.request.Request(VSSA_PAGE, headers={"User-Agent": "Mozilla/5.0"})
+    with urllib.request.urlopen(req, timeout=60) as r:
+        html = r.read().decode("utf-8", "replace")
+    links = sorted(set(re.findall(
+        r'href="(https?://[^"]*?/uploads/vssa/([^"/]+)\.pdf)"', html)))
+    return links
+
+
+def _vssa_chunks(url, stem, pages):
+    site = _norm(stem.replace("-", " "))
+    text = "\n".join(p for p in (_norm(x) for x in "\n".join(pages).split("\n")) if p)
+    if len(text) < 60:
+        return []
+    out = []
+    pieces = split_lines(text, 1800)
+    total = len(pieces)
+    for k, piece in enumerate(pieces, start=1):
+        suffix = "" if total == 1 else f"-p{k}"
+        note = "" if total == 1 else f" (part {k} of {total})"
+        out.append({
+            "id": f"vssa-{stem.lower()}{suffix}",
+            "doc_type": "union",
+            "act_code": "VSSA",
+            "act_short": "VSSA",
+            "act_name": "Variable Shift Schedule Agreements (by work site)",
+            "section": site,
+            "marginal_note": f"VSSA — {site}",
+            "part": "Variable Shift Schedule Agreements",
+            "division": "",
+            "heading": "",
+            "text": piece,
+            "history": "",
+            "last_amended": "",
+            "in_force": "",
+            "status": "in force",
+            "current_to": "",
+            "citation": f"VSSA — {site}{note}",
+            "source_url": url,
+        })
+    return out
+
+
+def build():
+    RAW.mkdir(parents=True, exist_ok=True)
+    all_chunks = []
+    for code, short, name, url, lang in DOCS:
+        fr = "-fr" if lang == "fr" else ""
+        dest = RAW / f"{code}{fr}.pdf"
+        try:
+            fetch_cached(url, dest, pause=0.8)
+            chunks = _doc_chunks(code, short, name, url, lang,
+                                 _pdf_pages(dest))
+        except Exception as exc:
+            print(f"  !! {short} ({lang}): {type(exc).__name__}: {exc}")
+            continue
+        print(f"  {short:24} ({lang}): {len(chunks)} chunks")
+        all_chunks.extend(chunks)
+    try:
+        links = _vssa_links()
+    except Exception as exc:
+        links = []
+        print(f"  !! VSSA index: {type(exc).__name__}: {exc}")
+    n_vssa = 0
+    for url, stem in links:
+        dest = RAW / f"vssa-{stem.lower()}.pdf"
+        try:
+            fetch_cached(url, dest, pause=0.6)
+            chunks = _vssa_chunks(url, stem, _pdf_pages(dest))
+        except Exception as exc:
+            print(f"  !! VSSA {stem}: {type(exc).__name__}: {exc}")
+            continue
+        all_chunks.extend(chunks)
+        n_vssa += 1
+    print(f"  VSSA sites: {n_vssa}")
+    uniquify_ids(all_chunks)
+    out = PROCESSED_DIR / "ciu.json"
+    out.write_text(json.dumps(all_chunks, ensure_ascii=False, indent=2),
+                   encoding="utf-8")
+    print(f"ciu: {len(all_chunks)} chunks -> {out.name}")
+    return all_chunks
+
+
+if __name__ == "__main__":
+    build()

canlex/refresh.py

@@ -70,8 +70,55 @@ _NON_XML = [
     ("charter", "charter.json", "py -m canlex.charter", "Charter / Constitution"),
     ("commentary", "commentary.json", "py -m canlex.commentary",
      "Curated commentary chunks"),
+    ("union", "ciu.json", "py -m canlex.ciu", "CIU/PSAC union documents"),
+    ("pdi", "pdi.json", "py -m canlex.pdi", "IRCC PDI pages (PR card / Tran)"),
+    ("irb-guidelines", "irb_guidelines.json", "py -m canlex.irb_guidelines",
+     "IRB Chairperson's Guidelines"),
 ]
 
+
+def check_union():
+    """Upstream drift for the CIU/PSAC documents (incl. every site VSSA).
+
+    The union reposts amended documents at the same URLs, so the drift
+    signal is each PDF's Last-Modified header against our cached copy's
+    fetch time. New/removed VSSAs surface as fetch errors or new links on
+    the next canlex.ciu run; this check covers content changes to what we
+    already hold."""
+    import email.utils
+    from . import ciu
+    rows = []
+    targets = [(short, lang, ciu.RAW / f"{code}{'-fr' if lang == 'fr' else ''}.pdf", url)
+               for code, short, name, url, lang in ciu.DOCS]
+    try:
+        targets += [(f"VSSA {stem}", "en",
+                     ciu.RAW / f"vssa-{stem.lower()}.pdf", url)
+                    for url, stem in ciu._vssa_links()]
+    except Exception as exc:
+        rows.append({"short": "VSSA index", "lang": "en", "status": "error",
+                     "remote": "", "error": f"{type(exc).__name__}: {exc}"})
+    for short, lang, cache, url in targets:
+        try:
+            req = urllib.request.Request(url, method="HEAD",
+                                         headers={"User-Agent": BROWSER_UA})
+            with urllib.request.urlopen(req, timeout=30) as resp:
+                lm = resp.headers.get("Last-Modified", "")
+        except Exception as exc:
+            rows.append({"short": short, "lang": lang, "status": "error",
+                         "remote": "", "error": f"{type(exc).__name__}: {exc}"})
+            continue
+        if not lm:
+            rows.append({"short": short, "lang": lang, "status": "no-date",
+                         "remote": "", "error": ""})
+            continue
+        remote_ts = email.utils.parsedate_to_datetime(lm).timestamp()
+        local_ts = cache.stat().st_mtime if cache.exists() else 0
+        rows.append({"short": short, "lang": lang,
+                     "status": "stale" if remote_ts > local_ts else "ok",
+                     "remote": lm[:25], "error": ""})
+        time.sleep(0.3)
+    return rows
+
 # Curated datasets age: state legislatures amend deferred-adjudication
 # statutes every session, so a reviewed date older than this many days earns
 # a warning even though nothing upstream can be diffed automatically.
@@ -488,6 +535,7 @@ def run(as_json=False):
     curated = check_curated(today)
     dmemo_idx = check_dmemo_index()
     tariff = check_tariff_edition(today)
+    union = check_union()
     pending = pending_in_force(today)
     stale = [r for r in leg if r["status"] in ("stale", "missing-local")]
     errors = [r for r in leg if r["status"] == "error"]
@@ -496,16 +544,19 @@ def run(as_json=False):
     curated_flag = [r for r in curated if r["status"] in ("aging", "drift")]
     dmemo_stale = dmemo_idx["status"] == "stale"
     tariff_stale = tariff["status"] == "stale"
+    union_stale = [r for r in union if r["status"] == "stale"]
 
     if as_json:
         print(json.dumps({"checked": today, "legislation": leg,
                           "delegation": deleg, "directives": dirs,
                           "non_xml": nonxml, "curated": curated,
                           "dmemo_index": dmemo_idx, "tariff": tariff,
+                          "union": union,
                           "pending_in_force": pending,
                           "stale_count": (len(stale) + len(deleg_stale)
                                           + len(dirs_stale)
                                           + len(curated_flag)
+                                          + len(union_stale)
                                           + (1 if dmemo_stale else 0)
                                           + (1 if tariff_stale else 0)),
                           "error_count": len(errors)}, indent=2))
@@ -529,6 +580,8 @@ def run(as_json=False):
             codes = " ".join(r["code"] for r in stale)
             print(f"\n  -> {len(stale)} drifted. Refresh: "
                   f"py -m canlex.ingest --force {codes}\n"
+                  f"     and the French twins: py -m canlex.ingest --fr "
+                  f"--force {codes}\n"
                   f"     then: py -m canlex.embed && py -m canlex.eval")
 
         print("\nDelegation instruments (upstream check):")
@@ -610,6 +663,19 @@ def run(as_json=False):
             print(f"\nCustoms Tariff edition: ok ({tariff['stored']} is "
                   f"current)")
 
+        n_union_ok = sum(1 for r in union if r["status"] == "ok")
+        print(f"\nCIU/PSAC union documents (upstream Last-Modified check, "
+              f"{len(union)} documents):")
+        for r in union:
+            if r["status"] == "stale":
+                print(f"  STALE  {r['short']} ({r['lang']}): upstream "
+                      f"modified {r['remote']} after our fetch — run "
+                      f"py -m canlex.ciu && py -m canlex.embed")
+            elif r["status"] == "error":
+                print(f"  ERROR  {r['short']}: {r['error'][:55]}")
+        if not union_stale and not any(r["status"] == "error" for r in union):
+            print(f"  all {n_union_ok} current (upstream unchanged since fetch)")
+
         if pending:
             print("\nPending bills now in force (re-ingest the affected Acts):")
             for b in pending:
@@ -619,7 +685,8 @@ def run(as_json=False):
                 print(f"     run: py -m canlex.ingest --force {' '.join(b['affects'])}")
 
     return 1 if (stale or errors or deleg_stale or dirs_stale
-                 or curated_flag or dmemo_stale or tariff_stale) else 0
+                 or curated_flag or dmemo_stale or tariff_stale
+                 or union_stale) else 0
 
 
 def main():

canlex/server.py

@@ -196,6 +196,20 @@ def _format_section(c: dict, related=None) -> str:
         age = _guidance_age_note(c["current_to"])
         if age:
             lines.append(age)
+    elif doc_type == "union":
+        lines.append("_Union document (CIU/PSAC) — internal governance "
+                     "rules, member guides or locally negotiated scheduling "
+                     "instruments published by the bargaining agent. They "
+                     "bind the union and its members under the union's own "
+                     "rules; they are NOT employer policy and NOT part of "
+                     "the collective agreement itself (a VSSA operates "
+                     "under the FB agreement's variable-shift provisions). "
+                     "The union site may lag renegotiations — verify "
+                     "currency with the Branch._")
+        lines.append(f"(document currency: {_stated(c['current_to'])})")
+        age = _guidance_age_note(c["current_to"])
+        if age:
+            lines.append(age)
     elif doc_type == "commentary":
         lines.append("_**CURATED ANALYSIS — CanLex commentary, not a source "
                      "of law.** A curated synthesis of the cited authorities; "
@@ -267,7 +281,7 @@ def _format_section(c: dict, related=None) -> str:
 # as an enum rather than free text (regex 'pattern' constraints are dropped by
 # several function-calling translators, notably Gemini's).
 DocType = Literal["legislation", "memorandum", "agreement", "directive",
-                  "caselaw", "delegation", "benefits", "commentary"]
+                  "caselaw", "delegation", "benefits", "commentary", "union"]
 
 # Longest alternative first, and 's'/'ss' only at a word boundary or before
 # a dotted number -- so 'section 20.1' loses the whole word (not its first
@@ -322,7 +336,7 @@ def canlex_search_legislation(
     """Search Canadian federal law, CBSA D-Memoranda, agreements, NJC directives,
     and leading court decisions.
 
-    The CanLex corpus has eight kinds of source: federal Acts and regulations
+    The CanLex corpus has nine kinds of source: federal Acts and regulations
     with their Schedules (immigration, customs, criminal, firearms, drugs,
     food/health, labour, privacy and more); CBSA D-Memoranda (administrative
     guidance on how the CBSA applies customs and border law); Treasury Board
@@ -331,8 +345,10 @@ def canlex_search_legislation(
     leading decisions of the courts and federal tribunals (Supreme Court,
     Federal Court of Appeal and Federal Court, the IRB, and the FPSLREB and
     CIRB labour boards); instruments of delegation and designation under IRPA
-    and the IRPR; member booklets of the public-service benefit plans; and
-    CanLex's curated commentary (US-disposition and equivalency analysis).
+    and the IRPR; member booklets of the public-service benefit plans;
+    CanLex's curated commentary (US-disposition and equivalency analysis);
+    and union documents (the CIU by-laws/regulations/branch rules, the PSAC
+    Constitution, member guides, and every published site VSSA).
     Use this for ANY question about that material. It ranks results by
     relevance and returns their full text so the answer can cite the actual
     wording; an explicit section reference (e.g. "section 34") is always
@@ -725,6 +741,7 @@ def canlex_list_acts() -> str:
     delegations: dict[str, dict] = {}
     benefits: dict[str, dict] = {}
     commentary: dict[str, dict] = {}
+    union_docs: dict[str, dict] = {}
     memo_numbers: set[str] = set()
     memo_chunks = 0
     memo_date = ""
@@ -776,6 +793,12 @@ def canlex_list_acts() -> str:
                 "current_to": c["current_to"], "count": 0,
             })
             entry["count"] += 1
+        elif doc_type == "union":
+            entry = union_docs.setdefault(c["act_code"], {
+                "short": c["act_short"], "name": c["act_name"],
+                "current_to": c["current_to"], "count": 0,
+            })
+            entry["count"] += 1
         else:
             entry = acts.setdefault(c["act_code"], {
                 "short": c["act_short"], "name": c["act_name"],
@@ -822,6 +845,12 @@ def canlex_list_acts() -> str:
             lines.append(f"- **{a['short']}** — {a['name']}: {a['count']} "
                          f"sections, booklet edition {a['current_to'] or 'n/a'}. "
                          f"Plain-language member guide; the plan rules govern.")
+    if union_docs:
+        lines += ["", "## Union documents (CIU/PSAC)"]
+        for a in sorted(union_docs.values(), key=lambda x: x["short"]):
+            lines.append(f"- **{a['short']}** — {a['name']}: {a['count']} "
+                         f"sections, currency {a['current_to'] or 'n/a'}. "
+                         f"Bargaining-agent document; not employer policy.")
     if commentary:
         lines += ["", "## Curated commentary (not law)"]
         for a in sorted(commentary.values(), key=lambda x: x["short"]):

data/eval/questions.json

@@ -1990,5 +1990,53 @@
   "query": "What notice must an Ontario landlord give to evict a tenant?",
   "answers": [],
   "style": "no-answer"
+ },
+ {
+  "query": "What do the CIU by-laws say about how branch elections are conducted?",
+  "answers": [
+   [
+    "CIU By-Laws",
+    ""
+   ],
+   [
+    "CIU Elections Kit",
+    ""
+   ],
+   [
+    "CIU Branch Rules",
+    ""
+   ]
+  ],
+  "style": "union"
+ },
+ {
+  "query": "What is the variable shift schedule agreement for Windsor Bridge?",
+  "answers": [
+   [
+    "VSSA",
+    ""
+   ]
+  ],
+  "style": "union"
+ },
+ {
+  "query": "How does the PSAC constitution deal with membership discipline and expulsion?",
+  "answers": [
+   [
+    "PSAC Constitution",
+    ""
+   ]
+  ],
+  "style": "union"
+ },
+ {
+  "query": "What are the timelines for presenting a grievance according to the union's grievance guide?",
+  "answers": [
+   [
+    "CIU Grievance Guide",
+    ""
+   ]
+  ],
+  "style": "union"
  }
 ]

data/processed/caselaw.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d0a415257b35e02c821e4d8ea225f8c6c73a72acfef7bb2f5a9de99f7a7d0455
-size 11745635
+oid sha256:94e937a9a6a36a17662c7fb63bc1cec7397a28ff910e0c6d5889c2b2ac8deed8
+size 13150503

data/processed/embeddings.npz

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bbde594e9da686b30a3cf252204432194849aac8e6e7cbdf6fbc9f8d5c7cef5f
-size 76219542
+oid sha256:b6380fda9c44fafe766c7cf83a1b40f8a7ef8a689533069d8181b3a28a79c06f
+size 78503650

webapp/app.py

@@ -124,7 +124,7 @@ TOOL_DECLARATIONS = [
                     "type": "string",
                     "enum": ["legislation", "memorandum", "agreement",
                              "directive", "caselaw", "delegation",
-                             "benefits", "commentary"],
+                             "benefits", "commentary", "union"],
                     "description": (
                         "Optional. Restrict to one source type: 'legislation', "
                         "'memorandum' (CBSA D-Memoranda), 'agreement' "