InsuranceBot / 70-docs /20-data-pipeline /information-source-map.md
rohitsar567's picture
refactor: KI-047 β€” bucket reorg (Option A safe subset)
e2d09f9
|
Raw
History Blame Contribute Delete
2.64 kB

Information Source Map

Field Value
Generated 2026-05-12T21:18:43Z
Total chunks in vector store 2
Policies indexed 1
Topics auto-tagged 16

0. Purpose

This document is the authoritative catalog of what the bot can answer. Every chunk in the Chroma vector store is summarized here, grouped by policy. For each policy, the high-value extracted fields are listed alongside.

A reviewer can use this file to answer two questions:

  1. "Could the bot know this?" β†’ look up the policy + topic.
  2. "Is the bot's answer plausibly grounded?" β†’ cross-reference the policy_id and field in the runtime audit log.

This artifact is regenerated after every ingestion or extraction run via python -m rag.source_map.

1. Topic inverted index β€” what is covered, where

  • claim_process β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • coverage_scope β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • critical_illness β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • exclusions β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • ncb β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • sum_insured β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure
  • waiting_period β€” covered in 1 policies: aditya-birla__activ-secure-cancer-secure__brochure

2. Per-policy catalog

Activ Secure - Cancer Secure

aditya-birla Β· brochure Β· 2 chunks Β· pages 1-4

Topics covered: coverage_scope(2), exclusions(2), claim_process(2), sum_insured(2), critical_illness(2), waiting_period(1), ncb(1)

Extracted fields:

  • (extraction not yet run for this policy)

policy_id: aditya-birla__activ-secure-cancer-secure__brochure


3. Machine-readable index

A JSON form of this catalog is at rag/source_map.json β€” used by the faithfulness verifier to look up whether a claim could plausibly trace to a chunk before allowing it through.

4. Coverage gaps (transparent)

These are areas where the corpus is thin. Bot questions on these should refuse:

  • Regulatory documents (IRDAI): Deferred β€” see decisions.md D-017. The bot's faithfulness Gate 1 (retrieval floor) refuses these correctly.
  • Premium pricing: Out of scope (advisor, not broker). See decisions.md D-007.
  • Categories beyond Health (Life, Motor, Travel): Out of scope v1.
  • Star Health policies (11 PDFs): Star Health's CDN actively blocks scripted downloads. Mitigation pending in v2.