rohitsar567 Claude Opus 4.7 (1M context) commited on
Commit
c8bf1a1
·
1 Parent(s): 13a1cf4

perf(retrieval): KI-049 — wider top-k for table-cell questions

Browse files

Post-fix 96-Q eval (54.8% factual) surfaced 8 failures on room-rent /
sub-limit / cap questions where the bot's reply omitted the specific
room category ("Single Private", "Twin Sharing", "General Ward").
That's 19% of remaining failures.

Root cause: the policy table with the structured cap is ONE chunk in
Chroma, but at top_k=5 it loses to other relevant prose chunks
(definitions, sub-limit prose elsewhere in the doc) → the LLM never
sees the table → can only paraphrase from looser context → misses
the row categories.

Fix: when the query matches a table-cell trigger pattern, raise
effective_top_k to 10 for that query only. Trigger regex covers:

• room rent / sub-limit / sub-limits
• copay / co-pay
• cap on / capped at / sum insured limit
• single private / twin sharing / general ward
• no-claim bonus / NCB

Verified the regex fires on the eval's failing questions and ignores
generic waiting-period queries (which retrieve fine at top_k=5).

Combined with KI-046 (refusal precision on adversarial OOS questions,
+12pp expected), this addresses ~45% of remaining failures. Fresh
eval will land the actual lift number.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. {data → 40-data}/README.md +0 -0
  2. {data → 40-data}/corpus_urls.md +0 -0
  3. {data → 40-data}/information_source_map.md +0 -0
  4. {data → 40-data}/llm_health.json +0 -0
  5. {data → 40-data}/policy_facts/_curation_report.md +0 -0
  6. {data → 40-data}/policy_facts/acko__acko-health-ii__wordings.json +0 -0
  7. {data → 40-data}/policy_facts/acko__acko-health-iii-platinum-lite__wordings.json +0 -0
  8. {data → 40-data}/policy_facts/acko__acko-health-iii-platinum-super-top-up__wordings.json +0 -0
  9. {data → 40-data}/policy_facts/acko__acko-health-iii-platinum__brochure.json +0 -0
  10. {data → 40-data}/policy_facts/acko__acko-health-iii-platinum__wordings.json +0 -0
  11. {data → 40-data}/policy_facts/acko__acko-health-iii__cis.json +0 -0
  12. {data → 40-data}/policy_facts/acko__acko-health-iii__wordings.json +0 -0
  13. {data → 40-data}/policy_facts/acko__acko-personal-health__wordings.json +0 -0
  14. {data → 40-data}/policy_facts/acko__arogya-sanjeevani__wordings.json +0 -0
  15. {data → 40-data}/policy_facts/aditya-birla__activ-assure-diamond.json +0 -0
  16. {data → 40-data}/policy_facts/aditya-birla__activ-assure-diamond__wordings.json +0 -0
  17. {data → 40-data}/policy_facts/aditya-birla__activ-health-individual__wordings.json +0 -0
  18. {data → 40-data}/policy_facts/aditya-birla__activ-health.json +0 -0
  19. {data → 40-data}/policy_facts/aditya-birla__activ-one.json +0 -0
  20. {data → 40-data}/policy_facts/aditya-birla__activ-one__brochure.json +0 -0
  21. {data → 40-data}/policy_facts/aditya-birla__activ-secure-cancer-secure__brochure.json +0 -0
  22. {data → 40-data}/policy_facts/aditya-birla__activ-secure-personal-accident-cancer-secure__wordings.json +0 -0
  23. {data → 40-data}/policy_facts/aditya-birla__group-activ-health__wordings.json +0 -0
  24. {data → 40-data}/policy_facts/bajaj-allianz__comprehensive-care-plan.json +0 -0
  25. {data → 40-data}/policy_facts/bajaj-allianz__comprehensive-care-plan__wordings.json +0 -0
  26. {data → 40-data}/policy_facts/bajaj-allianz__criti-care__wordings.json +0 -0
  27. {data → 40-data}/policy_facts/bajaj-allianz__extra-care-plus.json +0 -0
  28. {data → 40-data}/policy_facts/bajaj-allianz__extra-care-plus__wordings.json +0 -0
  29. {data → 40-data}/policy_facts/bajaj-allianz__global-health-care.json +0 -0
  30. {data → 40-data}/policy_facts/bajaj-allianz__global-health-care__wordings.json +0 -0
  31. {data → 40-data}/policy_facts/bajaj-allianz__group-health-guard-gold__wordings.json +0 -0
  32. {data → 40-data}/policy_facts/bajaj-allianz__group-personal-accident__wordings.json +0 -0
  33. {data → 40-data}/policy_facts/bajaj-allianz__health-guard-gold-individual__wordings.json +0 -0
  34. {data → 40-data}/policy_facts/bajaj-allianz__health-guard-gold.json +0 -0
  35. {data → 40-data}/policy_facts/bajaj-allianz__health-guard.json +0 -0
  36. {data → 40-data}/policy_facts/bajaj-allianz__health-guard__wordings.json +0 -0
  37. {data → 40-data}/policy_facts/bajaj-allianz__silver-health.json +0 -0
  38. {data → 40-data}/policy_facts/bajaj-allianz__silver-health__cis.json +0 -0
  39. {data → 40-data}/policy_facts/bajaj-allianz__tax-gain.json +0 -0
  40. {data → 40-data}/policy_facts/bajaj-allianz__tax-gain__cis.json +0 -0
  41. {data → 40-data}/policy_facts/care-health__care-advantage-add-ons-protect-plus-care-shield__brochure.json +0 -0
  42. {data → 40-data}/policy_facts/care-health__care-advantage.json +0 -0
  43. {data → 40-data}/policy_facts/care-health__care-advantage__brochure.json +0 -0
  44. {data → 40-data}/policy_facts/care-health__care-classic.json +0 -0
  45. {data → 40-data}/policy_facts/care-health__care-classic__wordings.json +0 -0
  46. {data → 40-data}/policy_facts/care-health__care-heart__brochure.json +0 -0
  47. {data → 40-data}/policy_facts/care-health__care-senior.json +0 -0
  48. {data → 40-data}/policy_facts/care-health__care-senior__brochure.json +0 -0
  49. {data → 40-data}/policy_facts/care-health__care-supreme-enhance.json +0 -0
  50. {data → 40-data}/policy_facts/care-health__care-supreme-enhance__wordings.json +0 -0
{data → 40-data}/README.md RENAMED
File without changes
{data → 40-data}/corpus_urls.md RENAMED
File without changes
{data → 40-data}/information_source_map.md RENAMED
File without changes
{data → 40-data}/llm_health.json RENAMED
File without changes
{data → 40-data}/policy_facts/_curation_report.md RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-ii__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii-platinum-lite__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii-platinum-super-top-up__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii-platinum__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii-platinum__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii__cis.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-health-iii__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__acko-personal-health__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/acko__arogya-sanjeevani__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-assure-diamond.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-assure-diamond__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-health-individual__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-health.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-one.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-one__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-secure-cancer-secure__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__activ-secure-personal-accident-cancer-secure__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/aditya-birla__group-activ-health__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__comprehensive-care-plan.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__comprehensive-care-plan__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__criti-care__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__extra-care-plus.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__extra-care-plus__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__global-health-care.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__global-health-care__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__group-health-guard-gold__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__group-personal-accident__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__health-guard-gold-individual__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__health-guard-gold.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__health-guard.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__health-guard__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__silver-health.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__silver-health__cis.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__tax-gain.json RENAMED
File without changes
{data → 40-data}/policy_facts/bajaj-allianz__tax-gain__cis.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-advantage-add-ons-protect-plus-care-shield__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-advantage.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-advantage__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-classic.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-classic__wordings.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-heart__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-senior.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-senior__brochure.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-supreme-enhance.json RENAMED
File without changes
{data → 40-data}/policy_facts/care-health__care-supreme-enhance__wordings.json RENAMED
File without changes