InsuranceBot / kb /methodology /tie-breakers.md
rohitsar567's picture
Stack A: NIM brain + Maverick judge + Sarvam voice/Indic (D-019). Data moved to insurance-bot-data dataset; Space is now code-only.
c32bddc verified
|
Raw
History Blame Contribute Delete
5.28 kB

Tie-Breaker Rubric β€” When Policies Score Equal

The scorecard's 0–100 grade collapses 6 sub-scores. Two policies can land at the same overall score with very different shapes. This document defines the objective tie-breakers the system applies when overall scores are within Β±2 points, ordered by buyer impact.

The intent: never tell a buyer "these are equal" β€” always have a defensible objective reason one wins.


Tier 1 β€” Insurer Quality (applies across portfolio)

These metrics belong to the insurer, not the policy. If two policies come from different insurers, these dominate.

# Metric Source Tie-breaker rule
1 Claim Settlement Ratio (most recent FY) IRDAI Annual Report Higher wins. Cutoff: <90% disqualifies regardless of other strengths.
2 Complaints per 10,000 policies IRDAI Grievance Statistics Lower wins. The insurer's own published metric reveals operational quality.
3 Repudiation rate IRDAI public data Lower wins. A 5% point swing here matters more than a 5% swing in CSR.
4 Average claim turnaround time Insurer's IRDAI filings Faster wins. Cashless TAT ≀2h is the gold standard.

Tier 2 β€” Network Quality

# Metric Tie-breaker rule
5 Cashless network density in user's city More hospitals within 10km radius wins. Not raw count β€” geographic density.
6 Quality of top-3 hospitals in network If both networks include AIIMS / Apollo / Manipal / Fortis flagship branches, equivalent. If one excludes top-tier, the other wins.
7 Network depth in tier-2/3 cities For non-metro users, presence in town's biggest 2 hospitals is decisive.

Tier 3 β€” Cost-vs-Cover Trade Quality

# Metric Tie-breaker rule
8 Price per β‚ΉL of sum insured at user's age Lower wins. Calculated from real premium quotes for matching profile.
9 NCB accrual pace + cap Higher pace AND higher cap wins. E.g., 50%/year capped at 100% beats 25%/year capped at 50% for buyers who stay claim-free.
10 Restoration benefit liquidity "Unlimited automatic restoration" beats "one-time per year" beats "available on full exhaustion only".
11 PED waiting reduction options Some policies let you pay extra to drop PED waiting from 36β†’24 months. That option is itself valuable for diabetic / hypertensive buyers.

Tier 4 β€” Customer Experience Signals

These come from outside the policy wording β€” Reddit + MouthShut + InsuranceDekho ratings.

# Metric Tie-breaker rule
12 Reddit sentiment skew (last 12 months) "Mostly positive" beats "Mixed" beats "Mostly negative" claim-time stories.
13 MouthShut / PolicyBazaar star rating Higher wins. Volume matters β€” a 4.6 over 500 reviews beats a 4.8 over 12 reviews.
14 Specific named-creator coverage on YouTube If trusted creators (Ditto Insurance, Beshak, Subhanker Saha) have reviewed and rated positively, that's a tie-breaker.
15 Press: regulatory actions in last 24 months Any IRDAI show-cause notice in last 24 months breaks the tie negative.

Tier 5 β€” Specialised Match

Applies only when the user has a specific need flagged in their profile.

Profile flag Tie-breaker
Maternity planned next 24 months Policy with ≀24-month maternity wait wins.
Surgery planned within 12 months Policy with no specific-disease wait for that condition wins.
AYUSH preference Policy with explicit AYUSH coverage limits stated (vs "up to SI") wins.
Senior parents Policy that allows porting in mid-term + has senior-specific rider wins.
Diabetic buyer Policy with day-1 diabetes coverage option (e.g., HDFC Energy) wins for that buyer even if generic score lower.

Application order

When the system needs to break a tie between two policies:

  1. Walk through Tier 1 first β€” insurer quality is the most predictive single metric of claim experience.
  2. If still tied (same insurer, two products), drop to Tier 2 (network).
  3. Continue down the tiers.
  4. If still tied after all 5 tiers, the tie is genuine β€” surface both and let the user pick on subjective preference (brand, ease of website, app reviews, etc.).

The "all-else-equal" framing is honest: in reality, two health policies rarely tie. Surfacing the tiered breakdown gives the buyer a defensible reason for the recommendation order.


What we explicitly DON'T use as tie-breakers

  • Brand recognition alone. "I've heard of HDFC ERGO" is not a tie-breaker.
  • Commission rate to the broker / aggregator. The whole platform is built on not letting this influence ranking.
  • Recency of policy launch. New β‰  better.
  • Glossy marketing ("award-winning", "most trusted", etc.). Awards are often paid placements.

Implementation contract

The tie-breaker logic lives at backend/scorecard.py::tie_break(policy_a, policy_b, profile) (TBD β€” to be implemented). It returns a structured comparison: {winner, reason_tier, reason_text, source}. The frontend renders this when two policies have grades within 2 points and the user has both selected for comparison.