apingali Claude Opus 4.7 (1M context) commited on
Commit
17c3a19
Β·
1 Parent(s): ebbca73

fix(samples): pad all 4 sample initiatives above the 200-word minimum

Browse files

Reported live: clicking a sample then Diagnose hit "need at least 200
words" (one was 185, one 171, one 188, one 175). The samples were below
the validator threshold the LLM needs for meaningful scoring.

Padded each with substantive operational detail (not filler) β€” extra
context that makes the case clearer rather than just adding words:

compounder 185 β†’ 231 (added: premium size, decline + referral
rates, more claim types, "agents favor
faster turnaround" punchline)
one-shot win 171 β†’ 228 (added: collateral fields, annual loan
count, vendor's deterministic-task framing,
chief credit officer's flag about LGD)
wrong thing 188 β†’ 230 (added: 20K orders/day network volume,
specific 6-10pm dock window, labor cost
up 8% because of idle hours)
roman candle 175 β†’ 217 (added: $480M revenue, "shared inference
fleet" with competitor brands, list of
actual unexamined constraints β€” drive-thru,
menu, breakfast β€” and the Q4 board deadline)

Synchronized between both locations:
gradio-apps/compounding-test/app.py β€” the Space's gr.Examples
src/components/CompoundingTestAI.tsx β€” the site's React component

(The duplication is intentional for now; consolidating to a shared JSON
is a fair cleanup if these samples need to change often enough that
sync drift becomes painful.)

Verified word counts via str.split() / split(/\s+/) which match between
Python and JS. Astro build + 31 pytest tests pass.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

Files changed (1) hide show
  1. app.py +81 -64
app.py CHANGED
@@ -401,83 +401,100 @@ BUDGETS = ["<$100K", "$100K–$1M", "$1M–$10M", ">$10M"]
401
  _SAMPLE_COMPOUNDER = (
402
  "We're a regional commercial insurance carrier specializing in restaurant "
403
  "general liability. We write about 8,000 policies a year across the "
404
- "Midwest. Underwriting is the bottleneck of our business β€” agents wait "
405
- "36 to 48 hours for a quote because our underwriters manually pull "
406
- "industry codes, loss runs, and prior-carrier history from three "
407
- "different systems and decide whether to bind, decline, or refer. "
408
- "We're deploying an LLM-powered underwriting assistant that pulls the "
409
- "data automatically, flags risk factors based on patterns in our "
410
- "12-year claims database, and proposes a base rate. The underwriter "
411
- "reviews and approves. Every policy we write generates new claim "
412
- "outcomes β€” fires, slip-and-falls, liquor-liability claims β€” and those "
413
- "outcomes feed back into the next quarter's model retraining. Our "
414
- "competitors mostly use Verisk's industry-standard models, which we "
415
- "don't share data with, so our model gets better on our book of "
416
- "business while theirs reflects the industry average. Internal goal: "
417
- "cut time-to-quote from 36 hours to 4 hours, increase win rate on "
418
- "profitable risks by 15%, and progressively shift the loss ratio by "
419
- "1–2 points per year as the model learns from each renewal cycle."
 
 
 
 
 
420
  )
421
 
422
  _SAMPLE_ONE_SHOT_WIN = (
423
- "We're a community bank with $4B in assets, 38 branches across two "
424
  "states. Loan officers spend about 6 hours per commercial loan "
425
  "reviewing financial statements, tax returns, and corporate documents "
426
  "before they can write the credit memo. We're deploying GPT-4 to "
427
  "extract key fields β€” revenue, EBITDA, debt service coverage ratio, "
428
- "ownership structure, related-party transactions β€” from these "
429
- "documents into a structured form. The loan officer reviews the "
430
- "extraction and writes the credit memo by hand. We expect to cut "
431
- "document review time from 6 hours to about 90 minutes per loan. "
432
- "The vendor provides the model and the document templates and is "
433
- "selling the same system to four of our peer community banks in the "
434
- "region. The AI doesn't learn from the outcome of the loan: defaults, "
435
- "prepayments, modifications, restructurings all go into our loan "
436
- "servicing system, which doesn't connect back to the extraction "
437
- "model. The vendor's roadmap doesn't include any feedback loop. "
438
- "We're funding the project from the operations budget; the credit "
439
- "team is excited about the time savings."
 
 
 
 
 
 
440
  )
441
 
442
  _SAMPLE_WRONG_THING = (
443
- "We're a third-party logistics provider with 8 warehouses on the "
444
- "East Coast. We're investing in computer vision software to optimize "
445
- "order picking routes β€” the AI looks at the warehouse layout, "
446
- "current orders, and worker positions and suggests optimized pick "
447
- "paths in real time. Pilot results show a 12% reduction in steps "
448
- "per order on the test floor. Our operations team has been excited "
449
- "about this for 18 months and we just signed a multi-year contract "
450
- "with the vendor. Some context on the operation: our warehouses run "
451
- "2 shifts. Order volume in shift 1 is around 14,000 orders/day; "
452
- "shift 2 is around 6,000. The pick wave finishes by 2pm on shift 1, "
453
- "then workers wait 4 to 5 hours for shift 2 trucks to arrive at the "
454
- "loading docks. The trucks are scheduled by the customer (a major "
455
- "national retailer) and arrive in unpredictable windows. We don't "
456
- "control the truck schedule. The CFO has been asking us why total "
457
- "throughput per warehouse hasn't moved much in three years; our "
458
- "answer has been that the legacy WMS is the constraint, which is "
459
- "why we're investing in better picking AI."
 
 
 
460
  )
461
 
462
  _SAMPLE_ROMAN_CANDLE = (
463
- "We run a chain of 220 quick-service restaurants across the "
464
- "Southeast. Our gross margin has been under pressure from rising "
465
- "ingredient costs and we're rolling out an AI-powered personalized "
466
- "marketing platform that sends customized email and SMS offers "
467
- "based on customer purchase history, location, and weather. The "
468
- "platform is from a major QSR-tech vendor used by several of our "
469
- "competitors. Our customer data β€” names, emails, phone numbers, "
470
- "purchase frequency β€” lives in our point-of-sale provider's cloud, "
471
- "which the marketing platform pulls from via the POS provider's "
472
- "standard integration. Our purchase data and the modeling are both "
473
- "the vendor's stack; we don't see the underlying model and our data "
474
- "is commingled with other QSR brands the vendor serves. We expect "
475
- "to lift email click-through by 8–12% based on the vendor's "
476
- "benchmark studies of similar brands. The marketing team is "
477
- "running the rollout; finance signed off on the multi-year "
478
- "subscription. We have not measured what's actually constraining "
479
- "same-store sales growth β€” we just know revenue has been flat for "
480
- "two years and the board wants action."
 
 
 
481
  )
482
 
483
 
 
401
  _SAMPLE_COMPOUNDER = (
402
  "We're a regional commercial insurance carrier specializing in restaurant "
403
  "general liability. We write about 8,000 policies a year across the "
404
+ "Midwest, with average annual premium around $4,500. Underwriting is "
405
+ "the bottleneck of our business β€” independent agents wait 36 to 48 "
406
+ "hours for a quote because our underwriters manually pull industry "
407
+ "codes, loss runs, and prior-carrier history from three different "
408
+ "systems and then decide whether to bind, decline, or refer. Roughly "
409
+ "30% of submissions get declined and another 15% are referred to "
410
+ "senior underwriters, which adds another day. We're deploying an "
411
+ "LLM-powered underwriting assistant that pulls the data automatically, "
412
+ "flags risk factors based on patterns in our 12-year claims database, "
413
+ "and proposes a base rate with an explanation. The underwriter "
414
+ "reviews, adjusts, and approves. Every policy we write generates new "
415
+ "claim outcomes β€” fires, slip-and-falls, liquor-liability claims, "
416
+ "food-poisoning suits β€” and those outcomes feed back into the next "
417
+ "quarter's model retraining. Our competitors mostly use Verisk's "
418
+ "industry-standard rating models, which we don't share data with, so "
419
+ "our model gets better on our specific book of business while theirs "
420
+ "reflects the industry average. Internal goal: cut time-to-quote from "
421
+ "36 hours to 4 hours, increase the win rate on profitable risks by "
422
+ "15%, and progressively shift the loss ratio by 1–2 points per year "
423
+ "as the model learns from each renewal cycle. Independent agents have "
424
+ "already started favoring carriers with faster quote turnaround."
425
  )
426
 
427
  _SAMPLE_ONE_SHOT_WIN = (
428
+ "We're a community bank with $4B in assets and 38 branches across two "
429
  "states. Loan officers spend about 6 hours per commercial loan "
430
  "reviewing financial statements, tax returns, and corporate documents "
431
  "before they can write the credit memo. We're deploying GPT-4 to "
432
  "extract key fields β€” revenue, EBITDA, debt service coverage ratio, "
433
+ "ownership structure, related-party transactions, collateral "
434
+ "descriptions β€” from these documents into a structured form. The loan "
435
+ "officer reviews the extraction and writes the credit memo by hand. "
436
+ "We expect to cut document review time from 6 hours to about 90 "
437
+ "minutes per loan, processing roughly 2,400 commercial loans a year. "
438
+ "The vendor provides the model, the document templates, and the "
439
+ "extraction prompts, and is selling the same system to four of our "
440
+ "peer community banks in the region under identical contracts. The AI "
441
+ "doesn't learn from the outcome of the loan: defaults, prepayments, "
442
+ "modifications, restructurings all go into our separate loan "
443
+ "servicing system, which has never connected back to the extraction "
444
+ "model. The vendor's three-year roadmap doesn't include any feedback "
445
+ "loop between loan performance and the model β€” they treat extraction "
446
+ "as a deterministic task. We're funding the project from the "
447
+ "operations budget; the credit team is excited about the time savings "
448
+ "but the chief credit officer has flagged that the productivity gain "
449
+ "will be one-time and won't show up in the loss-given-default rate "
450
+ "over time."
451
  )
452
 
453
  _SAMPLE_WRONG_THING = (
454
+ "We're a third-party logistics provider with 8 warehouses on the East "
455
+ "Coast handling about 20,000 orders a day across the network. We're "
456
+ "investing in computer vision software to optimize order picking "
457
+ "routes β€” the AI looks at the warehouse layout, current orders, and "
458
+ "worker positions and suggests optimized pick paths in real time. "
459
+ "Pilot results show a 12% reduction in steps per order on the test "
460
+ "floor. Our operations team has been excited about this for 18 months "
461
+ "and we just signed a multi-year contract with the vendor. Some "
462
+ "context on the operation: our warehouses run 2 shifts. Order volume "
463
+ "in shift 1 is around 14,000 orders per day; shift 2 is around 6,000. "
464
+ "The pick wave finishes by 2pm on shift 1, then workers wait 4 to 5 "
465
+ "hours for shift 2 trucks to arrive at the loading docks. The trucks "
466
+ "are scheduled by the customer (a major national retailer) and arrive "
467
+ "in unpredictable windows between 6pm and 10pm. We don't control the "
468
+ "truck schedule and the customer won't share their advance schedule "
469
+ "with us. The CFO has been asking us why total throughput per "
470
+ "warehouse hasn't moved much in three years; our answer has been that "
471
+ "the legacy warehouse management system is the constraint, which is "
472
+ "why we're investing in better picking AI. Same-store labor cost is "
473
+ "up 8% year-over-year because workers are paid through the idle hours."
474
  )
475
 
476
  _SAMPLE_ROMAN_CANDLE = (
477
+ "We run a chain of 220 quick-service restaurants across the Southeast "
478
+ "doing about $480M in annual revenue. Our gross margin has been under "
479
+ "pressure from rising ingredient costs and we're rolling out an "
480
+ "AI-powered personalized marketing platform that sends customized "
481
+ "email and SMS offers based on customer purchase history, location, "
482
+ "and local weather. The platform is from a major QSR-tech vendor used "
483
+ "by several of our direct competitors in the same markets we operate "
484
+ "in. Our customer data β€” names, emails, phone numbers, purchase "
485
+ "frequency, average ticket size β€” lives in our point-of-sale "
486
+ "provider's cloud, which the marketing platform pulls from via the "
487
+ "POS provider's standard integration. Both the purchase data feed and "
488
+ "the modeling are the vendor's stack; we don't see the underlying "
489
+ "model and our data is commingled with other QSR brands the vendor "
490
+ "serves on a shared inference fleet. We expect to lift email "
491
+ "click-through by 8–12% based on the vendor's benchmark studies of "
492
+ "similar brands. The marketing team is running the rollout; finance "
493
+ "signed off on the multi-year subscription. We have not measured what "
494
+ "is actually constraining same-store sales growth β€” drive-thru wait "
495
+ "times, menu pricing relative to local competitors, or breakfast "
496
+ "daypart penetration β€” we just know revenue has been flat for two "
497
+ "years and the board wants visible action by Q4."
498
  )
499
 
500