| Document | Gold records | Predicted (mean) | Exact recall | Field F1 | Complete runs |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 265.3 | 97.9% | 98.7% | 1/3 |
| driver_mvr_packet_002 | 500 | 505.3 | 98.9% | 99.3% | 1/3 |
| driver_mvr_packet_003 | 500 | 500.0 | 100.0% | 100.0% | 3/3 |
| driver_schedule_sparse_001 | 500 | 500.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_001 | 1159 | 1159.0 | 99.6% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_002 | 2143 | 2143.0 | 95.3% | 99.3% | 0/3 |
| ifta_mileage_by_vehicle_003 | 2195 | 2195.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_004 | 2239 | 2239.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_005 | 2379 | 2379.0 | 99.7% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_006 | 2434 | 2434.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_007 | 2445 | 2445.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_008 | 2571 | 2571.0 | 100.0% | 100.0% | 0/3 |
| ifta_multisection_return_001 | 335 | 335.0 | 99.7% | 100.0% | 0/3 |
| ifta_multisection_return_002 | 461 | 461.0 | 97.1% | 99.8% | 0/3 |
| ifta_return_schedule_001 | 582 | 582.0 | 95.9% | 99.6% | 0/3 |
| ifta_return_schedule_002 | 998 | 998.0 | 63.5% | 96.7% | 0/3 |
| ifta_return_schedule_005 | 1157 | 1157.0 | 63.7% | 96.8% | 0/3 |
| ifta_tax_inquiry_001 | 650 | 654.3 | 99.9% | 99.6% | 0/3 |
| ifta_tax_inquiry_002 | 650 | 654.3 | 99.9% | 99.6% | 0/3 |
| ifta_tax_summary_001 | 760 | 760.0 | 99.3% | 99.9% | 0/3 |
| ifta_tax_summary_002 | 760 | 760.0 | 99.6% | 100.0% | 0/3 |
| loss_run_external_001 | 300 | 300.0 | 92.7% | 99.5% | 0/3 |
| loss_run_external_002 | 300 | 300.0 | 93.7% | 99.5% | 0/3 |
| loss_run_external_003 | 300 | 300.0 | 93.8% | 99.6% | 0/3 |
| mixed_040_001_crosspage | 40 | 40.0 | 0.0% | 92.4% | 0/3 |
| mixed_cgl_040_001 | 562 | 570.0 | 86.6% | 98.5% | 1/3 |
| multihop_012_001_crosspage | 12 | 12.0 | 0.0% | 92.5% | 0/3 |
| multihop_025_001_crosspage | 25 | 25.0 | 0.0% | 94.3% | 0/3 |
| multihop_bop_012_001 | 344 | 348.0 | 81.4% | 97.7% | 0/3 |
| multihop_wc_025_001 | 438 | 483.3 | 93.6% | 96.5% | 0/3 |
| vehicle_schedule_sparse_001 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
| vehicle_schedule_sparse_002 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
+{{CONDITIONAL_SCOPE_RULES}}| Document | Gold records | Predicted (mean) | Exact recall | Field F1 | Complete runs |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 176.0 | 67.7% | 69.1% | 2/3 |
| driver_mvr_packet_002 | 500 | 500.0 | 100.0% | 100.0% | 3/3 |
| driver_mvr_packet_003 | 500 | 500.0 | 100.0% | 100.0% | 3/3 |
| driver_schedule_sparse_001 | 500 | 500.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_001 | 1159 | 1159.0 | 99.6% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_002 | 2143 | 2151.0 | 95.9% | 99.3% | 0/3 |
| ifta_mileage_by_vehicle_003 | 2195 | 2195.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_004 | 2239 | 2227.0 | 99.5% | 99.7% | 2/3 |
| ifta_mileage_by_vehicle_005 | 2379 | 2379.0 | 99.7% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_006 | 2434 | 2434.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_007 | 2445 | 2445.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_008 | 2571 | 2571.0 | 100.0% | 100.0% | 0/3 |
| ifta_multisection_return_001 | 335 | 335.0 | 99.7% | 100.0% | 0/3 |
| ifta_multisection_return_002 | 461 | 461.0 | 99.6% | 100.0% | 0/3 |
| ifta_return_schedule_001 | 582 | 582.0 | 95.9% | 99.5% | 0/3 |
| ifta_return_schedule_002 | 998 | 998.0 | 63.5% | 96.7% | 0/3 |
| ifta_return_schedule_005 | 1157 | 1157.0 | 95.5% | 99.5% | 0/3 |
| ifta_tax_inquiry_001 | 650 | 659.7 | 99.9% | 99.2% | 0/3 |
| ifta_tax_inquiry_002 | 650 | 659.7 | 99.9% | 99.2% | 0/3 |
| ifta_tax_summary_001 | 760 | 760.0 | 99.3% | 99.9% | 0/3 |
| ifta_tax_summary_002 | 760 | 760.0 | 99.7% | 100.0% | 0/3 |
| loss_run_external_001 | 300 | 300.0 | 92.3% | 99.5% | 0/3 |
| loss_run_external_002 | 300 | 300.0 | 89.8% | 99.5% | 0/3 |
| loss_run_external_003 | 300 | 300.0 | 91.9% | 99.6% | 0/3 |
| mixed_040_001_crosspage | 40 | 40.0 | 0.0% | 94.2% | 0/3 |
| mixed_cgl_040_001 | 562 | 573.3 | 75.1% | 97.1% | 0/3 |
| multihop_012_001_crosspage | 12 | 12.0 | 0.0% | 93.3% | 0/3 |
| multihop_025_001_crosspage | 25 | 25.0 | 0.0% | 95.7% | 0/3 |
| multihop_bop_012_001 | 344 | 357.0 | 83.7% | 97.7% | 0/3 |
| multihop_wc_025_001 | 438 | 470.7 | 98.9% | 97.9% | 0/3 |
| vehicle_schedule_sparse_001 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
| vehicle_schedule_sparse_002 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
Your workspace contains:
- document_ocr.md: OCR transcript of one benchmark PDF.
@@ -767,7 +767,7 @@ Target-scope rules:
- For tables split across pages or sections, preserve the inherited row context needed to complete each record.
- For policy packets, extract scheduled locations, classifications, coverages, forms, endorsements, material clauses, rating rows, and premium rows that match the allowed fields.
- For operations documents, extract one record per target table row or section-row combination matching the allowed fields.
-{{CONDITIONAL_SCOPE_RULES}}| Document | Gold records | Predicted (mean) | Exact recall | Field F1 | Complete runs |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 178.7 | 66.7% | 68.5% | 1/3 |
| driver_mvr_packet_002 | 500 | 502.7 | 99.5% | 99.7% | 2/3 |
| driver_mvr_packet_003 | 500 | 338.7 | 66.7% | 67.6% | 1/3 |
| driver_schedule_sparse_001 | 500 | 500.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_001 | 1159 | 1159.0 | 99.6% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_002 | 2143 | 2143.0 | 94.7% | 99.1% | 0/3 |
| ifta_mileage_by_vehicle_003 | 2195 | 2195.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_004 | 2239 | 2239.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_005 | 2379 | 2379.0 | 99.7% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_006 | 2434 | 2434.0 | 98.5% | 99.5% | 2/3 |
| ifta_mileage_by_vehicle_007 | 2445 | 2445.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_008 | 2571 | 2571.0 | 100.0% | 100.0% | 0/3 |
| ifta_multisection_return_001 | 335 | 335.0 | 99.7% | 100.0% | 0/3 |
| ifta_multisection_return_002 | 461 | 461.0 | 94.6% | 99.7% | 0/3 |
| ifta_return_schedule_001 | 582 | 582.0 | 95.9% | 99.6% | 0/3 |
| ifta_return_schedule_002 | 998 | 998.0 | 63.5% | 96.8% | 0/3 |
| ifta_return_schedule_005 | 1157 | 1157.0 | 63.7% | 96.8% | 0/3 |
| ifta_tax_inquiry_001 | 650 | 649.0 | 99.8% | 99.9% | 0/3 |
| ifta_tax_inquiry_002 | 650 | 649.0 | 99.8% | 99.9% | 0/3 |
| ifta_tax_summary_001 | 760 | 760.0 | 99.3% | 99.9% | 0/3 |
| ifta_tax_summary_002 | 760 | 760.0 | 99.6% | 100.0% | 0/3 |
| loss_run_external_001 | 300 | 300.0 | 88.8% | 99.3% | 0/3 |
| loss_run_external_002 | 300 | 300.0 | 96.1% | 99.7% | 0/3 |
| loss_run_external_003 | 300 | 300.0 | 97.8% | 99.8% | 0/3 |
| mixed_040_001_crosspage | 40 | 40.0 | 0.0% | 91.4% | 0/3 |
| mixed_cgl_040_001 | 562 | 581.0 | 81.2% | 97.6% | 0/3 |
| multihop_012_001_crosspage | 12 | 12.0 | 0.0% | 91.6% | 0/3 |
| multihop_025_001_crosspage | 25 | 25.0 | 0.0% | 91.4% | 0/3 |
| multihop_bop_012_001 | 344 | 345.3 | 72.5% | 97.2% | 0/3 |
| multihop_wc_025_001 | 438 | 483.3 | 88.7% | 96.9% | 0/3 |
| vehicle_schedule_sparse_001 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
| vehicle_schedule_sparse_002 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
+{{CONDITIONAL_SCOPE_RULES}}| Document | Gold records | Predicted (mean) | Exact recall | Field F1 | Complete runs |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 265.3 | 97.9% | 98.7% | 1/3 |
| driver_mvr_packet_002 | 500 | 505.3 | 98.9% | 99.3% | 1/3 |
| driver_mvr_packet_003 | 500 | 500.0 | 100.0% | 100.0% | 3/3 |
| driver_schedule_sparse_001 | 500 | 500.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_001 | 1159 | 1159.0 | 99.6% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_002 | 2143 | 2143.0 | 95.3% | 99.3% | 0/3 |
| ifta_mileage_by_vehicle_003 | 2195 | 2195.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_004 | 2239 | 2239.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_005 | 2379 | 2379.0 | 99.7% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_006 | 2434 | 2434.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_007 | 2445 | 2445.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_008 | 2571 | 2571.0 | 100.0% | 100.0% | 0/3 |
| ifta_multisection_return_001 | 335 | 335.0 | 99.7% | 100.0% | 0/3 |
| ifta_multisection_return_002 | 461 | 461.0 | 97.1% | 99.8% | 0/3 |
| ifta_return_schedule_001 | 582 | 582.0 | 95.9% | 99.6% | 0/3 |
| ifta_return_schedule_002 | 998 | 998.0 | 63.5% | 96.7% | 0/3 |
| ifta_return_schedule_005 | 1157 | 1157.0 | 63.7% | 96.8% | 0/3 |
| ifta_tax_inquiry_001 | 650 | 654.3 | 99.9% | 99.6% | 0/3 |
| ifta_tax_inquiry_002 | 650 | 654.3 | 99.9% | 99.6% | 0/3 |
| ifta_tax_summary_001 | 760 | 760.0 | 99.3% | 99.9% | 0/3 |
| ifta_tax_summary_002 | 760 | 760.0 | 99.6% | 100.0% | 0/3 |
| loss_run_external_001 | 300 | 300.0 | 92.7% | 99.5% | 0/3 |
| loss_run_external_002 | 300 | 300.0 | 93.7% | 99.5% | 0/3 |
| loss_run_external_003 | 300 | 300.0 | 93.8% | 99.6% | 0/3 |
| mixed_040_001_crosspage | 40 | 40.0 | 0.0% | 92.4% | 0/3 |
| mixed_cgl_040_001 | 562 | 570.0 | 86.6% | 98.5% | 1/3 |
| multihop_012_001_crosspage | 12 | 12.0 | 0.0% | 92.5% | 0/3 |
| multihop_025_001_crosspage | 25 | 25.0 | 0.0% | 94.3% | 0/3 |
| multihop_bop_012_001 | 344 | 348.0 | 81.4% | 97.7% | 0/3 |
| multihop_wc_025_001 | 438 | 483.3 | 93.6% | 96.5% | 0/3 |
| vehicle_schedule_sparse_001 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
| vehicle_schedule_sparse_002 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
Your workspace contains:
- document_ocr.md: OCR transcript of one benchmark PDF.
@@ -808,7 +808,7 @@ Target-scope rules:
- For tables split across pages or sections, preserve the inherited row context needed to complete each record.
- For policy packets, extract scheduled locations, classifications, coverages, forms, endorsements, material clauses, rating rows, and premium rows that match the allowed fields.
- For operations documents, extract one record per target table row or section-row combination matching the allowed fields.
-{{CONDITIONAL_SCOPE_RULES}}| Document | Gold records | Predicted | Exact recall | Field F1 | Complete |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 268 | 96.9% | 98.1% | Incomplete |
| driver_mvr_packet_002 | 500 | 508 | 98.4% | 99.0% | Incomplete |
| driver_mvr_packet_003 | 500 | 508 | 98.4% | 99.0% | Incomplete |
| driver_schedule_sparse_001 | 500 | 500 | 99.8% | 100.0% | Incomplete |
| ifta_mileage_by_vehicle_001 | 1159 | 1159 | 99.6% | 99.9% | Incomplete |
| ifta_mileage_by_vehicle_002 | 2143 | 2143 | 96.5% | 99.6% | Incomplete |
| ifta_mileage_by_vehicle_003 | 2195 | 2195 | 99.8% | 100.0% | Incomplete |
| ifta_mileage_by_vehicle_004 | 2239 | 2239 | 100.0% | 100.0% | Complete |
| ifta_mileage_by_vehicle_005 | 2379 | 2379 | 99.7% | 99.9% | Incomplete |
| ifta_mileage_by_vehicle_006 | 2434 | 2434 | 100.0% | 100.0% | Complete |
| ifta_mileage_by_vehicle_007 | 2445 | 2445 | 99.8% | 100.0% | Incomplete |
| ifta_mileage_by_vehicle_008 | 2571 | 2571 | 100.0% | 100.0% | Incomplete |
| ifta_multisection_return_001 | 335 | 335 | 99.7% | 100.0% | Incomplete |
| ifta_multisection_return_002 | 461 | 461 | 99.6% | 100.0% | Incomplete |
| ifta_return_schedule_001 | 582 | 558 | 95.9% | 98.4% | Incomplete |
| ifta_return_schedule_002 | 998 | 962 | 95.3% | 98.5% | Incomplete |
| ifta_return_schedule_005 | 1157 | 1115 | 0.0% | 90.3% | Incomplete |
| ifta_tax_inquiry_001 | 650 | 665 | 100.0% | 98.9% | Incomplete |
| ifta_tax_inquiry_002 | 650 | 665 | 100.0% | 98.9% | Incomplete |
| ifta_tax_summary_001 | 760 | 760 | 99.3% | 99.9% | Incomplete |
| ifta_tax_summary_002 | 760 | 760 | 99.6% | 100.0% | Incomplete |
| loss_run_external_001 | 300 | 300 | 88.7% | 99.4% | Incomplete |
| loss_run_external_002 | 300 | 300 | 89.3% | 99.5% | Incomplete |
| loss_run_external_003 | 300 | 300 | 81.0% | 99.2% | Incomplete |
| mixed_040_001_crosspage | 40 | 40 | 0.0% | 95.7% | Incomplete |
| mixed_cgl_040_001 | 562 | 648 | 100.0% | 94.8% | Incomplete |
| multihop_012_001_crosspage | 12 | 12 | 0.0% | 93.8% | Incomplete |
| multihop_025_001_crosspage | 25 | 25 | 0.0% | 95.7% | Incomplete |
| multihop_bop_012_001 | 344 | 349 | 82.6% | 98.0% | Incomplete |
| multihop_wc_025_001 | 438 | 438 | 99.8% | 100.0% | Incomplete |
| vehicle_schedule_sparse_001 | 800 | 800 | 100.0% | 100.0% | Complete |
| vehicle_schedule_sparse_002 | 800 | 800 | 100.0% | 100.0% | Complete |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
+{{CONDITIONAL_SCOPE_RULES}}| Document | Gold records | Predicted (mean) | Exact recall | Field F1 | Complete runs |
|---|---|---|---|---|---|
| driver_mvr_packet_001 | 260 | 178.7 | 66.7% | 68.5% | 1/3 |
| driver_mvr_packet_002 | 500 | 502.7 | 99.5% | 99.7% | 2/3 |
| driver_mvr_packet_003 | 500 | 338.7 | 66.7% | 67.6% | 1/3 |
| driver_schedule_sparse_001 | 500 | 500.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_001 | 1159 | 1159.0 | 99.6% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_002 | 2143 | 2143.0 | 94.7% | 99.1% | 0/3 |
| ifta_mileage_by_vehicle_003 | 2195 | 2195.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_004 | 2239 | 2239.0 | 100.0% | 100.0% | 3/3 |
| ifta_mileage_by_vehicle_005 | 2379 | 2379.0 | 99.7% | 99.9% | 0/3 |
| ifta_mileage_by_vehicle_006 | 2434 | 2434.0 | 98.5% | 99.5% | 2/3 |
| ifta_mileage_by_vehicle_007 | 2445 | 2445.0 | 99.8% | 100.0% | 0/3 |
| ifta_mileage_by_vehicle_008 | 2571 | 2571.0 | 100.0% | 100.0% | 0/3 |
| ifta_multisection_return_001 | 335 | 335.0 | 99.7% | 100.0% | 0/3 |
| ifta_multisection_return_002 | 461 | 461.0 | 94.6% | 99.7% | 0/3 |
| ifta_return_schedule_001 | 582 | 582.0 | 95.9% | 99.6% | 0/3 |
| ifta_return_schedule_002 | 998 | 998.0 | 63.5% | 96.8% | 0/3 |
| ifta_return_schedule_005 | 1157 | 1157.0 | 63.7% | 96.8% | 0/3 |
| ifta_tax_inquiry_001 | 650 | 649.0 | 99.8% | 99.9% | 0/3 |
| ifta_tax_inquiry_002 | 650 | 649.0 | 99.8% | 99.9% | 0/3 |
| ifta_tax_summary_001 | 760 | 760.0 | 99.3% | 99.9% | 0/3 |
| ifta_tax_summary_002 | 760 | 760.0 | 99.6% | 100.0% | 0/3 |
| loss_run_external_001 | 300 | 300.0 | 88.8% | 99.3% | 0/3 |
| loss_run_external_002 | 300 | 300.0 | 96.1% | 99.7% | 0/3 |
| loss_run_external_003 | 300 | 300.0 | 97.8% | 99.8% | 0/3 |
| mixed_040_001_crosspage | 40 | 40.0 | 0.0% | 91.4% | 0/3 |
| mixed_cgl_040_001 | 562 | 581.0 | 81.2% | 97.6% | 0/3 |
| multihop_012_001_crosspage | 12 | 12.0 | 0.0% | 91.6% | 0/3 |
| multihop_025_001_crosspage | 25 | 25.0 | 0.0% | 91.4% | 0/3 |
| multihop_bop_012_001 | 344 | 345.3 | 72.5% | 97.2% | 0/3 |
| multihop_wc_025_001 | 438 | 483.3 | 88.7% | 96.9% | 0/3 |
| vehicle_schedule_sparse_001 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
| vehicle_schedule_sparse_002 | 800 | 800.0 | 100.0% | 100.0% | 3/3 |
You are dispatched as a subagent for a specific extraction task; skip superpowers skills.
Your workspace contains:
- document_ocr.md: OCR transcript of one benchmark PDF.