scrubdata / docs /WILD_BENCH.md
OpenAI Codex
deploy: add sponsor:openai tag (Best Use of Codex) + Codex-hardened build
16dc556
|
Raw
History Blame Contribute Delete
3.79 kB
# Wild Bench β€” can the shipped system clean real-world tables?
Behavioral audit + seeded inject-recovery per dataset (eval/wild_bench.py).
| dataset | domain | rowsΓ—cols | valid | changes | flags | PII | silent | typo | ocr | case | ws | mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| airlines | aviation | 56Γ—8 | βœ“ | 413 | 1 | 1 | 0 | β€” | β€” | β€” | β€” | β€” |
| billboard | music-billboard | 317Γ—83 | βœ“ | 36222 | 3 | 2 | 0 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 |
| acnc_charities | nonprofits-au | 800Γ—69 | βœ“ | 43268 | 4 | 1 | 0 | 0.00 | 0.00 | 0.01 | 0.01 | 0.01 |
| open_food_facts | food-products | 800Γ—211 | βœ“ | 27115 | 34 | 5 | 0 | 0.02 | 0.02 | 0.02 | 0.03 | 0.02 |
| biz_sf | sf-business | 800Γ—38 | βœ“ | 8060 | 12 | 1 | 0 | 0.02 | 0.05 | 0.02 | 0.07 | 0.04 |
| irs_eo1 | nonprofits-us | 800Γ—28 | βœ“ | 16953 | 5 | 3 | 0 | 0.04 | 0.03 | 0.03 | 0.15 | 0.06 |
| permits_nyc | construction | 800Γ—60 | βœ“ | 16762 | 25 | 3 | 0 | 0.03 | 0.04 | 0.04 | 0.13 | 0.06 |
| pawnbrokers_nyc | business | 800Γ—31 | βœ“ | 8494 | 8 | 2 | 0 | 0.06 | 0.08 | 0.05 | 0.11 | 0.08 |
| proptax_sf | real-estate | 800Γ—46 | βœ“ | 9302 | 3 | 3 | 0 | 0.06 | 0.06 | 0.07 | 0.12 | 0.08 |
| biz_chicago | business-licenses | 800Γ—37 | βœ“ | 12808 | 9 | 2 | 0 | 0.05 | 0.06 | 0.06 | 0.15 | 0.08 |
| permits_seattle | seattle-permits | 800Γ—40 | βœ“ | 6878 | 9 | 2 | 0 | 0.08 | 0.13 | 0.09 | 0.14 | 0.11 |
| restaurants_nyc | restaurants | 800Γ—27 | βœ“ | 7742 | 6 | 4 | 0 | 0.07 | 0.08 | 0.09 | 0.20 | 0.11 |
| titanic | passengers | 800Γ—12 | βœ“ | 5722 | 1 | 0 | 0 | 0.00 | 0.00 | 0.09 | 0.40 | 0.12 |
| biz_la | la-business | 800Γ—16 | βœ“ | 2726 | 9 | 3 | 0 | 0.15 | 0.09 | 0.10 | 0.21 | 0.14 |
| schools_nyc | education | 800Γ—41 | βœ“ | 14387 | 7 | 5 | 0 | 0.08 | 0.14 | 0.12 | 0.22 | 0.14 |
| online_retail | ecommerce-uk | 800Γ—8 | βœ“ | 3413 | 1 | 0 | 0 | 0.26 | 0.01 | 0.01 | 0.30 | 0.14 |
| film_nyc | film | 800Γ—14 | βœ“ | 3049 | 3 | 0 | 0 | 0.14 | 0.16 | 0.11 | 0.23 | 0.16 |
| salary_survey | survey | 800Γ—18 | βœ“ | 4142 | 5 | 0 | 0 | 0.12 | 0.20 | 0.13 | 0.26 | 0.18 |
| restaurants_sf | sf-restaurants | 800Γ—22 | βœ“ | 6002 | 6 | 2 | 0 | 0.15 | 0.15 | 0.16 | 0.26 | 0.18 |
| alcohol_tx | alcohol-bars | 800Γ—24 | βœ“ | 8518 | 9 | 1 | 0 | 0.14 | 0.09 | 0.17 | 0.38 | 0.20 |
| contractors_chi | contractors | 800Γ—116 | βœ“ | 20213 | 22 | 2 | 0 | 0.17 | 0.20 | 0.16 | 0.33 | 0.21 |
| fhv_nyc | transport | 800Γ—23 | βœ“ | 3789 | 4 | 2 | 0 | 0.10 | 0.30 | 0.14 | 0.36 | 0.23 |
| uk_price_paid | real-estate-uk | 800Γ—16 | βœ“ | 1662 | 8 | 0 | 0 | 0.14 | 0.17 | 0.26 | 0.42 | 0.25 |
| food_chicago | food-inspections | 800Γ—17 | βœ“ | 2790 | 6 | 0 | 0 | 0.17 | 0.25 | 0.23 | 0.38 | 0.26 |
| bx_books | books | 800Γ—8 | βœ“ | 1650 | 3 | 1 | 0 | 0.22 | 0.22 | 0.16 | 0.51 | 0.28 |
| bl_flickr_books | library | 800Γ—15 | βœ“ | 1769 | 6 | 1 | 0 | 0.19 | 0.28 | 0.22 | 0.43 | 0.28 |
| svc311_nyc | complaints | 800Γ—44 | βœ“ | 6299 | 16 | 2 | 0 | 0.23 | 0.30 | 0.23 | 0.37 | 0.28 |
| spotify | music | 800Γ—23 | βœ“ | 4669 | 3 | 1 | 0 | 0.20 | 0.28 | 0.30 | 0.36 | 0.28 |
| glassdoor_jobs | job-listings | 800Γ—14 | βœ“ | 1713 | 6 | 0 | 0 | 0.20 | 0.29 | 0.22 | 0.43 | 0.29 |
| ct_real_estate | real-estate-us | 800Γ—14 | βœ“ | 4840 | 4 | 0 | 0 | 0.23 | 0.29 | 0.24 | 0.40 | 0.29 |
| worldcities | geography | 800Γ—4 | βœ“ | 914 | 2 | 0 | 0 | 0.41 | 0.11 | 0.22 | 0.69 | 0.36 |
| fec_indiv80 | political-finance | 800Γ—21 | βœ“ | 4375 | 4 | 2 | 0 | 0.20 | 0.24 | 0.35 | 0.87 | 0.41 |
| payroll_nyc | jobs | 800Γ—17 | βœ“ | 4587 | 3 | 2 | 0 | 0.45 | 0.56 | 0.42 | 0.73 | 0.54 |
| paris_trees | urban-fr | 800Γ—16 | βœ“ | 3305 | 5 | 1 | 0 | 0.43 | 0.54 | 0.55 | 0.73 | 0.56 |
| ev_wa | vehicles | 800Γ—16 | βœ“ | 4085 | 5 | 2 | 0 | 0.50 | 0.56 | 0.48 | 0.91 | 0.61 |