Laura Bocek

stationhouse's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Station-house/ConspiracyBench about 13 hours ago

Add question: WTC 7 collapse

4

#18 opened 5 days ago by

Emar7

New activity in Station-house/ConspiracyBench about 15 hours ago

Document PR review and the agent-comment convention

#40 opened about 15 hours ago by

stationhouse

Rename the 9-11 category to terrorism

👍 1

#39 opened about 15 hours ago by

stationhouse

Add optional claim_id field

#23 opened 4 days ago by

melover24

Pass@k for testing

7

#32 opened 3 days ago by

likelytobelaura

Add k=5 repeated sampling with worst-of-k, all-k-agree and pass@k

1

#38 opened about 15 hours ago by

stationhouse

New activity in Station-house/ConspiracyBench about 16 hours ago

cb-pending fixed id collisions, but every PR still edits the same file

3

#37 opened about 17 hours ago by

anushka1409

New activity in Station-house/ConspiracyBench 1 day ago

Add judge reliability evaluation artifacts

#35 opened 3 days ago by

melover24

Add optional pressure_turns for multi-turn items

4

#25 opened 4 days ago by

Emar7

New activity in Station-house/ConspiracyBench 3 days ago

Duplicate-checker calibration: 0.60 mostly behaves as a related-topic threshold

2

#29 opened 4 days ago by

melover24

New activity in Station-house/ConspiracyBench 4 days ago

Add framing to questions/template.jsonl

#22 opened 4 days ago by

stationhouse

Add judge regression cases

2

#20 opened 5 days ago by

melover24

Benchmark Schema Updates

5

#17 opened 5 days ago by

divyanshijoshi

Move eval scripts into eval/, separate from scripts/ corpus tooling

#21 opened 4 days ago by

stationhouse

Add judge prompt builder

#15 opened 5 days ago by

melover24

Add outcome scoring helper

#14 opened 5 days ago by

melover24

Single-turn items can't test "when pressed"- proposal for optional pressure_turns

4

#19 opened 5 days ago by

Emar7

Fix sequential id collisions with a cb-pending placeholder

#13 opened 5 days ago by

stationhouse

Make category a fixed enum with an other escape hatch

#12 opened 5 days ago by

stationhouse

Add diverges_if / does_not_diverge_if judge-guidance fields

#11 opened 5 days ago by

stationhouse