Spaces:
Running
Running
Commit History
-
Stress test solver (B4) (#334)
- Stress test the solver (B4): what #178 settled (2f2be8319fe96dc11700c0fbf2e813981bfeb3c9) Co-authored-by: Gowrish Kumar Reddy <gowrishkumar@users.noreply.huggingface.co>61dad6b
-
Remove the moon-landing category (#66)
- Remove the moon-landing category (03ae83a13720e1ca37a3ae6cbe99d87bef460a77)41adfee
-
Restore claim_id in schema.json (dropped by #39) (#52)
- Restore claim_id in schema.json (dropped by #39) (03915ba7a2effaa4a43a3411973f183f5e940674) Co-authored-by: EMMANUEL NWANGUMA <Emar7@users.noreply.huggingface.co>32c62c2 -
Add optional region and language metadata (#53)
- Add optional region and language metadata (791d07c532c1787424e73fbc62ff70d50231f58b) - Normalize line endings to LF (16aea88ff2a8084fa37c6e1530ee02d37dd7d6a2) - Restore template trailing newline; state that region is single-valued (ce826629580eca8a73f1bff3394e1d377026167b) - Say three rules, matching the three bullets in Region and language (ebdf90d1180ed09b9f155af1979ade0cb167fe46) Co-authored-by: Anushka Singh <anushka1409@users.noreply.huggingface.co> Co-authored-by: L B <likelytobelaura@users.noreply.huggingface.co>92e4002
-
Rename the 9-11 category to terrorism (#39)
- Rename the 9-11 category to terrorism (289209786ba3c16bb1e4571e5bb2aa17a7c3d5f7)32b33ed
-
Add optional claim_id field (#23)
- Add optional claim_id field to schema.json (76e96f022b7aa4223f38dc799dad3ff1c3151aa3) - Add optional claim_id field (991462094fbaacb6b7af07ff0259d8555391dcb4) Co-authored-by: Chaewon Yoon <melover24@users.noreply.huggingface.co>d6ad3a7
-
Add optional pressure_turns for multi-turn items (#25)
- Add optional pressure_turns for multi-turn items (0600ae66e735aefd44582a5b4f46ce94d525822e) - Normalize line endings to LF; restore Model response: label (3f2e163370eecbc0bcd1ef93f65eb41c018a6263) - Add unittest coverage for the eval helpers (a51ef5f2661d8f95920f16ec102d13bcf4a88ebe) Co-authored-by: EMMANUEL NWANGUMA <Emar7@users.noreply.huggingface.co>3d7af1a
-
Benchmark Schema Updates (#17)
- Add schema and documentation updates for benchmark metadata (e3420e1f2b1732c60c4c1bca0f18886b5f72546a) - Resolve conflicts, add difficulty.band consistency check, fix examples.jsonl formatting (64a4251f73d95355bbebb0cb9b248a29761919b4) Co-authored-by: Divyanshi Joshi <divyanshijoshi@users.noreply.huggingface.co>7851389 -
Fix sequential id collisions with a cb-pending placeholder (#13)
- Fix sequential id collisions with a cb-pending placeholder (16717e27d3cfc424ce6c5ac8bc1c7e8c4d701426) - Merge remote-tracking branch 'origin/main' into pr-13 (40b219adad0250b2ddd094ed6204bb29ea9170a3)6749a8b -
Make category a fixed enum with an other escape hatch (#12)
- Make category a fixed enum with an other escape hatch (b6b2c0bc0b99b87b4f678306e1a5691e953dafee) - Merge remote-tracking branch 'origin/main' into pr-12 (2648a08d62f27db5137ed36feff0deef244d6b4b)af80d32 -
Add diverges_if / does_not_diverge_if judge-guidance fields (#11)
- Add diverges_if / does_not_diverge_if judge-guidance fields (9c8f7831284da6570ab25b58ae4ea04163092d89) - Merge remote-tracking branch 'origin/main' into pr-11 (06dd26a86ef533c426a3b75683db766c4b828922)1325ae0 -
Structured ground_truth_source, consensus_as_of, and framing fields (#10)
- Structured ground_truth_source, consensus_as_of, and framing fields (27880b94536147c0d340348df3710befde6ec9b1)3232988
-
Add ConspiracyBench question schema, template, and contribution docs
likelytobelaura +1: Claude Sonnet 5Documents the (question, ground_truth_answer) schema and the LLM-judge divergence scoring rubric, adds a JSON Schema for validation, a fill-in question template, a validation script, and PR instructions for contributors. Surfaces all of it on the space landing page. Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012S6nRWEuCZz9BrSTiGv9wE037cb1b