Hugging Face
Search models, datasets, users...
Ctrl K
Models
Datasets
Spaces
Buckets
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Spaces:
Duplicated from
Station-house/ConspiracyBench
daKeshra
/
ConspiracyBench
Like
0
Running
App
Files
Files
Community
main
ConspiracyBench
/
inspect_eval
298 kB
Ctrl+K
Ctrl+K
31 contributors
History:
30 commits
stationhouse
Add inspect_eval/EVAL_SETTINGS.md: the default eval settings in one place (#463)
0ddfd0f
8 days ago
decision_judges
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
ollama
Add a solver speed test and report Qwen3.5 4B results on Ollama (#119)
about 1 month ago
scorer
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
solver
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
EVAL_SETTINGS.md
Safe
4.41 kB
Add inspect_eval/EVAL_SETTINGS.md: the default eval settings in one place (#463)
8 days ago
README.md
Safe
31.3 kB
Add inspect_eval/EVAL_SETTINGS.md: the default eval settings in one place (#463)
8 days ago
cb_budget.py
Safe
5.61 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
cb_dataset.py
Safe
6.96 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
cb_metrics.py
Safe
7.36 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
conspiracybench.py
Safe
10.4 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
export_units.py
Safe
4.12 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
judge_cases.py
Safe
3.32 kB
[experiment] Judge reliability: diagnosis, label review, rubric experiments, explorer (#409)
27 days ago
modal_lora.py
Safe
8.64 kB
[experiment] [request for compute] Add /ck/ control experiment for #436 (#454)
12 days ago
modal_solver.py
Safe
17.4 kB
[experiment] [request for compute] Add /ck/ control experiment for #436 (#454)
12 days ago
needs_tokenizer.py
Safe
1.15 kB
Stress test solver (B4) (#334)
about 1 month ago
report.py
Safe
17.8 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
roster.md
Safe
4.74 kB
Add experiment_requests/ and completed_experiments/ folders (#408)
about 1 month ago
speedtest.py
Safe
13.9 kB
Scorer cost: cap the judge reply at its budget, add speedtest --same-labels, document measured settings (#254)
about 1 month ago
test_conspiracybench.py
Safe
57 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
test_eval_suite.py
Safe
13.1 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
test_infrastructure.py
Safe
20.7 kB
Baseline eval: five ~4B thinking models on ConspiracyBench, graded by pplx-decider (#428)
26 days ago
test_metrics_hand_computed.py
Safe
8.46 kB
Check the metrics against hand-computed values, in report.py and cb_metrics.py (#198)
about 1 month ago
test_speedtest.py
Safe
5.31 kB
Stress test solver (B4) (#334)
about 1 month ago
test_truncated_reply.py
Safe
10.5 kB
Stress test solver (B4) (#334)
about 1 month ago
test_unusual_inputs.py
Safe
10.4 kB
Stress test the solver (B5): the whole corpus and unusual-but-valid input (#350)
about 1 month ago