Spaces:
Running
Running
Commit History
14 days ago
-
[experiment] [request for compute] Experiment: conspiracy versus ordinary falsehood training (#444)
- Experiment: conspiracy versus ordinary falsehood training (5ac72b71fd9ee5acfaef21b588e229c47243d98b) - Add reviewed triples and pilot pipeline (caa1c87c641acf49f7edfae306e11458093e8763) - Add pilot results and maintainer design changes (f7121742851872bd94404a460ca058ae2e3d466d) - Add full study results (a691dbcf3205607047429071e207fe19cf430025) - Merge branch 'main' into relocate444 (7ccf521a8bc1cf75533f6ea86e99daf16c67cf0f) - Move conspiracy-vs-falsehood (#444) to completed_experiments/hillclimb/ (8361aae82805c531d4b70465050bd41ea39a799f) Co-authored-by: Tommaso Cerruti <Cerru02@users.noreply.huggingface.co>dead516
21 days ago
-
[experiment] [request for compute] Experiment request: H100 math sycophancy transfer to ConspiracyBench (#442)
- Experiment request: H100 math sycophancy transfer to ConspiracyBench (d835158909dbadef130a67ecf04da73435b8e328) - #442 return: thinking-off H100 run, outputs in completed_experiments/hillclimb/math-sycophancy-transfer (3d7e7e5816ae888e0bb434a1136c79b0e5ee5b24) - Move the run package to completed_experiments/hillclimb/math-sycophancy-transfer/ (baa3529c4bff41cd89e295bcdeadbc1b429a03f1) - Merge main into PR #442 (dfd9b8c39d1ed58dd5e57aa9112b33878639f29d) Co-authored-by: Tomer Zipori <tomerz14@users.noreply.huggingface.co> Co-authored-by: Екатерина К. <asdfasdfqrqwer@users.noreply.huggingface.co>1f4c43b -
[experiment] [request for compute] Experiment request: evidence-focused instruction evaluation (#441)
- Experiment request: evidence-focused instruction evaluation (4a33c37fc5732dcd5eebad2c8e999bf9d7083a5e) - #441 results: evidence instruction lowers multi-turn divergence 5.2 pts [2.2, 8.4] vs neutral (37c8cf32b6c8d78dc550f35386d1700f1d40ba3f) - Merge main into PR #441 (3ae19b9cac2b90c4b4946e7f83a02ebd2bf05254) Co-authored-by: Chaewon Yoon <melover24@users.noreply.huggingface.co> Co-authored-by: Екатерина К. <asdfasdfqrqwer@users.noreply.huggingface.co>fb0b1a5
28 days ago
-
[experiment] Judge reliability: diagnosis, label review, rubric experiments, explorer (#409)
- [experiment] Judge reliability: diagnosis, label review, rubric experiments, explorer (748e53d9bc2899481ac638b02f7aeb23f835379d) - Merge remote-tracking branch 'origin/pr/409' into reliability-v1.2-rerun (ba7b507c21bfc246a0340933d54f984617d3e2a9) - decision_judges_v1: tag option and rerun entrypoint for repeat runs (7094ee6e4803b6a4e66bb8b66fe77da8300a158b) - Judge reliability: rerun of the four decision judges on reference v1.2 (c67545f1c0629921d0f69ad0653bd7bb860e25ad) - Judge reliability rerun: source of the combined judge-trust page (f92d1cb0fbf8cf5bbfe1302021e7f2b7763a6e7d) - Judge reliability rerun: report only headline scores against the final labels (3703f7d70a6e7a50b5c790867486d85e7eae3405)dd0db0a
-
Add experiment_requests/ and completed_experiments/ folders (#408)
- Add experiment_requests/ and completed_experiments/ folders (2df315e50fec0622c4d996e73c5d097524d3e9a0) - Move existing experiments into completed_experiments/, grouped by task (be58213965c5cdf5d528547d39ab6015709e18c8)4f9e6db