AI Coscientist

non-profit

AI & ML interests

None defined yet.

talor-abramovich

updated a Space 6 months ago

AblationBench

Generate ablation plans for research papers

talor-abramovich

published a Space 6 months ago

AblationBench

Generate ablation plans for research papers

talor-abramovich

updated a collection 6 months ago

AblationBench

This is a collection of datasets used to evaluate language models in the task of ablation planning in empirical AI research. • 5 items • Updated Feb 10 • 6

talor-abramovich

updated 4 datasets 6 months ago

ai-coscientist/reviewer-ablation-judge-eval

Viewer • Updated Feb 2 • 60 • 33 • 1

ai-coscientist/researcher-ablation-judge-eval

Viewer • Updated Feb 2 • 63 • 29

ai-coscientist/researcher-ablation-bench

Viewer • Updated Feb 2 • 83 • 76 • 1

ai-coscientist/reviewer-ablation-bench

Viewer • Updated Feb 2 • 6.26k • 60

talor-abramovich

authored 2 papers 12 months ago

EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities

Paper • 2409.16165 • Published Sep 24, 2024

AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Research

Paper • 2507.08038 • Published Jul 9, 2025 • 1

talor-abramovich

updated a collection about 1 year ago

AblationBench

This is a collection of datasets used to evaluate language models in the task of ablation planning in empirical AI research. • 5 items • Updated Feb 10 • 6

talor-abramovich

published a Space about 1 year ago

README

talor-abramovich

published 4 datasets about 1 year ago

ai-coscientist/reviewer-ablation-judge-eval

Viewer • Updated Feb 2 • 60 • 33 • 1

ai-coscientist/reviewer-ablation-bench

Viewer • Updated Feb 2 • 6.26k • 60

ai-coscientist/researcher-ablation-bench

Viewer • Updated Feb 2 • 83 • 76 • 1

ai-coscientist/researcher-ablation-judge-eval

Viewer • Updated Feb 2 • 63 • 29