# Task data Each benchmark task gets one TOML file under `manifests/`. The example is a schema template, not an eligible experiment task. Split files contain one `task_id` per line and must be frozen before confirmatory evaluation. Gold patches, gold locations, and hidden tests are evaluator-only data. The agent receives only the problem statement and repository state, except in the explicit oracle controls. Public repository URLs and exact base commits are required for reproducibility; obtain and preserve any repository license and redistribution metadata before publishing a task bundle.