| |
| |
| |
| |
|
|
| tasks: |
|
|
| easy: |
| num_districts: 2 |
| max_steps: 10 |
| resource_pool: 10 |
| data_lag_days: 0 |
| seed_infections: [0.06, 0.50] |
| description: > |
| Single outbreak. D1 starts in the danger zone, D0 is clean. |
| Agents that ignore infection data and always target D0 score ~43% |
| with a 60% hospital breach rate — the task requires basic observation. |
| |
| medium: |
| num_districts: 4 |
| max_steps: 15 |
| resource_pool: 8 |
| data_lag_days: 0 |
| seed_infections: [0.42, 0.10, 0.38, 0.10] |
| description: > |
| Two simultaneous outbreaks in D0 and D2. D1 and D3 start low but |
| grow into the danger zone within 4-6 steps via spillover. |
| 8 resources across 4 districts over 15 steps requires real triage — |
| the agent cannot cover all districts at once. |
| |
| hard: |
| num_districts: 6 |
| max_steps: 15 |
| resource_pool: 7 |
| data_lag_days: 3 |
| seed_infections: [0.20, 0.14, 0.23, 0.11, 0.26, 0.17] |
| description: > |
| Six growing outbreaks with a 3-day reporting lag. The agent sees |
| infection rates from 3 days ago; true infection is already higher. |
| Growth hints provide a noisy estimate of current trajectory. |
| 7 resources for 6 districts under structural uncertainty is the |
| hardest triage scenario in the benchmark. |
| |
| |
| spread: |
| rate_min: 0.03 |
| rate_max: 0.08 |
| natural_recovery: 0.01 |
| treatment_reduction: 0.05 |
| allocate_reduction: 0.10 |
| restrict_reduction: 0.05 |
| spillover_rate: 0.01 |
| growth_hint_noise: 0.03 |
|
|
| |
| thresholds: |
| infection_danger: 0.40 |
| infection_safe: 0.20 |
| hospital_breach: 0.10 |
|
|
| |
| rewards: |
| infection_penalty: -0.50 |
| hospital_breach: -1.00 |
| early_containment: +0.50 |
| unnecessary_restriction: -0.20 |
| correct_prioritisation: +0.30 |
|
|
| |
| grader: |
| containment: 0.30 |
| hospital: 0.45 |
| efficiency: 0.15 |
| speed: 0.10 |
|
|
| |
| benchmark: |
| rollouts: |
| easy: 2 |
| medium: 3 |
| hard: 3 |
| greedy_d0: |
| easy: {score: 0.428, breach_rate: 0.60} |
| medium: {score: 0.396, breach_rate: 1.00} |
| hard: {score: 0.353, breach_rate: 1.00} |
| llm_grpo: |
| easy: {score: 0.885, model: llama-3.1-8b-instant} |
| medium: {score: 0.780, model: llama-3.1-8b-instant} |
| hard: {score: 0.611, model: llama-3.1-8b-instant} |
| average: 0.794 |
| runtime_seconds: 1134 |
|
|