OpenRA-Bench / tests

Commit History

Merge pull request #5 from yiyu-tian/scenarios/tech-production-planning
7c62ead
unverified

yiyu-tian commited on

botgen: surface scripted opponents for YAML; drop premature capture_actor
ca911f6

yxc20098 commited on

mapgen: surface map generator for YAML (base_map generator spec)
d3514c7

yxc20098 commited on

win-speed bonus: record + reward how fast a model wins
35d7d47

yxc20098 commited on

tests: tech-production-planning pack — full Rust loop
9afe0cd

Yiyu Tian Claude Opus 4.7 commited on

#2 hard: set base_map INSIDE overrides so it actually uses scout-arena
cdd813f

yxc20098 commited on

#2: enforce ordered waypoints (stateful waypoint_sequence) + two-path medium + scouted hard
b165246

yxc20098 commited on

action-multiunit-coordination hard: spatial-grounding via relative-direction objective
51d66ad

yxc20098 commited on

prompt_v2: sanitize confusing 'Buildings: ? ()' briefing line
5a3c04b

yxc20098 commited on

action-multiunit-coordination medium: disperse the 3 regions (multi-vector)
a3fc650

yxc20098 commited on

Default spawn_mcvs:false — stop engine auto-seeding phantom MCVs
f1ea367

yxc20098 commited on

playback: append a terminal 'episode end' frame (the resolved win/loss board)
7dbeb97

yxc20098 commited on

Fix action-multiunit-coordination: enforce split, binding deadline, real fail
deb7cde

yxc20098 commited on

De-dup: consolidate aimless scenario duplicates (24→21 active)
834b683

yxc20098 commited on

Scenario configs (level+fog per cell) + adversarial-duel duel/interrupts + clearer names
f244b78

yxc20098 commited on

Structured-fog text mode, premium routing, codex descriptions, minimap colour-by-difficulty
93ee9dd

yxc20098 commited on

prompt_v2: strip ASCII minimap from the briefing (training parity)
fe09c5b

yxc20098 commited on

test: pin run_id in whole-result determinism test (wall-clock label, not part of contract)
d57bdd5

yxc20098 commited on

Wire bench to vendored training prompt v2 (system/briefing/minimap)
8e88074

yxc20098 commited on

Vendor training prompt/briefing/minimap v2 (byte-identical)
96c15d6

yxc20098 commited on

Training-parity minimap (real terrain + legend) + viewer (system/thinking/debrief)
39fba02

yxc20098 commited on

Live-smoke fixes: tool-call wire 400, episode resilience, real PNG minimap
247ff7a

yxc20098 commited on

run_eval: dependency-free .env autoload for the API key
82e69a9

yxc20098 commited on

Deterministic scenario-scoped game knowledge + explicit objective
049448a

yxc20098 commited on

Strategy packs: faithful 'destroy key economic buildings' objective
e6d690e

yxc20098 commited on

S8: capture_actor tool schema + dispatch; wildcard count 21->22
18612b1

yxc20098 commited on

Hard-tier curation: action/perception/reasoning/strict/rush-hour + exhaustive classification
2e5c9a4

yxc20098 commited on

Hard-tier curation: Art-of-War quartet
b3ebc0e

yxc20098 commited on

Hard-tier curation: adversarial family (skirmish, siege)
466f040

yxc20098 commited on

Hard-tier curation: seed-driven spawn variation (exemplar + invariant)
199bf71

yxc20098 commited on

Curate: remove the auto-generated cat-* corpus
e9d5097

yxc20098 commited on

Eval resilience layer for real OpenRouter runs
424da31

yxc20098 commited on

Scenario hygiene: quarantine redundant cat-* + harvest packs
8bb4b88

yxc20098 commited on

Art-of-War long-horizon family: sacrifice/detour, delayed credit
5b73a50

yxc20098 commited on

Strict-action-API family: spec fidelity as the objective
85964f1

yxc20098 commited on

Adversarial 1v1 spotlight: ladder family + rating + Elo wiring
f5e23f8

yxc20098 commited on

cargo tools: enter_transport + unload, 1:1 congruence
755ab44

yxc20098 commited on

Unified Battle Viewer in app.py + run/model playback identity
0a488d3

yxc20098 commited on

guard tool: 1:1 congruence with engine Command.guard
18d038a

yxc20098 commited on

Wire goal tracker into scoring + leaderboard
eeedfdf

yxc20098 commited on

Playback: capture model reasoning + per-turn goal tracker + viewer
f77eea7

yxc20098 commited on

Scenario-controlled tool allow/deny + default core set
f912cfc

yxc20098 commited on

S7 bench: surrender tool + loss outcome (tool schema 1:1, 15==15)
09ac234

yxc20098 commited on

Step 4 (bench): interrupt-driven loop + playback/trace capture
03c65ab

yxc20098 commited on

Step 2: concurrent scenario execution (--concurrency N)
3771d77

yxc20098 commited on

Pipeline step 7: per-episode playback persistence
28c736f

yxc20098 commited on

Bench: surface S9 spatial tensor in render_state (multimodal reach)
41a0d2e

yxc20098 commited on

Pairwise adversarial eval + Elo (the user's 'pairwise conditions')
b04adfc

yxc20098 commited on

Generalization-gap metric: held-out split in run_eval + leaderboard
03e4efa

yxc20098 commited on

Catalog C13: harvest-economy packs — closes #14 (user economy families)
7a25eb3

yxc20098 commited on