File size: 1,861 Bytes
d61821a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 | # Study 2 preflight and execution
Run these commands only from a clean committed research worktree. No GUI model control is part of
the protocol.
```bash
PYTHONPATH=src MPLCONFIGDIR=/tmp/agent-harness-mpl .venv/bin/python -m pytest -q
PYTHONPATH=src .venv/bin/python -m agent_harness.cli validate
PYTHONPATH=src .venv/bin/python scripts/audit_study2_design.py
PYTHONPATH=src .venv/bin/python scripts/preflight_study2.py
```
The outcome-blind preflight uses `lms server start/status/stop` for lifecycle and LM Studio's native
REST API for exclusive residency. It verifies pinned repository heads, dependency versions, disk
headroom, exact agent model variants/contexts/reasoning defaults, tokenizer hashes, custom tool
calling, and embedding dimensions/normalization. It writes
`results/reports/study2_preflight.json` and unloads all models before stopping the server.
The main and reliability executions are resumable:
```bash
PYTHONPATH=src MPLCONFIGDIR=/tmp/agent-harness-mpl .venv/bin/python -m agent_harness.cli run-study2
PYTHONPATH=src MPLCONFIGDIR=/tmp/agent-harness-mpl .venv/bin/python -m agent_harness.cli run-study2-reliability
```
The main command must yield exactly 840 completed deterministic cells. The reliability command
must yield exactly 72 stochastic sensitivity cells. Any incomplete infrastructure attempt is
retained under `results/infrastructure_attempts/`; it is not a scored model outcome.
## Completion record
The outcome-blind preflight passed. Execution revision
`58933d6fa8af09fcc5a832fb3b523ffb4182bc50` produced exactly 840 main and 72
reliability cells with no missing identity and no scored infrastructure
failure. Both run reports end with an empty model-residency set and a stopped
LM Studio server. The deterministic analysis at revision
`bab257bfc30d9959e31ffdd2ba2c9ebf2c5e575b` is under
`results/derived/study2`.
|