Spaces:
Running
Running
data/runs/: commit run metadata; gitignore bulky JSONL/PNG payloads
Browse files* data/runs/README.md explains the data layout + how to re-create
* Commits _summary.json + _invocation.json for each paper-v1 run
* .gitignore excludes the bulky *.jsonl / *.png / .logs/ so they
don't bloat the repo on push.
- .gitignore +8 -0
- data/runs/README.md +28 -0
.gitignore
CHANGED
|
@@ -8,3 +8,11 @@ build/
|
|
| 8 |
*.orarep
|
| 9 |
flagged/
|
| 10 |
submissions/
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
*.orarep
|
| 9 |
flagged/
|
| 10 |
submissions/
|
| 11 |
+
|
| 12 |
+
# Heavy paper-v1 payloads: per-turn obs + minimap base64 JSONLs
|
| 13 |
+
# (commit the _summary.json + _invocation.json only)
|
| 14 |
+
data/runs/paper-v1-**/*.jsonl
|
| 15 |
+
data/runs/paper-v1-**/*.partial
|
| 16 |
+
data/runs/paper-v1-**/*.png
|
| 17 |
+
data/runs/paper-v1-**/.logs/
|
| 18 |
+
data/runs/_archive_*/
|
data/runs/README.md
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# `data/runs/` — Phase 4 paper data
|
| 2 |
+
|
| 3 |
+
This directory holds the per-run JSONL + per-turn PNG output of
|
| 4 |
+
`scripts/collect_eval_data.py`. JSONLs can be hundreds of MB per
|
| 5 |
+
run (full untruncated obs + system prompt + model request +
|
| 6 |
+
response per turn, plus minimap base64); PNGs are ~150 KB each.
|
| 7 |
+
|
| 8 |
+
**Heavy payloads (`*.jsonl`, `*.png`) are intentionally NOT
|
| 9 |
+
committed** to keep the repo lean. The summary metadata
|
| 10 |
+
(`_summary.json`, `_invocation.json`) IS committed — it records
|
| 11 |
+
what cells were run, how long they took, and where the JSONL
|
| 12 |
+
files live locally.
|
| 13 |
+
|
| 14 |
+
To re-create the data: rerun the same `scripts/collect_eval_data.py`
|
| 15 |
+
invocation; `--resume` will skip any cells whose JSONL still has
|
| 16 |
+
a `terminal:` line locally.
|
| 17 |
+
|
| 18 |
+
## Runs in this session
|
| 19 |
+
|
| 20 |
+
- `_smoke_16cell/` — 16-cell plumbing verification (Qwen3.5-9B)
|
| 21 |
+
- `paper-v1-engine-feature-packs/` — main collection (12 packs × 2
|
| 22 |
+
levels × 2 seeds × 5 models; in flight, ~69 cells captured of
|
| 23 |
+
240 planned at session checkpoint)
|
| 24 |
+
- `paper-v1-plus-medium/` — Qwen3.6-Plus F1-scale-test (8/8)
|
| 25 |
+
- `paper-v1-gemma-medium/` — gemma-4-31B-it F1-cross-model
|
| 26 |
+
control (5/6 in flight)
|
| 27 |
+
- `_archive_flash-gemma-orphan/` — orphaned cells from an early
|
| 28 |
+
flash run that errored; kept for audit reference
|