v2 / data /README.md
JulianHJR's picture
Upload folder using huggingface_hub
e53f10b verified
# Data directory
All intermediate data and outputs are written here by the pipeline.
Subdirectories (auto-created):
- `models/` β€” Hugging Face weights (Qwen3-30B-A3B-Thinking-2507)
- `cots/` β€” Generated CoTs + test problem lists
- `routing/` β€” Sharded router dumps from Stage 1
- `activations/` β€” Decision-point residual stream tensors
- `checkpoints/` β€” Direction vectors, top-expert lists
- `logs/` β€” Per-script log files
- `results/` β€” Final outputs (plots, JSON, report)
To override the default location, set env:
export DATA_ROOT=/some/other/path
To start fresh:
rm -rf data/routing data/activations data/checkpoints data/results data/logs
(Do NOT delete `models/` unless you want to re-download ~60GB.)