v2 / data /README.md
JulianHJR's picture
Upload folder using huggingface_hub
e53f10b verified

Data directory

All intermediate data and outputs are written here by the pipeline.

Subdirectories (auto-created):

  • models/ — Hugging Face weights (Qwen3-30B-A3B-Thinking-2507)
  • cots/ — Generated CoTs + test problem lists
  • routing/ — Sharded router dumps from Stage 1
  • activations/ — Decision-point residual stream tensors
  • checkpoints/ — Direction vectors, top-expert lists
  • logs/ — Per-script log files
  • results/ — Final outputs (plots, JSON, report)

To override the default location, set env: export DATA_ROOT=/some/other/path

To start fresh: rm -rf data/routing data/activations data/checkpoints data/results data/logs

(Do NOT delete models/ unless you want to re-download ~60GB.)