metadata
language:
- en
tags:
- text-generation
- research
ICLR debug experiments
Public artifacts for the iclr-debug branch of HazyResearch/MsTok.
W&B project: mstok/iclr-debug.
This repository currently establishes the experiment namespace and contains a training-budget audit. No new model weights or final benchmark claims are implied. Future selected checkpoints and evaluations will be organized by unique run ID and optimizer step.
Training budgets must report raw token positions per component, dataset size, global batch, optimizer updates, and LR horizons. Generation reports must label supplied-level-zero versus unconditional sampling and record the reference model precision, entropy, scored-token counts, and per-seed results.
See NCM-BUDGET-AUDIT.md for historical budget provenance and limitations.