| language: | |
| - en | |
| tags: | |
| - text-generation | |
| - research | |
| # ICLR debug experiments | |
| Public artifacts for the `iclr-debug` branch of HazyResearch/MsTok. | |
| W&B project: `mstok/iclr-debug`. | |
| This repository currently establishes the experiment namespace and contains a | |
| training-budget audit. No new model weights or final benchmark claims are | |
| implied. Future selected checkpoints and evaluations will be organized by | |
| unique run ID and optimizer step. | |
| Training budgets must report raw token positions per component, dataset size, | |
| global batch, optimizer updates, and LR horizons. Generation reports must label | |
| supplied-level-zero versus unconditional sampling and record the reference | |
| model precision, entropy, scored-token counts, and per-seed results. | |
| See `NCM-BUDGET-AUDIT.md` for historical budget provenance and limitations. | |