# 2026-06-23 - GPT2PreLN decay-only release (`step_8600`)

This release publishes the current best `decay-only` GPT2PreLN checkpoint in the workspace.

- parent checkpoint: `step_8000.pt`
- parent run: `202606212315_fresh-gpt2small-gpt2preln-k20-wsd-lr2e-4-7k-final2e5-webwiki`
- decay-only continuation run: `20260622_resume-gpt2small-gpt2preln-k20-wsds800-final2e5-webwiki-step8000-dense50`
- released checkpoint: `step_8600.pt`

Selection summary:
- `7k` decay-only winner: `step_7500` with `val_loss_mixed = 4.8401`
- `8k` decay-only winner: `step_8600` with `val_loss_mixed = 4.7964`
- result: `step_8600` is the best decay-only checkpoint across both tails

Recommended decoding preset:
- `balanced`
- `temperature = 0.8`
- `top_k = 50`
- `top_p = 0.95`
- `repetition_penalty = 1.1`
- `no_repeat_ngram_size = 0`