Add epsroot-0 AdamW optimizer state for Adam-normalized attribution f821b85 verified luciaquirke commited on Jul 8
Add base GPT-2 trained on wikitext 512-chunks (eps_root=0), before leave-1%-out retrains (checkpoints/step_287) 024b394 verified luciaquirke commited on Jul 8