Commit History

2 days ago

  1. NaN fix v2 (root cause: exactly-zero embedding rows trigger gemma-backward NaN on torch 2.13, localised to layer-12 mlp grad_out via hooks; A-probe with zero token reproduced it): no zero rows anywhere - B uses 1e-4 no-info epsilon, resampler opener 1e-4

    agent
    884986c
  2. NaN-grad fix: rsqrt-normalise resampler k/v (torch-2.13 sdpa backward NaNs with 4x-magnitude latent inputs); assert now NaN-aware with grad table

    agent
    f473997
  3. run_pilot: mock-gemma dry run green end-to-end; fixes: StepDescriptor t=0 branch, frozen-grad assert guards trainable-only, B zero-prefix is floor-only (no backward), generation shape

    agent
    33dbd59
  4. gemma_decoder prototype: faithful live capture (hooks: router, mem_attn; ACT semantics), Latent+Resampler bridges (Gemma embed-scale aware, one-way detach boundary), grounded NL targets, run_pilot with controls A-G and frozen-Gemma gradient contract; 8/8 tests

    agent
    788ee34