Commit History

Yesterday

  1. Overnight runs of 2026-11-12: the 18M model with gated attention and QK-norm (1.393 against 1.419), with the circuit search (1.431), the 0.1B model at step 3,000, the 8,000-step wide fine-tune, and their result files

    Verified signature
    ce2a9da
  2. Research checkpoints of the 17M experiments (checkpoints/17m), all result files (results/), and an updated card: both memory skills at 17M, equal-compute results, a correction to the swarm-on-text claim

    Verified signature
    2315c01

2 days ago

  1. Model card: 0.1B hybrid design and small-scale results; add the 32k tokenizer

    Verified signature
    a9cf22d

3 days ago

  1. Correct model size to 0.1B

    Verified signature
    aac4cbd
  2. Explain token count by diminishing returns

    Verified signature
    402641d
  3. Update training data token count

    Verified signature
    743e926
  4. Clean up model card and link TONN paper

    Verified signature
    88495b5
  5. Add model card

    Verified signature
    629823e
  6. initial commit

    Verified signature
    86723d6