tiny-math-1m / README.md

Commit History

12 days ago

  1. tokenizer ablation: digit-split pre-tok = 0.2% -> 99.7% on TinyStories-1M; smallest arithmetic LLM now 3.75M

    Verified signature
    f117e6b
  2. final verdict: smallest arithmetic LLM = pythia-14m 14.1M (99.8%); smallest from-scratch = 805,632 (100%); corrected param counts; full stage A/B records

    Verified signature
    9feb5f5

13 days ago

  1. add YAML frontmatter to model card

    Verified signature
    9c8cabb
  2. 1M-param 4-digit addition model + full results (phase diagram, extrapolation, bake-off)

    Verified signature
    4a6c57b