tiny-math-1m / tokenizer_ablation_check.py

Commit History

13 days ago

  1. tokenizer ablation: digit-split pre-tok = 0.2% -> 99.7% on TinyStories-1M; smallest arithmetic LLM now 3.75M

    Verified signature
    f117e6b