solvformer / tokenizer.json

Commit History

6 days ago

  1. Токенизатор: byte-level BPE, 16k

    Verified signature
    b72ef1f