dodecahedron / tokenizer.json

Commit History

Upload SmolLM-32M (LlamaForCausalLM, 16K vocab, step 5197, trained on 21.8B tokens of FineWeb)
8925d4e
verified

bfpill commited on