dodecahedron / tokenizer.json
bfpill's picture
Upload SmolLM-32M (LlamaForCausalLM, 16K vocab, step 5197, trained on 21.8B tokens of FineWeb)
8925d4e verified
Raw
History Contribute Delete
1.14 MB
File too large to display, you can check the raw version instead.