Kashif786
/

SmolLM2-135M-sindhi-tokenizer

Model card Files Files and versions

SmolLM2-135M-sindhi-tokenizer / tokenizer.json

Commit History

Add 20k Sindhi tokens to SmolLM2-135M for CPT and QA research

90a9f90
verified

Kashif786 commited on Mar 30