Kashif786
/

SmolLM2-135M-sindhi-tokenizer

Model card Files Files and versions

SmolLM2-135M-sindhi-tokenizer / tokenizer.json

Kashif786's picture

Add 20k Sindhi tokens to SmolLM2-135M for CPT and QA research

90a9f90 verified 2 months ago

history contribute delete

7.27 MB

File too large to display, you can check the raw version instead.