Transformers
gemma3-1b-sindhi-tokenizer / tokenizer.json

Commit History

Add 20k Sindhi unigram tokens to Gemma-7B-it base for thesis research
56283b9
verified

Kashif786 commited on