Hugging Face's logo

Kashif786
/
gemma-7b-it-sindhi-tokenizer

Transformers
Sindhi
English
sindhi
nlp
tokenizer-extension
gemma
low-resource-languages
unigram
Model card Files
xet
Community
gemma-7b-it-sindhi-tokenizer / tokenizer.json

Commit History

Add 20k Sindhi unigram tokens to Gemma-7B-it base for thesis research
780c97c
verified

Kashif786 commited on