Kashif786
/

gemma-7b-it-sindhi-tokenizer

tokenizer-extension

low-resource-languages

Model card Files Files and versions

gemma-7b-it-sindhi-tokenizer / tokenizer.json

Kashif786's picture

Add 20k Sindhi unigram tokens to Gemma-7B-it base for thesis research

780c97c verified 16 days ago

history blame contribute delete

37.8 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )

SHA256:: bbe3ad3ec726501d408f83df4dc34770beffee4ab40c5045bc61124b518dfa1f
Pointer size:: 133 Bytes
Size of remote file:: 37.8 MB
Xet hash:: 61cf07f186443e57275fbb0b83fbc0c1b5895b086c0fe1ceb2bee1635de77e3e

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.