Kashif786
/

gemma3-1b-sindhi-tokenizer

Model card Files Files and versions

gemma3-1b-sindhi-tokenizer / tokenizer.json

Kashif786's picture

Add 20k Sindhi unigram tokens to Gemma-7B-it base for thesis research

56283b9 verified 3 months ago

history blame contribute delete

36.8 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 4bfd18ebecfe68e57ad51e8679843f34cf6023743e68e00da4bf959485709ce9
Size of remote file:: 36.8 MB
SHA256:: d9610d115f633c05e82b2c22cfca891b30fdf675bd83dc786606f4b15942dee5

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.