tokiers
/

voyage-code-2

Model card Files Files and versions

voyage-code-2 / tokenizer.tkz

bhavnicksm's picture

Update tokenizer.tkz to v11 (with pad_token_id)

b050c80 verified 6 days ago

history blame contribute delete

1.07 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )

SHA256:: 3111781ec4e8c8f105cc27b98a62e9c3485c9449ed78d021c931a0c53f5ef3bc
Pointer size:: 132 Bytes
Size of remote file:: 1.07 MB
Xet hash:: 47c8eb78b72495cb6fbe478b7c0ec351b6fbce493f4158af28dc87cfa7f421eb

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.