suchirsalhan's picture
Add tokenizer redpajama_fr
25dddc2 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
f4ddd3cc9027cb9e066630504fb039573f25741e8d37affd30e237ac9fb8b259
Size of remote file:
1.1 MB
·
SHA256:
d31efdadfd7a28ef0e07b5746ed77c50c2e75ac65ef51b3841d8fe7337435273

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.