icarus112's picture
Fix: prod9 65536 vocab tokenizer (token_bytes.pt)
61c891d verified
Download
History Blame Contribute Delete
264 kB
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
76c310421b41e6b096b9a8014d1f5ade5fa2e95966bff1d88767cb19b104a96d
Size of remote file:
264 kB
·
SHA256:
2348b6912e6ef3ab2f4664babf4d73f40f586a9fc7e4128fae660d0d5a9a8025

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.