parameter-golf-tokenizers / tokenizers /fineweb_4096_bpe.model
sproos's picture
Upload folder using huggingface_hub
c5f9e16 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )
Xet hash:
99307bb7065328dbe75aa9d14389e0a619517dada45cbb39b46d988caf82f245
Size of remote file:
302 kB
·
SHA256:
d76de35070ed9feb76afe3a7efc3a1a0e91e9aa4978360ecdc7fbc22a9725512

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.