sproos
/

parameter-golf-tokenizers

Model card Files Files and versions

parameter-golf-tokenizers / tokenizers /fineweb_4096_bpe.model

sproos's picture

Upload folder using huggingface_hub

c5f9e16 verified 30 days ago

history blame contribute delete

302 kB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 99307bb7065328dbe75aa9d14389e0a619517dada45cbb39b46d988caf82f245
Size of remote file:: 302 kB
SHA256:: d76de35070ed9feb76afe3a7efc3a1a0e91e9aa4978360ecdc7fbc22a9725512

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.