sproos
/

parameter-golf-tokenizers

Model card Files Files and versions

parameter-golf-tokenizers / tokenizers /fineweb_1024_bpe.model

sproos's picture

Upload folder using huggingface_hub

c5f9e16 verified 29 days ago

history blame contribute delete

254 kB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: d858f472eb70e31b4defbc29ea484fd30e3fe5308d41830f56dff66bc63173c1
Size of remote file:: 254 kB
SHA256:: 849ea920119b5135ace5016137e82ab397738fc29d723d5f9a6b74c4e31af191

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.