tokenizers / frequency_256000 /tokenizer.json

Zeb

Update frequency tokenizer names

2e9392c 9 months ago

19.6 MB

This file is stored with Xet . It is too big to display, but you can still download it.

( Raw pointer file )

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.