nb-tokenizers-spm / wikipedia /da_64000_bpe.sp.model

Adding tokenizers models and vocabs

0ed8b17 over 3 years ago

1.33 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.