flexitok
/

parity_aware_bpe_tr_5k_val_100

Model card Files Files and versions

parity_aware_bpe_tr_5k_val_100 / tokenizer.json

gsaltintas's picture

Upload tokenizer

08bdab8 verified 5 days ago

History Blame Contribute Delete

13 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: 4e1eb3bc1aa7ace52544eb95a067892450f8bb68a799047eda47c5440c1f0f2e
Size of remote file:: 13 MB
SHA256:: 94696341d0228e6f1196186c50f851645a940be17499e6d5322727ac62bf0520

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.