scholarly-code-tokenizer / research /source-comparisons.png
jfrick's picture
Publish 18 measured scholarly/code BPE tokenizers and research report
6bbbc6f verified
History Blame Contribute Delete
407 kB
source-comparisons.png

Xet Pointer Details

( Raw pointer file )
Xet hash:
d1a80e51ea86c2119f7dda846987b74d798df141df683ff101cf42111136a8be
Size of remote file:
407 kB
·
SHA256:
1e96d6ad85993c2c7492eac831c42a0a9f1376358a322abd989a15f197d85a98

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.