llama_8K_extended / tokenizer.json
Billyyy's picture
Add agglutination-optimized tokenizer
a8304ea verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
1a16386f9613f1c3c5ccca061f3d5a625c6fc2c928b787fecb4531cf27e6f3dc
Pointer size:
133 Bytes
·
Size of remote file:
18.5 MB
·
Xet hash:
a4713d49d3047ac1817cee03b6e4a6d70fc751dfd956fe18bd8c76b98bceedc2

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.