anicka's picture
Copy tokenizer.json from v1 repo
82ccb43 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
21e2b58ce119ac9c0d306b7a35d538fe02f55e7f2af95cb0a2d563e892790684
Pointer size:
133 Bytes
·
Size of remote file:
11.4 MB
·
Xet hash:
14f6830d88be73710d92ca7d42994977757de6322dc2e2b6cea3784fd4d20b56

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.