yusuke111
/

nanochat-jp-tokenizer

Model card Files Files and versions

nanochat-jp-tokenizer / tokenizer.pkl

yusuke111's picture

tokenizer

26f2267 verified 4 months ago

history blame contribute delete

1.05 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: e1c103f51841b00d63aa0caa5a93fdb88e628ec8e721fbcaa5e1500dd3b00959
Size of remote file:: 1.05 MB
SHA256:: c4a4575ee18a5e36e6afc70cd64fbe6c53c2472418718c7c2dc507df876e9017

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.