procmarco
/

ita-en-code-bpe-48k

Model card Files Files and versions

ita-en-code-bpe-48k / tokenizer /token_bytes.pt

procmarco's picture

48k IT/EN/code BPE (40/40/20), frontier-aligned special tokens

b4e272e verified 7 days ago

History Blame Contribute Delete

198 kB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: cb26654a53c919b93d57728893c278c3c05c0bb885946fb1525eaed66bc30fbe
Size of remote file:: 198 kB
SHA256:: fecb6042d2eefc25c6dadcd30e4287f2d4c0466a9c45759a5487231a86634bd6

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.