Xerv-AI
/

CRAYON-tokenizer

Text Generation

hardware-accelerated

double-array-trie

Model card Files Files and versions

CRAYON-tokenizer / src /crayon /resources /dat /vocab_lite.dat

Phase-Technologies's picture

Phase-Technologies

Upload folder using huggingface_hub

708f4a3 verified 4 days ago

history blame contribute delete

1.17 MB

This file is stored with Xet . It is too big to display, but you can still download it.

Xet Pointer Details

( Raw pointer file )

Xet hash:: f7b3961259e3d24f16111abdfdb72cb77df2a07085a6d2e79ed3ad07a0558a4b
Size of remote file:: 1.17 MB
SHA256:: 3e85170b4e247470d879e260f4cef001ab61c4fcf6c74c3523ca2c6ed91ce71b

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.