Xerv-AI
/

CRAYON-tokenizer

Text Generation

hardware-accelerated

double-array-trie

Model card Files Files and versions

CRAYON-tokenizer / src /crayon /resources /code_corpus.txt

Commit History

Upload folder using huggingface_hub

708f4a3
verified

Phase-Technologies commited on 5 days ago