Xerv-AI
/

CRAYON-tokenizer

Text Generation

hardware-accelerated

double-array-trie

Model card Files Files and versions

CRAYON-tokenizer / src /crayon /concurrency /thread_local.py

Commit History

Upload folder using huggingface_hub

708f4a3
verified

Phase-Technologies commited on 4 days ago