Hugging Face's logo

Xerv-AI
/
CRAYON-tokenizer

Text Generation
English
generic
tokenizers
hardware-accelerated
avx2
cuda
rocm
double-array-trie
crayon
Model card Files
xet
 Community
CRAYON-tokenizer / benchmark_results
2.55 MB
  • 1 contributor
 History: 1 commit
Phase-Technologies's picture
Phase-Technologies
Upload folder using huggingface_hub
708f4a3 verified