Hugging Face's logo

mjbommar
/
magic-bert-tokenizer-8k

Transformers
English
tokenizer
bpe
binary-analysis
file-type-detection
magic-bert
Model card Files
xet
 Community
magic-bert-tokenizer-8k
541 kB
  • 1 contributor
 History: 2 commits
mjbommar's picture
mjbommar
Upload Magic-BERT tokenizer
6b5e19f verified