ThingAI
/

QuarkTokenizer

Model card Files Files and versions

QuarkTokenizer / tokenizer.json

ThingsAI's picture

Quark BPE tokenizer EN+IT 65536 vocab v1

9fb41e6 verified 4 days ago

4.72 MB

File too large to display, you can check the raw version instead.