metadata
license: apache-2.0
tags:
- tokenizers
language:
- en
Unlike the T5 and Qwen variants, it can handle real Japanese names and booru tags written in romaji.
Note that the tokenizer playground is not fully compatible with it.