metadata
license: cc-by-nc-4.0
language:
- ja
Tokenizer
ouktlab/character_tokenizer_jis_v2
This is a Japanse character tokenizer based on JIS X 0213 (Japanese Industrial Standard for coded character sets).