README.md

---
license: cc-by-nc-4.0
language:
- ja
---
## Tokenizer
### `ouktlab/character_tokenizer_jis_v2`

This is a Japanse character tokenizer based on JIS X 0213 (Japanese Industrial Standard for coded character sets).