---
license: cc-by-nc-4.0
language:
- ja
---
## Tokenizer
### `ouktlab/character_tokenizer_jis_v1`
This is a Japanse character tokenizer based on JIS X 0213 (Japanese Industrial Standard for coded character sets).