niobures's picture
MFA
2f6b10b verified
.. _tokenizer_japanese:
Japanese
========
.. needtable::
:types: tokenizer
:filter: language == "Japanese"
:style: datatable
:columns: ID;language;license
:class: table-striped
:colwidths: 50;25;25
.. toctree::
:hidden:
Japanese tokenizer v2_2_0.md
Japanese tokenizer v2_2_1.md