File size: 316 Bytes
cde7fe4 | 1 2 3 4 5 6 7 8 9 | Tokenizers
----------
.. autoclass:: nemo.collections.common.tokenizers.AutoTokenizer
:special-members: __init__
.. autoclass:: nemo.collections.common.tokenizers.SentencePieceTokenizer
:special-members: __init__
.. autoclass:: nemo.collections.common.tokenizers.TokenizerSpec
:special-members: __init__
|