NIRVLab
/

transformer_morpheme_eviral_v4

vanilla-transformer

morpheme-tokenizer

information-retrieval

cross-lingual-retrieval

Model card Files Files and versions

transformer_morpheme_eviral_v4 / morph_tokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

HeyDunaX's picture

upload morph_tokenizer/tokenizer_config.json

10feff7 verified about 1 month ago

mi_table.json

753 kB
upload morph_tokenizer/mi_table.json about 1 month ago
synonym_graph.json

800 kB
upload morph_tokenizer/synonym_graph.json about 1 month ago
tokenizer_config.json

460 Bytes
upload morph_tokenizer/tokenizer_config.json about 1 month ago
vocab.json

1.09 MB
upload morph_tokenizer/vocab.json about 1 month ago