Instructions to use u107/nemo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- NeMo
How to use u107/nemo with NeMo:
# tag did not correspond to a valid NeMo domain.
- Notebooks
- Google Colab
- Kaggle
File size: 5,224 Bytes
184ffcb 2862da0 fbede25 2862da0 97b4f81 9fba329 e484d37 75db244 e484d37 2862da0 fbede25 2862da0 9fba329 d37a688 7e47106 75db244 8e1f50a e6ac6c7 8e1f50a e6ac6c7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 | ---
language:
- uk
- ru
library_name: nemo
tags:
- deepspeech
---
# list models
### QuartzNet15x5
---
- 2023-04-28
- _language:_ ru
- _from_pretrained:_ [stt_en_quartznet15x5](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_en_quartznet15x5)
- _Epoch:_ 50
- _Step:_ 738649
- _val_loss:_ 4.19466 (best 4.19466)
- _model:_ ```quartznet15x5/2023-04-28_00-24-37/stt_ru_quartznet15x5.nemo```
- _last checkpoint:_ ```quartznet15x5/2023-04-28_00-24-37/stt_ru_quartznet15x5--val_loss=4.2732-epoch=50-last.ckpt```
- _Dataset train:_ **709100** files totalling **680.21** hours
- _Dataset validation:_ **14670** files totalling **15.63** hours
- 2023-04-04
- _language:_ uk
- _from_pretrained:_ [stt_en_quartznet15x5](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_en_quartznet15x5)
- _Epoch:_ 34
- _Step:_ 566076
- _val_loss:_ 1.90886 (best 1.89907)
- _model:_ ```quartznet15x5/2023-04-04_02-57-02/stt_uk_quartznet15x5.nemo```
- _last checkpoint:_ ```quartznet15x5/2023-04-04_02-57-02/QuartzNet15x5--val_loss=1.9543-epoch=34-last.ckpt```
- _Dataset train:_ **1042635** files totalling **1028.14** hours
- _Dataset validation:_ **50640** files totalling **50.71** hours
- 2023-02-23
- _language:_ uk-RU
- _from_pretrained:_ [stt_en_quartznet15x5](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_en_quartznet15x5)
- _Epoch:_ 7
- _Step:_ 217287
- _val_loss:_ 1.66200 (best 1.66200)
- _model:_ ```quartznet15x5/2023-02-23_11-43-23/stt_uk_ru_quartznet15x5.nemo```
- _last checkpoint:_ ```quartznet15x5/2023-02-23_11-43-23/QuartzNet15x5--val_loss=1.6620-epoch=7-last.ckpt```
- _Dataset train:_ **1738252** files totalling **1645.74** hours
- _Dataset validation:_ **11373** files totalling **12.63** hours
### Jasper10x5
---
- 2023-04-07
- _language:_ uk
- _from_pretrained:_ [stt_en_jasper10x5dr](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_en_jasper10x5dr)
- _Epoch:_ 17
- _Step:_ 293256
- _val_loss:_ 2.10919 (best 2.10919)
- _model:_ ```jasper10x5/2023-04-07_05-01-29/stt_uk_jasper10x5.nemo```
- _last checkpoint:_ ```jasper10x5/2023-04-07_05-01-29/Jasper10x5--val_loss=2.1092-epoch=17-last.ckpt```
- _Dataset train:_ **1042635** files totalling **1028.14** hours
- _Dataset validation:_ **50640** files totalling **50.71** hours
- 2023-02-22
- _language:_ uk-RU
- _from_pretrained:_ [stt_en_jasper10x5dr](https://catalog.ngc.nvidia.com/orgs/nvidia/teams/nemo/models/stt_en_jasper10x5dr)
- _Epoch:_ 4
- _Step:_ 271604
- _val_loss:_ 1.76058 (best 1.76058)
- _model:_ ```jasper10x5/2023-02-22_06-46-21/stt_uk_ru_jasper10x5.nemo```
- _last checkpoint:_ ```jasper10x5/2023-02-22_06-46-21/Jasper10x5--val_loss=1.7606-epoch=4-last.ckpt```
- _Dataset train:_ **1738252** files totalling **1645.74** hours
- _Dataset validation:_ **11373** files totalling **12.63** hours
# Punctuation and Capitalization Model
### punctuation_uk_bert
---
- 2023-06-28
- _language:_ uk
- _Epoch:_ 3
- _val_loss:_ 0.0319
- _last checkpoint:_ ```punctuation_uk_bert/2023-06-28_04-10-06/punctuation_uk_bert--val_loss=0.0385-epoch=3-last.ckpt```
### punctuation_ru_bert
---
- 2023-06-28
- _language:_ rU
- _Epoch:_ 5
- _val_loss:_ 0.0196
- _last checkpoint:_ ```punctuation_ru_bert/2023-06-28_15-12-29/punctuation_ru_bert--val_loss=0.0712-epoch=5-last.ckpt```
### Використання ASR:
```python
from huggingface_hub import hf_hub_download
from nemo.collections.asr.models import ASRModel
from omegaconf import OmegaConf
# filename_model = 'quartznet15x5/2023-02-23_11-43-23/stt_uk_ru_quartznet15x5.nemo'
# filename_model = 'quartznet15x5/2023-04-04_02-57-02/stt_uk_quartznet15x5.nemo'
# filename_model = 'jasper10x5/2023-02-22_06-46-21/stt_uk_ru_jasper10x5.nemo'
filename_model = 'jasper10x5/2023-04-07_05-01-29/stt_uk_jasper10x5.nemo'
model_path = hf_hub_download(
repo_id="u107/nemo",
filename=filename_model,
repo_type="model",
cache_dir='/content',
use_auth_token='hf_...')
nemo_model = ASRModel.restore_from(
restore_path=model_path,
# map_location='CPU',
# return_config=True,
) # type: ASRModel
# зберегти файл налаштувань
OmegaConf.save(nemo_model.cfg, 'model_config.yaml')
# відобразити версію nemo на якій було навчання
print(nemo_model.cfg.nemo_version)
# відобразити алфавіт
print(nemo_model.cfg.labels)
```
### Використання NLP:
```python
from huggingface_hub import hf_hub_download
from nemo.collections import nlp as nemo_nlp
# filename_model = 'punctuation_ru_bert/2023-06-28_15-12-29/punctuation_ru_bert.nemo'
filename_model = 'punctuation_uk_bert/2023-06-28_04-10-06/punctuation_uk_bert.nemo'
model_path = hf_hub_download(
repo_id="u107/nemo",
filename=filename_model,
repo_type="model",
cache_dir='/content',
use_auth_token='hf_...')
pretrained_model = nemo_nlp.models.PunctuationCapitalizationModel.restore_from(
restore_path=model_path
)
queries = [
'ніхто ж не каже що б давати так',
]
result = pretrained_model.add_punctuation_capitalization(queries=queries)
print(result)
```
|