Update README.md
Browse files
README.md
CHANGED
|
@@ -108,7 +108,7 @@ Use the code below to get started with the model.
|
|
| 108 |
|
| 109 |
### Training Data
|
| 110 |
|
| 111 |
-
|
| 112 |
|
| 113 |
[More Information Needed]
|
| 114 |
|
|
@@ -123,8 +123,74 @@ Use the code below to get started with the model.
|
|
| 123 |
|
| 124 |
#### Training Hyperparameters
|
| 125 |
|
| 126 |
-
|
| 127 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 128 |
#### Speeds, Sizes, Times [optional]
|
| 129 |
|
| 130 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
|
|
|
| 108 |
|
| 109 |
### Training Data
|
| 110 |
|
| 111 |
+
- IndictTTS: https://www.kaggle.com/datasets/tuannguyenvananh/indictts-english
|
| 112 |
|
| 113 |
[More Information Needed]
|
| 114 |
|
|
|
|
| 123 |
|
| 124 |
#### Training Hyperparameters
|
| 125 |
|
| 126 |
+
```yaml
|
| 127 |
+
data_cfg:
|
| 128 |
+
dataset:
|
| 129 |
+
processor:
|
| 130 |
+
feat_extractor_id: ${model_cfg.model.encoder_id}
|
| 131 |
+
tokenizer_id: ${model_cfg.tokenizer_id}
|
| 132 |
+
path:
|
| 133 |
+
base:
|
| 134 |
+
indict_tts: ../IndicTTS
|
| 135 |
+
cv: ../
|
| 136 |
+
train:
|
| 137 |
+
- train_data/indict_tts_train.jsonl
|
| 138 |
+
# - train_data/cv_train.jsonl
|
| 139 |
+
test:
|
| 140 |
+
- train_data/indict_tts_test.jsonl
|
| 141 |
+
# - train_data/cv_test.jsonl
|
| 142 |
+
dev:
|
| 143 |
+
- train_data/indict_tts_dev.jsonl
|
| 144 |
+
# - train_data/cv_dev.jsonl
|
| 145 |
+
dataloader:
|
| 146 |
+
batch_size: 46
|
| 147 |
+
num_workers: 8
|
| 148 |
+
pin_memory: True
|
| 149 |
+
|
| 150 |
+
model_cfg:
|
| 151 |
+
tokenizer_id: tuanio/wav2vec2-phoneme-ipa-ctc
|
| 152 |
+
model:
|
| 153 |
+
dropout: 0.1
|
| 154 |
+
encoder_id: tuanio/whisper-encoder.medium.en
|
| 155 |
+
optim:
|
| 156 |
+
lr: 1.25e-05
|
| 157 |
+
betas: [0.9, 0.998]
|
| 158 |
+
weight_decay: 0.01
|
| 159 |
+
scheduler:
|
| 160 |
+
name: linear
|
| 161 |
+
total_steps: -1
|
| 162 |
+
warmup_ratio: 0.05
|
| 163 |
+
interval: step
|
| 164 |
+
frequency: 1
|
| 165 |
+
|
| 166 |
+
trainer_cfg:
|
| 167 |
+
log:
|
| 168 |
+
wandb: True
|
| 169 |
+
logger_wandb:
|
| 170 |
+
project: aped_indian-lish
|
| 171 |
+
name: whisper-medium-indict-tts-only-from-epoch1
|
| 172 |
+
log_model: all
|
| 173 |
+
arguments:
|
| 174 |
+
accelerator: gpu
|
| 175 |
+
devices: -1
|
| 176 |
+
max_epochs: 10
|
| 177 |
+
log_every_n_steps: 1
|
| 178 |
+
enable_checkpointing: True
|
| 179 |
+
accumulate_grad_batches: 2
|
| 180 |
+
inference_mode: True
|
| 181 |
+
gradient_clip_val: 5.0
|
| 182 |
+
check_val_every_n_epoch: 1
|
| 183 |
+
val_check_interval: null
|
| 184 |
+
|
| 185 |
+
|
| 186 |
+
experiment_cfg:
|
| 187 |
+
train: True
|
| 188 |
+
valid: True
|
| 189 |
+
test: True
|
| 190 |
+
ckpt:
|
| 191 |
+
resume_ckpt: True
|
| 192 |
+
ckpt_path: ckpt/medium.epoch3.ckpt
|
| 193 |
+
```
|
| 194 |
#### Speeds, Sizes, Times [optional]
|
| 195 |
|
| 196 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|