File size: 53,924 Bytes
ddafe39 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 | 2024-04-30 16:34:05,565 dotcom INFO {'train': {'log_interval': 200, 'seed': 1234, 'epochs': 20000, 'learning_rate': 0.0001, 'betas': [0.8, 0.99], 'eps': 1e-09, 'batch_size': 6, 'fp16_run': True, 'lr_decay': 0.999875, 'segment_size': 11520, 'init_lr_ratio': 1, 'warmup_epochs': 0, 'c_mel': 45, 'c_kl': 1.0}, 'data': {'max_wav_value': 32768.0, 'sampling_rate': 48000, 'filter_length': 2048, 'hop_length': 480, 'win_length': 2048, 'n_mel_channels': 128, 'mel_fmin': 0.0, 'mel_fmax': None, 'training_files': './logs\\dotcom/filelist.txt'}, 'model': {'inter_channels': 192, 'hidden_channels': 192, 'filter_channels': 768, 'n_heads': 2, 'n_layers': 6, 'kernel_size': 3, 'p_dropout': 0, 'resblock': '1', 'resblock_kernel_sizes': [3, 7, 11], 'resblock_dilation_sizes': [[1, 3, 5], [1, 3, 5], [1, 3, 5]], 'upsample_rates': [12, 10, 2, 2], 'upsample_initial_channel': 512, 'upsample_kernel_sizes': [24, 20, 4, 4], 'use_spectral_norm': False, 'gin_channels': 256, 'spk_embed_dim': 109}, 'model_dir': './logs\\dotcom', 'experiment_dir': './logs\\dotcom', 'save_every_epoch': 5, 'name': 'dotcom', 'total_epoch': 367, 'pretrainG': 'pretrained_v2/f0G48k.pth', 'pretrainD': 'pretrained_v2/f0D48k.pth', 'version': 'v2', 'gpus': '0', 'sample_rate': '48k', 'if_f0': 1, 'if_latest': 1, 'save_every_weights': '0', 'if_cache_data_in_gpu': 0}
2024-04-30 16:34:07,527 dotcom INFO loaded pretrained pretrained_v2/f0G48k.pth
2024-04-30 16:34:08,034 dotcom INFO loaded pretrained pretrained_v2/f0D48k.pth
2024-04-30 16:34:18,598 dotcom INFO Train Epoch: 1 [0%]
2024-04-30 16:34:18,599 dotcom INFO [0, 0.0001]
2024-04-30 16:34:18,599 dotcom INFO loss_disc=4.226, loss_gen=2.772, loss_fm=2.408,loss_mel=24.948, loss_kl=9.000
2024-04-30 16:34:19,967 dotcom INFO ====> Epoch: 1 [2024-04-30 16:34:19] | (0:00:10.548044)
2024-04-30 16:34:21,120 dotcom INFO ====> Epoch: 2 [2024-04-30 16:34:21] | (0:00:01.140843)
2024-04-30 16:34:22,293 dotcom INFO ====> Epoch: 3 [2024-04-30 16:34:22] | (0:00:01.166013)
2024-04-30 16:34:23,519 dotcom INFO ====> Epoch: 4 [2024-04-30 16:34:23] | (0:00:01.219184)
2024-04-30 16:34:24,860 dotcom INFO Saving model and optimizer state at epoch 5 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:34:28,822 dotcom INFO Saving model and optimizer state at epoch 5 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:34:31,703 dotcom INFO ====> Epoch: 5 [2024-04-30 16:34:31] | (0:00:08.177656)
2024-04-30 16:34:33,149 dotcom INFO ====> Epoch: 6 [2024-04-30 16:34:33] | (0:00:01.439715)
2024-04-30 16:34:34,439 dotcom INFO ====> Epoch: 7 [2024-04-30 16:34:34] | (0:00:01.284326)
2024-04-30 16:34:35,743 dotcom INFO ====> Epoch: 8 [2024-04-30 16:34:35] | (0:00:01.296562)
2024-04-30 16:34:37,042 dotcom INFO ====> Epoch: 9 [2024-04-30 16:34:37] | (0:00:01.289133)
2024-04-30 16:34:38,347 dotcom INFO Saving model and optimizer state at epoch 10 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:34:39,243 dotcom INFO Saving model and optimizer state at epoch 10 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:34:47,791 dotcom INFO ====> Epoch: 10 [2024-04-30 16:34:47] | (0:00:10.742723)
2024-04-30 16:34:49,355 dotcom INFO ====> Epoch: 11 [2024-04-30 16:34:49] | (0:00:01.555023)
2024-04-30 16:34:50,722 dotcom INFO ====> Epoch: 12 [2024-04-30 16:34:50] | (0:00:01.361806)
2024-04-30 16:34:52,011 dotcom INFO ====> Epoch: 13 [2024-04-30 16:34:52] | (0:00:01.281475)
2024-04-30 16:34:53,414 dotcom INFO ====> Epoch: 14 [2024-04-30 16:34:53] | (0:00:01.395711)
2024-04-30 16:34:54,791 dotcom INFO Saving model and optimizer state at epoch 15 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:34:55,775 dotcom INFO Saving model and optimizer state at epoch 15 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:34:58,963 dotcom INFO ====> Epoch: 15 [2024-04-30 16:34:58] | (0:00:05.543420)
2024-04-30 16:35:00,508 dotcom INFO ====> Epoch: 16 [2024-04-30 16:35:00] | (0:00:01.537151)
2024-04-30 16:35:01,862 dotcom INFO ====> Epoch: 17 [2024-04-30 16:35:01] | (0:00:01.344962)
2024-04-30 16:35:03,229 dotcom INFO ====> Epoch: 18 [2024-04-30 16:35:03] | (0:00:01.359643)
2024-04-30 16:35:04,558 dotcom INFO ====> Epoch: 19 [2024-04-30 16:35:04] | (0:00:01.321429)
2024-04-30 16:35:05,883 dotcom INFO Saving model and optimizer state at epoch 20 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:35:09,758 dotcom INFO Saving model and optimizer state at epoch 20 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:35:20,482 dotcom INFO ====> Epoch: 20 [2024-04-30 16:35:20] | (0:00:15.915901)
2024-04-30 16:35:21,750 dotcom INFO ====> Epoch: 21 [2024-04-30 16:35:21] | (0:00:01.262156)
2024-04-30 16:35:23,096 dotcom INFO ====> Epoch: 22 [2024-04-30 16:35:23] | (0:00:01.339197)
2024-04-30 16:35:24,415 dotcom INFO ====> Epoch: 23 [2024-04-30 16:35:24] | (0:00:01.312788)
2024-04-30 16:35:25,765 dotcom INFO ====> Epoch: 24 [2024-04-30 16:35:25] | (0:00:01.341233)
2024-04-30 16:35:27,103 dotcom INFO Saving model and optimizer state at epoch 25 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:35:27,949 dotcom INFO Saving model and optimizer state at epoch 25 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:35:35,472 dotcom INFO ====> Epoch: 25 [2024-04-30 16:35:35] | (0:00:09.698323)
2024-04-30 16:35:36,912 dotcom INFO ====> Epoch: 26 [2024-04-30 16:35:36] | (0:00:01.433500)
2024-04-30 16:35:38,164 dotcom INFO ====> Epoch: 27 [2024-04-30 16:35:38] | (0:00:01.244008)
2024-04-30 16:35:39,407 dotcom INFO ====> Epoch: 28 [2024-04-30 16:35:39] | (0:00:01.236304)
2024-04-30 16:35:40,632 dotcom INFO ====> Epoch: 29 [2024-04-30 16:35:40] | (0:00:01.218310)
2024-04-30 16:35:41,902 dotcom INFO Saving model and optimizer state at epoch 30 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:35:42,666 dotcom INFO Saving model and optimizer state at epoch 30 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:35:45,306 dotcom INFO ====> Epoch: 30 [2024-04-30 16:35:45] | (0:00:04.668109)
2024-04-30 16:35:46,743 dotcom INFO ====> Epoch: 31 [2024-04-30 16:35:46] | (0:00:01.430308)
2024-04-30 16:35:48,003 dotcom INFO ====> Epoch: 32 [2024-04-30 16:35:48] | (0:00:01.253959)
2024-04-30 16:35:49,256 dotcom INFO ====> Epoch: 33 [2024-04-30 16:35:49] | (0:00:01.245929)
2024-04-30 16:35:50,477 dotcom INFO ====> Epoch: 34 [2024-04-30 16:35:50] | (0:00:01.214060)
2024-04-30 16:35:51,726 dotcom INFO Saving model and optimizer state at epoch 35 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:35:52,516 dotcom INFO Saving model and optimizer state at epoch 35 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:35:56,248 dotcom INFO ====> Epoch: 35 [2024-04-30 16:35:56] | (0:00:05.764082)
2024-04-30 16:35:57,725 dotcom INFO ====> Epoch: 36 [2024-04-30 16:35:57] | (0:00:01.471447)
2024-04-30 16:35:59,102 dotcom INFO ====> Epoch: 37 [2024-04-30 16:35:59] | (0:00:01.365378)
2024-04-30 16:36:00,536 dotcom INFO ====> Epoch: 38 [2024-04-30 16:36:00] | (0:00:01.421828)
2024-04-30 16:36:01,849 dotcom INFO ====> Epoch: 39 [2024-04-30 16:36:01] | (0:00:01.304270)
2024-04-30 16:36:03,225 dotcom INFO Saving model and optimizer state at epoch 40 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:36:04,040 dotcom INFO Saving model and optimizer state at epoch 40 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:36:13,336 dotcom INFO ====> Epoch: 40 [2024-04-30 16:36:13] | (0:00:11.481333)
2024-04-30 16:36:14,837 dotcom INFO ====> Epoch: 41 [2024-04-30 16:36:14] | (0:00:01.493939)
2024-04-30 16:36:16,091 dotcom INFO ====> Epoch: 42 [2024-04-30 16:36:16] | (0:00:01.247929)
2024-04-30 16:36:17,308 dotcom INFO ====> Epoch: 43 [2024-04-30 16:36:17] | (0:00:01.209678)
2024-04-30 16:36:18,535 dotcom INFO ====> Epoch: 44 [2024-04-30 16:36:18] | (0:00:01.221105)
2024-04-30 16:36:19,786 dotcom INFO Saving model and optimizer state at epoch 45 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:36:20,552 dotcom INFO Saving model and optimizer state at epoch 45 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:36:24,031 dotcom INFO ====> Epoch: 45 [2024-04-30 16:36:24] | (0:00:05.490638)
2024-04-30 16:36:25,514 dotcom INFO ====> Epoch: 46 [2024-04-30 16:36:25] | (0:00:01.477101)
2024-04-30 16:36:26,889 dotcom INFO ====> Epoch: 47 [2024-04-30 16:36:26] | (0:00:01.366437)
2024-04-30 16:36:28,266 dotcom INFO ====> Epoch: 48 [2024-04-30 16:36:28] | (0:00:01.370128)
2024-04-30 16:36:29,620 dotcom INFO ====> Epoch: 49 [2024-04-30 16:36:29] | (0:00:01.347190)
2024-04-30 16:36:31,022 dotcom INFO Saving model and optimizer state at epoch 50 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:36:35,991 dotcom INFO Saving model and optimizer state at epoch 50 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:36:38,970 dotcom INFO ====> Epoch: 50 [2024-04-30 16:36:38] | (0:00:09.340139)
2024-04-30 16:36:40,514 dotcom INFO ====> Epoch: 51 [2024-04-30 16:36:40] | (0:00:01.537902)
2024-04-30 16:36:41,772 dotcom INFO ====> Epoch: 52 [2024-04-30 16:36:41] | (0:00:01.250578)
2024-04-30 16:36:43,036 dotcom INFO ====> Epoch: 53 [2024-04-30 16:36:43] | (0:00:01.258318)
2024-04-30 16:36:44,300 dotcom INFO ====> Epoch: 54 [2024-04-30 16:36:44] | (0:00:01.257300)
2024-04-30 16:36:45,655 dotcom INFO Saving model and optimizer state at epoch 55 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:36:48,065 dotcom INFO Saving model and optimizer state at epoch 55 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:36:51,080 dotcom INFO ====> Epoch: 55 [2024-04-30 16:36:51] | (0:00:06.774246)
2024-04-30 16:36:52,612 dotcom INFO ====> Epoch: 56 [2024-04-30 16:36:52] | (0:00:01.525274)
2024-04-30 16:36:53,946 dotcom INFO ====> Epoch: 57 [2024-04-30 16:36:53] | (0:00:01.324439)
2024-04-30 16:36:55,287 dotcom INFO ====> Epoch: 58 [2024-04-30 16:36:55] | (0:00:01.335008)
2024-04-30 16:36:56,647 dotcom INFO ====> Epoch: 59 [2024-04-30 16:36:56] | (0:00:01.353132)
2024-04-30 16:36:58,022 dotcom INFO Saving model and optimizer state at epoch 60 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:36:59,237 dotcom INFO Saving model and optimizer state at epoch 60 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:37:07,629 dotcom INFO ====> Epoch: 60 [2024-04-30 16:37:07] | (0:00:10.973518)
2024-04-30 16:37:09,063 dotcom INFO ====> Epoch: 61 [2024-04-30 16:37:09] | (0:00:01.428327)
2024-04-30 16:37:10,345 dotcom INFO ====> Epoch: 62 [2024-04-30 16:37:10] | (0:00:01.275998)
2024-04-30 16:37:11,625 dotcom INFO ====> Epoch: 63 [2024-04-30 16:37:11] | (0:00:01.273293)
2024-04-30 16:37:12,901 dotcom INFO ====> Epoch: 64 [2024-04-30 16:37:12] | (0:00:01.269373)
2024-04-30 16:37:14,148 dotcom INFO Saving model and optimizer state at epoch 65 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:37:14,912 dotcom INFO Saving model and optimizer state at epoch 65 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:37:17,865 dotcom INFO ====> Epoch: 65 [2024-04-30 16:37:17] | (0:00:04.958994)
2024-04-30 16:37:19,148 dotcom INFO ====> Epoch: 66 [2024-04-30 16:37:19] | (0:00:01.274863)
2024-04-30 16:37:20,425 dotcom INFO ====> Epoch: 67 [2024-04-30 16:37:20] | (0:00:01.268937)
2024-04-30 16:37:21,781 dotcom INFO ====> Epoch: 68 [2024-04-30 16:37:21] | (0:00:01.349382)
2024-04-30 16:37:23,112 dotcom INFO ====> Epoch: 69 [2024-04-30 16:37:23] | (0:00:01.324938)
2024-04-30 16:37:24,441 dotcom INFO Saving model and optimizer state at epoch 70 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:37:25,425 dotcom INFO Saving model and optimizer state at epoch 70 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:37:35,185 dotcom INFO ====> Epoch: 70 [2024-04-30 16:37:35] | (0:00:12.065562)
2024-04-30 16:37:36,744 dotcom INFO ====> Epoch: 71 [2024-04-30 16:37:36] | (0:00:01.551024)
2024-04-30 16:37:38,004 dotcom INFO ====> Epoch: 72 [2024-04-30 16:37:38] | (0:00:01.253994)
2024-04-30 16:37:39,259 dotcom INFO ====> Epoch: 73 [2024-04-30 16:37:39] | (0:00:01.248126)
2024-04-30 16:37:40,539 dotcom INFO ====> Epoch: 74 [2024-04-30 16:37:40] | (0:00:01.273618)
2024-04-30 16:37:41,828 dotcom INFO Saving model and optimizer state at epoch 75 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:37:42,792 dotcom INFO Saving model and optimizer state at epoch 75 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:37:54,327 dotcom INFO ====> Epoch: 75 [2024-04-30 16:37:54] | (0:00:13.779683)
2024-04-30 16:37:55,927 dotcom INFO ====> Epoch: 76 [2024-04-30 16:37:55] | (0:00:01.591825)
2024-04-30 16:37:57,353 dotcom INFO ====> Epoch: 77 [2024-04-30 16:37:57] | (0:00:01.417957)
2024-04-30 16:37:58,691 dotcom INFO ====> Epoch: 78 [2024-04-30 16:37:58] | (0:00:01.330415)
2024-04-30 16:38:00,052 dotcom INFO ====> Epoch: 79 [2024-04-30 16:38:00] | (0:00:01.354039)
2024-04-30 16:38:01,428 dotcom INFO Saving model and optimizer state at epoch 80 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:38:02,225 dotcom INFO Saving model and optimizer state at epoch 80 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:38:06,019 dotcom INFO ====> Epoch: 80 [2024-04-30 16:38:06] | (0:00:05.958117)
2024-04-30 16:38:07,497 dotcom INFO ====> Epoch: 81 [2024-04-30 16:38:07] | (0:00:01.471095)
2024-04-30 16:38:08,802 dotcom INFO ====> Epoch: 82 [2024-04-30 16:38:08] | (0:00:01.298178)
2024-04-30 16:38:10,102 dotcom INFO ====> Epoch: 83 [2024-04-30 16:38:10] | (0:00:01.293255)
2024-04-30 16:38:11,383 dotcom INFO ====> Epoch: 84 [2024-04-30 16:38:11] | (0:00:01.275212)
2024-04-30 16:38:12,639 dotcom INFO Saving model and optimizer state at epoch 85 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:38:13,400 dotcom INFO Saving model and optimizer state at epoch 85 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:38:17,473 dotcom INFO ====> Epoch: 85 [2024-04-30 16:38:17] | (0:00:06.081613)
2024-04-30 16:38:18,998 dotcom INFO ====> Epoch: 86 [2024-04-30 16:38:18] | (0:00:01.519861)
2024-04-30 16:38:20,298 dotcom INFO ====> Epoch: 87 [2024-04-30 16:38:20] | (0:00:01.293470)
2024-04-30 16:38:21,604 dotcom INFO ====> Epoch: 88 [2024-04-30 16:38:21] | (0:00:01.299672)
2024-04-30 16:38:22,915 dotcom INFO ====> Epoch: 89 [2024-04-30 16:38:22] | (0:00:01.303681)
2024-04-30 16:38:24,232 dotcom INFO Saving model and optimizer state at epoch 90 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:38:25,914 dotcom INFO Saving model and optimizer state at epoch 90 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:38:36,794 dotcom INFO ====> Epoch: 90 [2024-04-30 16:38:36] | (0:00:13.872966)
2024-04-30 16:38:38,237 dotcom INFO ====> Epoch: 91 [2024-04-30 16:38:38] | (0:00:01.435211)
2024-04-30 16:38:39,536 dotcom INFO ====> Epoch: 92 [2024-04-30 16:38:39] | (0:00:01.290711)
2024-04-30 16:38:40,796 dotcom INFO ====> Epoch: 93 [2024-04-30 16:38:40] | (0:00:01.253335)
2024-04-30 16:38:42,090 dotcom INFO ====> Epoch: 94 [2024-04-30 16:38:42] | (0:00:01.288513)
2024-04-30 16:38:43,367 dotcom INFO Saving model and optimizer state at epoch 95 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:38:44,170 dotcom INFO Saving model and optimizer state at epoch 95 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:38:50,564 dotcom INFO ====> Epoch: 95 [2024-04-30 16:38:50] | (0:00:08.467569)
2024-04-30 16:38:51,880 dotcom INFO ====> Epoch: 96 [2024-04-30 16:38:51] | (0:00:01.308204)
2024-04-30 16:38:53,274 dotcom INFO ====> Epoch: 97 [2024-04-30 16:38:53] | (0:00:01.388111)
2024-04-30 16:38:54,600 dotcom INFO ====> Epoch: 98 [2024-04-30 16:38:54] | (0:00:01.320366)
2024-04-30 16:38:55,927 dotcom INFO ====> Epoch: 99 [2024-04-30 16:38:55] | (0:00:01.319974)
2024-04-30 16:38:57,312 dotcom INFO Saving model and optimizer state at epoch 100 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:38:58,178 dotcom INFO Saving model and optimizer state at epoch 100 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:39:02,446 dotcom INFO ====> Epoch: 100 [2024-04-30 16:39:02] | (0:00:06.511509)
2024-04-30 16:39:03,198 dotcom INFO Train Epoch: 101 [0%]
2024-04-30 16:39:03,198 dotcom INFO [200, 9.875770288847208e-05]
2024-04-30 16:39:03,200 dotcom INFO loss_disc=3.517, loss_gen=3.131, loss_fm=5.502,loss_mel=9.204, loss_kl=0.256
2024-04-30 16:39:04,242 dotcom INFO ====> Epoch: 101 [2024-04-30 16:39:04] | (0:00:01.788380)
2024-04-30 16:39:05,708 dotcom INFO ====> Epoch: 102 [2024-04-30 16:39:05] | (0:00:01.455112)
2024-04-30 16:39:07,088 dotcom INFO ====> Epoch: 103 [2024-04-30 16:39:07] | (0:00:01.373297)
2024-04-30 16:39:08,418 dotcom INFO ====> Epoch: 104 [2024-04-30 16:39:08] | (0:00:01.321884)
2024-04-30 16:39:09,699 dotcom INFO Saving model and optimizer state at epoch 105 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:39:12,309 dotcom INFO Saving model and optimizer state at epoch 105 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:39:21,912 dotcom INFO ====> Epoch: 105 [2024-04-30 16:39:21] | (0:00:13.486665)
2024-04-30 16:39:23,398 dotcom INFO ====> Epoch: 106 [2024-04-30 16:39:23] | (0:00:01.480500)
2024-04-30 16:39:24,702 dotcom INFO ====> Epoch: 107 [2024-04-30 16:39:24] | (0:00:01.295964)
2024-04-30 16:39:26,114 dotcom INFO ====> Epoch: 108 [2024-04-30 16:39:26] | (0:00:01.404330)
2024-04-30 16:39:27,585 dotcom INFO ====> Epoch: 109 [2024-04-30 16:39:27] | (0:00:01.463891)
2024-04-30 16:39:28,936 dotcom INFO Saving model and optimizer state at epoch 110 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:39:29,793 dotcom INFO Saving model and optimizer state at epoch 110 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:39:33,094 dotcom INFO ====> Epoch: 110 [2024-04-30 16:39:33] | (0:00:05.501075)
2024-04-30 16:39:34,612 dotcom INFO ====> Epoch: 111 [2024-04-30 16:39:34] | (0:00:01.512102)
2024-04-30 16:39:36,089 dotcom INFO ====> Epoch: 112 [2024-04-30 16:39:36] | (0:00:01.469335)
2024-04-30 16:39:37,628 dotcom INFO ====> Epoch: 113 [2024-04-30 16:39:37] | (0:00:01.530600)
2024-04-30 16:39:39,185 dotcom INFO ====> Epoch: 114 [2024-04-30 16:39:39] | (0:00:01.549969)
2024-04-30 16:39:40,630 dotcom INFO Saving model and optimizer state at epoch 115 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:39:45,749 dotcom INFO Saving model and optimizer state at epoch 115 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:39:50,249 dotcom INFO ====> Epoch: 115 [2024-04-30 16:39:50] | (0:00:11.054755)
2024-04-30 16:39:51,859 dotcom INFO ====> Epoch: 116 [2024-04-30 16:39:51] | (0:00:01.601666)
2024-04-30 16:39:53,227 dotcom INFO ====> Epoch: 117 [2024-04-30 16:39:53] | (0:00:01.359881)
2024-04-30 16:39:54,549 dotcom INFO ====> Epoch: 118 [2024-04-30 16:39:54] | (0:00:01.316028)
2024-04-30 16:39:55,932 dotcom INFO ====> Epoch: 119 [2024-04-30 16:39:55] | (0:00:01.375577)
2024-04-30 16:39:57,342 dotcom INFO Saving model and optimizer state at epoch 120 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:40:04,119 dotcom INFO Saving model and optimizer state at epoch 120 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:40:07,155 dotcom INFO ====> Epoch: 120 [2024-04-30 16:40:07] | (0:00:11.213292)
2024-04-30 16:40:08,497 dotcom INFO ====> Epoch: 121 [2024-04-30 16:40:08] | (0:00:01.334519)
2024-04-30 16:40:09,913 dotcom INFO ====> Epoch: 122 [2024-04-30 16:40:09] | (0:00:01.409529)
2024-04-30 16:40:11,347 dotcom INFO ====> Epoch: 123 [2024-04-30 16:40:11] | (0:00:01.426552)
2024-04-30 16:40:12,747 dotcom INFO ====> Epoch: 124 [2024-04-30 16:40:12] | (0:00:01.393201)
2024-04-30 16:40:14,226 dotcom INFO Saving model and optimizer state at epoch 125 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:40:15,106 dotcom INFO Saving model and optimizer state at epoch 125 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:40:25,469 dotcom INFO ====> Epoch: 125 [2024-04-30 16:40:25] | (0:00:12.713949)
2024-04-30 16:40:27,130 dotcom INFO ====> Epoch: 126 [2024-04-30 16:40:27] | (0:00:01.651648)
2024-04-30 16:40:28,529 dotcom INFO ====> Epoch: 127 [2024-04-30 16:40:28] | (0:00:01.391617)
2024-04-30 16:40:29,932 dotcom INFO ====> Epoch: 128 [2024-04-30 16:40:29] | (0:00:01.397583)
2024-04-30 16:40:31,387 dotcom INFO ====> Epoch: 129 [2024-04-30 16:40:31] | (0:00:01.444872)
2024-04-30 16:40:32,746 dotcom INFO Saving model and optimizer state at epoch 130 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:40:33,663 dotcom INFO Saving model and optimizer state at epoch 130 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:40:37,207 dotcom INFO ====> Epoch: 130 [2024-04-30 16:40:37] | (0:00:05.813330)
2024-04-30 16:40:38,691 dotcom INFO ====> Epoch: 131 [2024-04-30 16:40:38] | (0:00:01.477165)
2024-04-30 16:40:40,047 dotcom INFO ====> Epoch: 132 [2024-04-30 16:40:40] | (0:00:01.350116)
2024-04-30 16:40:41,392 dotcom INFO ====> Epoch: 133 [2024-04-30 16:40:41] | (0:00:01.339518)
2024-04-30 16:40:42,714 dotcom INFO ====> Epoch: 134 [2024-04-30 16:40:42] | (0:00:01.315389)
2024-04-30 16:40:44,125 dotcom INFO Saving model and optimizer state at epoch 135 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:40:45,064 dotcom INFO Saving model and optimizer state at epoch 135 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:40:57,592 dotcom INFO ====> Epoch: 135 [2024-04-30 16:40:57] | (0:00:14.869790)
2024-04-30 16:40:59,258 dotcom INFO ====> Epoch: 136 [2024-04-30 16:40:59] | (0:00:01.659316)
2024-04-30 16:41:00,619 dotcom INFO ====> Epoch: 137 [2024-04-30 16:41:00] | (0:00:01.355434)
2024-04-30 16:41:01,987 dotcom INFO ====> Epoch: 138 [2024-04-30 16:41:01] | (0:00:01.360468)
2024-04-30 16:41:03,355 dotcom INFO ====> Epoch: 139 [2024-04-30 16:41:03] | (0:00:01.358898)
2024-04-30 16:41:04,677 dotcom INFO Saving model and optimizer state at epoch 140 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:41:05,498 dotcom INFO Saving model and optimizer state at epoch 140 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:41:14,025 dotcom INFO ====> Epoch: 140 [2024-04-30 16:41:14] | (0:00:10.662335)
2024-04-30 16:41:15,652 dotcom INFO ====> Epoch: 141 [2024-04-30 16:41:15] | (0:00:01.619947)
2024-04-30 16:41:17,029 dotcom INFO ====> Epoch: 142 [2024-04-30 16:41:17] | (0:00:01.369255)
2024-04-30 16:41:18,451 dotcom INFO ====> Epoch: 143 [2024-04-30 16:41:18] | (0:00:01.413111)
2024-04-30 16:41:19,909 dotcom INFO ====> Epoch: 144 [2024-04-30 16:41:19] | (0:00:01.448842)
2024-04-30 16:41:21,307 dotcom INFO Saving model and optimizer state at epoch 145 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:41:22,193 dotcom INFO Saving model and optimizer state at epoch 145 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:41:34,875 dotcom INFO ====> Epoch: 145 [2024-04-30 16:41:34] | (0:00:14.955374)
2024-04-30 16:41:36,366 dotcom INFO ====> Epoch: 146 [2024-04-30 16:41:36] | (0:00:01.484339)
2024-04-30 16:41:37,701 dotcom INFO ====> Epoch: 147 [2024-04-30 16:41:37] | (0:00:01.329481)
2024-04-30 16:41:39,021 dotcom INFO ====> Epoch: 148 [2024-04-30 16:41:39] | (0:00:01.312418)
2024-04-30 16:41:40,304 dotcom INFO ====> Epoch: 149 [2024-04-30 16:41:40] | (0:00:01.276371)
2024-04-30 16:41:41,618 dotcom INFO Saving model and optimizer state at epoch 150 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:41:42,440 dotcom INFO Saving model and optimizer state at epoch 150 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:41:51,967 dotcom INFO ====> Epoch: 150 [2024-04-30 16:41:51] | (0:00:11.657728)
2024-04-30 16:41:53,546 dotcom INFO ====> Epoch: 151 [2024-04-30 16:41:53] | (0:00:01.562510)
2024-04-30 16:41:54,859 dotcom INFO ====> Epoch: 152 [2024-04-30 16:41:54] | (0:00:01.305054)
2024-04-30 16:41:56,233 dotcom INFO ====> Epoch: 153 [2024-04-30 16:41:56] | (0:00:01.368160)
2024-04-30 16:41:57,634 dotcom INFO ====> Epoch: 154 [2024-04-30 16:41:57] | (0:00:01.393775)
2024-04-30 16:41:59,008 dotcom INFO Saving model and optimizer state at epoch 155 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:41:59,921 dotcom INFO Saving model and optimizer state at epoch 155 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:42:03,710 dotcom INFO ====> Epoch: 155 [2024-04-30 16:42:03] | (0:00:06.067529)
2024-04-30 16:42:05,134 dotcom INFO ====> Epoch: 156 [2024-04-30 16:42:05] | (0:00:01.417162)
2024-04-30 16:42:06,409 dotcom INFO ====> Epoch: 157 [2024-04-30 16:42:06] | (0:00:01.266901)
2024-04-30 16:42:07,685 dotcom INFO ====> Epoch: 158 [2024-04-30 16:42:07] | (0:00:01.269796)
2024-04-30 16:42:08,918 dotcom INFO ====> Epoch: 159 [2024-04-30 16:42:08] | (0:00:01.226535)
2024-04-30 16:42:10,244 dotcom INFO Saving model and optimizer state at epoch 160 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:42:11,022 dotcom INFO Saving model and optimizer state at epoch 160 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:42:15,634 dotcom INFO ====> Epoch: 160 [2024-04-30 16:42:15] | (0:00:06.708672)
2024-04-30 16:42:17,110 dotcom INFO ====> Epoch: 161 [2024-04-30 16:42:17] | (0:00:01.467661)
2024-04-30 16:42:18,392 dotcom INFO ====> Epoch: 162 [2024-04-30 16:42:18] | (0:00:01.276088)
2024-04-30 16:42:19,660 dotcom INFO ====> Epoch: 163 [2024-04-30 16:42:19] | (0:00:01.261409)
2024-04-30 16:42:20,916 dotcom INFO ====> Epoch: 164 [2024-04-30 16:42:20] | (0:00:01.251468)
2024-04-30 16:42:22,194 dotcom INFO Saving model and optimizer state at epoch 165 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:42:26,187 dotcom INFO Saving model and optimizer state at epoch 165 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:42:30,622 dotcom INFO ====> Epoch: 165 [2024-04-30 16:42:30] | (0:00:09.698874)
2024-04-30 16:42:32,050 dotcom INFO ====> Epoch: 166 [2024-04-30 16:42:32] | (0:00:01.421263)
2024-04-30 16:42:33,451 dotcom INFO ====> Epoch: 167 [2024-04-30 16:42:33] | (0:00:01.392913)
2024-04-30 16:42:34,703 dotcom INFO ====> Epoch: 168 [2024-04-30 16:42:34] | (0:00:01.243707)
2024-04-30 16:42:36,020 dotcom INFO ====> Epoch: 169 [2024-04-30 16:42:36] | (0:00:01.310143)
2024-04-30 16:42:37,313 dotcom INFO Saving model and optimizer state at epoch 170 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:42:40,078 dotcom INFO Saving model and optimizer state at epoch 170 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:42:43,153 dotcom INFO ====> Epoch: 170 [2024-04-30 16:42:43] | (0:00:07.127411)
2024-04-30 16:42:44,708 dotcom INFO ====> Epoch: 171 [2024-04-30 16:42:44] | (0:00:01.549170)
2024-04-30 16:42:45,982 dotcom INFO ====> Epoch: 172 [2024-04-30 16:42:45] | (0:00:01.267243)
2024-04-30 16:42:47,296 dotcom INFO ====> Epoch: 173 [2024-04-30 16:42:47] | (0:00:01.305008)
2024-04-30 16:42:48,551 dotcom INFO ====> Epoch: 174 [2024-04-30 16:42:48] | (0:00:01.247561)
2024-04-30 16:42:49,840 dotcom INFO Saving model and optimizer state at epoch 175 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:42:50,687 dotcom INFO Saving model and optimizer state at epoch 175 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:43:00,952 dotcom INFO ====> Epoch: 175 [2024-04-30 16:43:00] | (0:00:12.392082)
2024-04-30 16:43:02,631 dotcom INFO ====> Epoch: 176 [2024-04-30 16:43:02] | (0:00:01.672860)
2024-04-30 16:43:03,929 dotcom INFO ====> Epoch: 177 [2024-04-30 16:43:03] | (0:00:01.290789)
2024-04-30 16:43:05,228 dotcom INFO ====> Epoch: 178 [2024-04-30 16:43:05] | (0:00:01.292444)
2024-04-30 16:43:06,534 dotcom INFO ====> Epoch: 179 [2024-04-30 16:43:06] | (0:00:01.300071)
2024-04-30 16:43:07,875 dotcom INFO Saving model and optimizer state at epoch 180 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:43:08,815 dotcom INFO Saving model and optimizer state at epoch 180 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:43:21,581 dotcom INFO ====> Epoch: 180 [2024-04-30 16:43:21] | (0:00:15.039955)
2024-04-30 16:43:23,160 dotcom INFO ====> Epoch: 181 [2024-04-30 16:43:23] | (0:00:01.571652)
2024-04-30 16:43:24,584 dotcom INFO ====> Epoch: 182 [2024-04-30 16:43:24] | (0:00:01.418823)
2024-04-30 16:43:25,991 dotcom INFO ====> Epoch: 183 [2024-04-30 16:43:25] | (0:00:01.398502)
2024-04-30 16:43:27,370 dotcom INFO ====> Epoch: 184 [2024-04-30 16:43:27] | (0:00:01.372740)
2024-04-30 16:43:28,807 dotcom INFO Saving model and optimizer state at epoch 185 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:43:29,730 dotcom INFO Saving model and optimizer state at epoch 185 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:43:42,033 dotcom INFO ====> Epoch: 185 [2024-04-30 16:43:42] | (0:00:14.654892)
2024-04-30 16:43:43,319 dotcom INFO ====> Epoch: 186 [2024-04-30 16:43:43] | (0:00:01.278580)
2024-04-30 16:43:44,618 dotcom INFO ====> Epoch: 187 [2024-04-30 16:43:44] | (0:00:01.290776)
2024-04-30 16:43:45,977 dotcom INFO ====> Epoch: 188 [2024-04-30 16:43:45] | (0:00:01.351893)
2024-04-30 16:43:47,255 dotcom INFO ====> Epoch: 189 [2024-04-30 16:43:47] | (0:00:01.273360)
2024-04-30 16:43:48,551 dotcom INFO Saving model and optimizer state at epoch 190 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:43:49,363 dotcom INFO Saving model and optimizer state at epoch 190 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:44:03,450 dotcom INFO ====> Epoch: 190 [2024-04-30 16:44:03] | (0:00:16.188103)
2024-04-30 16:44:04,909 dotcom INFO ====> Epoch: 191 [2024-04-30 16:44:04] | (0:00:01.453105)
2024-04-30 16:44:06,139 dotcom INFO ====> Epoch: 192 [2024-04-30 16:44:06] | (0:00:01.224868)
2024-04-30 16:44:07,403 dotcom INFO ====> Epoch: 193 [2024-04-30 16:44:07] | (0:00:01.258324)
2024-04-30 16:44:08,687 dotcom INFO ====> Epoch: 194 [2024-04-30 16:44:08] | (0:00:01.278056)
2024-04-30 16:44:09,950 dotcom INFO Saving model and optimizer state at epoch 195 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:44:10,750 dotcom INFO Saving model and optimizer state at epoch 195 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:44:13,880 dotcom INFO ====> Epoch: 195 [2024-04-30 16:44:13] | (0:00:05.186566)
2024-04-30 16:44:15,300 dotcom INFO ====> Epoch: 196 [2024-04-30 16:44:15] | (0:00:01.410254)
2024-04-30 16:44:16,527 dotcom INFO ====> Epoch: 197 [2024-04-30 16:44:16] | (0:00:01.220553)
2024-04-30 16:44:17,760 dotcom INFO ====> Epoch: 198 [2024-04-30 16:44:17] | (0:00:01.227751)
2024-04-30 16:44:18,987 dotcom INFO ====> Epoch: 199 [2024-04-30 16:44:18] | (0:00:01.221083)
2024-04-30 16:44:20,249 dotcom INFO Saving model and optimizer state at epoch 200 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:44:28,385 dotcom INFO Saving model and optimizer state at epoch 200 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:44:33,489 dotcom INFO ====> Epoch: 200 [2024-04-30 16:44:33] | (0:00:14.494247)
2024-04-30 16:44:34,310 dotcom INFO Train Epoch: 201 [0%]
2024-04-30 16:44:34,311 dotcom INFO [400, 9.753083879807726e-05]
2024-04-30 16:44:34,312 dotcom INFO loss_disc=2.601, loss_gen=4.676, loss_fm=13.793,loss_mel=17.129, loss_kl=0.383
2024-04-30 16:44:35,439 dotcom INFO ====> Epoch: 201 [2024-04-30 16:44:35] | (0:00:01.943367)
2024-04-30 16:44:36,686 dotcom INFO ====> Epoch: 202 [2024-04-30 16:44:36] | (0:00:01.239188)
2024-04-30 16:44:38,012 dotcom INFO ====> Epoch: 203 [2024-04-30 16:44:38] | (0:00:01.320027)
2024-04-30 16:44:39,325 dotcom INFO ====> Epoch: 204 [2024-04-30 16:44:39] | (0:00:01.307044)
2024-04-30 16:44:40,604 dotcom INFO Saving model and optimizer state at epoch 205 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:44:45,563 dotcom INFO Saving model and optimizer state at epoch 205 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:44:55,309 dotcom INFO ====> Epoch: 205 [2024-04-30 16:44:55] | (0:00:15.977114)
2024-04-30 16:44:56,971 dotcom INFO ====> Epoch: 206 [2024-04-30 16:44:56] | (0:00:01.656408)
2024-04-30 16:44:58,348 dotcom INFO ====> Epoch: 207 [2024-04-30 16:44:58] | (0:00:01.370642)
2024-04-30 16:44:59,760 dotcom INFO ====> Epoch: 208 [2024-04-30 16:44:59] | (0:00:01.405177)
2024-04-30 16:45:01,121 dotcom INFO ====> Epoch: 209 [2024-04-30 16:45:01] | (0:00:01.355015)
2024-04-30 16:45:02,480 dotcom INFO Saving model and optimizer state at epoch 210 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:45:03,309 dotcom INFO Saving model and optimizer state at epoch 210 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:45:06,297 dotcom INFO ====> Epoch: 210 [2024-04-30 16:45:06] | (0:00:05.169248)
2024-04-30 16:45:07,732 dotcom INFO ====> Epoch: 211 [2024-04-30 16:45:07] | (0:00:01.428908)
2024-04-30 16:45:08,998 dotcom INFO ====> Epoch: 212 [2024-04-30 16:45:08] | (0:00:01.259109)
2024-04-30 16:45:10,298 dotcom INFO ====> Epoch: 213 [2024-04-30 16:45:10] | (0:00:01.292671)
2024-04-30 16:45:11,541 dotcom INFO ====> Epoch: 214 [2024-04-30 16:45:11] | (0:00:01.235656)
2024-04-30 16:45:12,771 dotcom INFO Saving model and optimizer state at epoch 215 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:45:13,598 dotcom INFO Saving model and optimizer state at epoch 215 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:45:23,336 dotcom INFO ====> Epoch: 215 [2024-04-30 16:45:23] | (0:00:11.788778)
2024-04-30 16:45:24,900 dotcom INFO ====> Epoch: 216 [2024-04-30 16:45:24] | (0:00:01.558096)
2024-04-30 16:45:26,292 dotcom INFO ====> Epoch: 217 [2024-04-30 16:45:26] | (0:00:01.384855)
2024-04-30 16:45:27,681 dotcom INFO ====> Epoch: 218 [2024-04-30 16:45:27] | (0:00:01.381734)
2024-04-30 16:45:29,041 dotcom INFO ====> Epoch: 219 [2024-04-30 16:45:29] | (0:00:01.353006)
2024-04-30 16:45:30,428 dotcom INFO Saving model and optimizer state at epoch 220 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:45:31,442 dotcom INFO Saving model and optimizer state at epoch 220 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:45:35,139 dotcom INFO ====> Epoch: 220 [2024-04-30 16:45:35] | (0:00:06.091518)
2024-04-30 16:45:36,655 dotcom INFO ====> Epoch: 221 [2024-04-30 16:45:36] | (0:00:01.510561)
2024-04-30 16:45:37,972 dotcom INFO ====> Epoch: 222 [2024-04-30 16:45:37] | (0:00:01.311160)
2024-04-30 16:45:39,275 dotcom INFO ====> Epoch: 223 [2024-04-30 16:45:39] | (0:00:01.296826)
2024-04-30 16:45:40,549 dotcom INFO ====> Epoch: 224 [2024-04-30 16:45:40] | (0:00:01.267796)
2024-04-30 16:45:41,790 dotcom INFO Saving model and optimizer state at epoch 225 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:45:49,072 dotcom INFO Saving model and optimizer state at epoch 225 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:45:52,171 dotcom INFO ====> Epoch: 225 [2024-04-30 16:45:52] | (0:00:11.615417)
2024-04-30 16:45:53,672 dotcom INFO ====> Epoch: 226 [2024-04-30 16:45:53] | (0:00:01.494049)
2024-04-30 16:45:55,011 dotcom INFO ====> Epoch: 227 [2024-04-30 16:45:55] | (0:00:01.332844)
2024-04-30 16:45:56,389 dotcom INFO ====> Epoch: 228 [2024-04-30 16:45:56] | (0:00:01.372471)
2024-04-30 16:45:57,763 dotcom INFO ====> Epoch: 229 [2024-04-30 16:45:57] | (0:00:01.367837)
2024-04-30 16:45:59,095 dotcom INFO Saving model and optimizer state at epoch 230 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:46:01,467 dotcom INFO Saving model and optimizer state at epoch 230 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:46:07,721 dotcom INFO ====> Epoch: 230 [2024-04-30 16:46:07] | (0:00:09.948850)
2024-04-30 16:46:09,212 dotcom INFO ====> Epoch: 231 [2024-04-30 16:46:09] | (0:00:01.484827)
2024-04-30 16:46:10,499 dotcom INFO ====> Epoch: 232 [2024-04-30 16:46:10] | (0:00:01.280047)
2024-04-30 16:46:11,766 dotcom INFO ====> Epoch: 233 [2024-04-30 16:46:11] | (0:00:01.261890)
2024-04-30 16:46:13,074 dotcom INFO ====> Epoch: 234 [2024-04-30 16:46:13] | (0:00:01.300858)
2024-04-30 16:46:14,337 dotcom INFO Saving model and optimizer state at epoch 235 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:46:15,169 dotcom INFO Saving model and optimizer state at epoch 235 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:46:28,825 dotcom INFO ====> Epoch: 235 [2024-04-30 16:46:28] | (0:00:15.744486)
2024-04-30 16:46:30,387 dotcom INFO ====> Epoch: 236 [2024-04-30 16:46:30] | (0:00:01.555259)
2024-04-30 16:46:31,786 dotcom INFO ====> Epoch: 237 [2024-04-30 16:46:31] | (0:00:01.392477)
2024-04-30 16:46:33,082 dotcom INFO ====> Epoch: 238 [2024-04-30 16:46:33] | (0:00:01.289104)
2024-04-30 16:46:34,317 dotcom INFO ====> Epoch: 239 [2024-04-30 16:46:34] | (0:00:01.228170)
2024-04-30 16:46:35,541 dotcom INFO Saving model and optimizer state at epoch 240 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:46:36,327 dotcom INFO Saving model and optimizer state at epoch 240 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:46:39,238 dotcom INFO ====> Epoch: 240 [2024-04-30 16:46:39] | (0:00:04.915146)
2024-04-30 16:46:40,597 dotcom INFO ====> Epoch: 241 [2024-04-30 16:46:40] | (0:00:01.353019)
2024-04-30 16:46:41,841 dotcom INFO ====> Epoch: 242 [2024-04-30 16:46:41] | (0:00:01.237356)
2024-04-30 16:46:43,093 dotcom INFO ====> Epoch: 243 [2024-04-30 16:46:43] | (0:00:01.244958)
2024-04-30 16:46:44,356 dotcom INFO ====> Epoch: 244 [2024-04-30 16:46:44] | (0:00:01.254635)
2024-04-30 16:46:45,646 dotcom INFO Saving model and optimizer state at epoch 245 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:46:46,458 dotcom INFO Saving model and optimizer state at epoch 245 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:46:55,900 dotcom INFO ====> Epoch: 245 [2024-04-30 16:46:55] | (0:00:11.538942)
2024-04-30 16:46:57,533 dotcom INFO ====> Epoch: 246 [2024-04-30 16:46:57] | (0:00:01.626327)
2024-04-30 16:46:58,943 dotcom INFO ====> Epoch: 247 [2024-04-30 16:46:58] | (0:00:01.403756)
2024-04-30 16:47:00,393 dotcom INFO ====> Epoch: 248 [2024-04-30 16:47:00] | (0:00:01.443080)
2024-04-30 16:47:01,743 dotcom INFO ====> Epoch: 249 [2024-04-30 16:47:01] | (0:00:01.341319)
2024-04-30 16:47:03,091 dotcom INFO Saving model and optimizer state at epoch 250 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:47:03,888 dotcom INFO Saving model and optimizer state at epoch 250 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:47:08,517 dotcom INFO ====> Epoch: 250 [2024-04-30 16:47:08] | (0:00:06.767764)
2024-04-30 16:47:10,040 dotcom INFO ====> Epoch: 251 [2024-04-30 16:47:10] | (0:00:01.517298)
2024-04-30 16:47:11,339 dotcom INFO ====> Epoch: 252 [2024-04-30 16:47:11] | (0:00:01.293205)
2024-04-30 16:47:12,591 dotcom INFO ====> Epoch: 253 [2024-04-30 16:47:12] | (0:00:01.246544)
2024-04-30 16:47:13,856 dotcom INFO ====> Epoch: 254 [2024-04-30 16:47:13] | (0:00:01.258427)
2024-04-30 16:47:15,114 dotcom INFO Saving model and optimizer state at epoch 255 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:47:15,892 dotcom INFO Saving model and optimizer state at epoch 255 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:47:28,932 dotcom INFO ====> Epoch: 255 [2024-04-30 16:47:28] | (0:00:15.068685)
2024-04-30 16:47:30,574 dotcom INFO ====> Epoch: 256 [2024-04-30 16:47:30] | (0:00:01.635261)
2024-04-30 16:47:31,902 dotcom INFO ====> Epoch: 257 [2024-04-30 16:47:31] | (0:00:01.321876)
2024-04-30 16:47:33,260 dotcom INFO ====> Epoch: 258 [2024-04-30 16:47:33] | (0:00:01.342387)
2024-04-30 16:47:34,541 dotcom INFO ====> Epoch: 259 [2024-04-30 16:47:34] | (0:00:01.274777)
2024-04-30 16:47:35,826 dotcom INFO Saving model and optimizer state at epoch 260 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:47:36,651 dotcom INFO Saving model and optimizer state at epoch 260 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:47:47,651 dotcom INFO ====> Epoch: 260 [2024-04-30 16:47:47] | (0:00:13.103398)
2024-04-30 16:47:48,968 dotcom INFO ====> Epoch: 261 [2024-04-30 16:47:48] | (0:00:01.309189)
2024-04-30 16:47:50,227 dotcom INFO ====> Epoch: 262 [2024-04-30 16:47:50] | (0:00:01.252124)
2024-04-30 16:47:51,471 dotcom INFO ====> Epoch: 263 [2024-04-30 16:47:51] | (0:00:01.236628)
2024-04-30 16:47:52,789 dotcom INFO ====> Epoch: 264 [2024-04-30 16:47:52] | (0:00:01.311653)
2024-04-30 16:47:54,072 dotcom INFO Saving model and optimizer state at epoch 265 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:48:01,800 dotcom INFO Saving model and optimizer state at epoch 265 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:48:12,452 dotcom INFO ====> Epoch: 265 [2024-04-30 16:48:12] | (0:00:19.656599)
2024-04-30 16:48:14,063 dotcom INFO ====> Epoch: 266 [2024-04-30 16:48:14] | (0:00:01.604576)
2024-04-30 16:48:15,382 dotcom INFO ====> Epoch: 267 [2024-04-30 16:48:15] | (0:00:01.312605)
2024-04-30 16:48:16,673 dotcom INFO ====> Epoch: 268 [2024-04-30 16:48:16] | (0:00:01.284463)
2024-04-30 16:48:17,898 dotcom INFO ====> Epoch: 269 [2024-04-30 16:48:17] | (0:00:01.219241)
2024-04-30 16:48:19,188 dotcom INFO Saving model and optimizer state at epoch 270 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:48:19,975 dotcom INFO Saving model and optimizer state at epoch 270 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:48:23,003 dotcom INFO ====> Epoch: 270 [2024-04-30 16:48:23] | (0:00:05.098911)
2024-04-30 16:48:24,460 dotcom INFO ====> Epoch: 271 [2024-04-30 16:48:24] | (0:00:01.450913)
2024-04-30 16:48:25,875 dotcom INFO ====> Epoch: 272 [2024-04-30 16:48:25] | (0:00:01.405659)
2024-04-30 16:48:27,255 dotcom INFO ====> Epoch: 273 [2024-04-30 16:48:27] | (0:00:01.371728)
2024-04-30 16:48:28,698 dotcom INFO ====> Epoch: 274 [2024-04-30 16:48:28] | (0:00:01.436732)
2024-04-30 16:48:30,077 dotcom INFO Saving model and optimizer state at epoch 275 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:48:31,291 dotcom INFO Saving model and optimizer state at epoch 275 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:48:46,231 dotcom INFO ====> Epoch: 275 [2024-04-30 16:48:46] | (0:00:17.525585)
2024-04-30 16:48:47,814 dotcom INFO ====> Epoch: 276 [2024-04-30 16:48:47] | (0:00:01.577534)
2024-04-30 16:48:49,128 dotcom INFO ====> Epoch: 277 [2024-04-30 16:48:49] | (0:00:01.306568)
2024-04-30 16:48:50,397 dotcom INFO ====> Epoch: 278 [2024-04-30 16:48:50] | (0:00:01.262261)
2024-04-30 16:48:51,662 dotcom INFO ====> Epoch: 279 [2024-04-30 16:48:51] | (0:00:01.258415)
2024-04-30 16:48:52,930 dotcom INFO Saving model and optimizer state at epoch 280 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:48:53,727 dotcom INFO Saving model and optimizer state at epoch 280 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:48:58,769 dotcom INFO ====> Epoch: 280 [2024-04-30 16:48:58] | (0:00:07.098671)
2024-04-30 16:49:00,367 dotcom INFO ====> Epoch: 281 [2024-04-30 16:49:00] | (0:00:01.590324)
2024-04-30 16:49:01,756 dotcom INFO ====> Epoch: 282 [2024-04-30 16:49:01] | (0:00:01.382018)
2024-04-30 16:49:03,087 dotcom INFO ====> Epoch: 283 [2024-04-30 16:49:03] | (0:00:01.323486)
2024-04-30 16:49:04,397 dotcom INFO ====> Epoch: 284 [2024-04-30 16:49:04] | (0:00:01.303093)
2024-04-30 16:49:05,695 dotcom INFO Saving model and optimizer state at epoch 285 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:49:13,716 dotcom INFO Saving model and optimizer state at epoch 285 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:49:24,988 dotcom INFO ====> Epoch: 285 [2024-04-30 16:49:24] | (0:00:20.584162)
2024-04-30 16:49:26,539 dotcom INFO ====> Epoch: 286 [2024-04-30 16:49:26] | (0:00:01.543989)
2024-04-30 16:49:27,965 dotcom INFO ====> Epoch: 287 [2024-04-30 16:49:27] | (0:00:01.399974)
2024-04-30 16:49:29,375 dotcom INFO ====> Epoch: 288 [2024-04-30 16:49:29] | (0:00:01.403826)
2024-04-30 16:49:30,839 dotcom INFO ====> Epoch: 289 [2024-04-30 16:49:30] | (0:00:01.455486)
2024-04-30 16:49:32,243 dotcom INFO Saving model and optimizer state at epoch 290 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:49:33,135 dotcom INFO Saving model and optimizer state at epoch 290 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:49:46,913 dotcom INFO ====> Epoch: 290 [2024-04-30 16:49:46] | (0:00:16.065351)
2024-04-30 16:49:48,439 dotcom INFO ====> Epoch: 291 [2024-04-30 16:49:48] | (0:00:01.519707)
2024-04-30 16:49:49,710 dotcom INFO ====> Epoch: 292 [2024-04-30 16:49:49] | (0:00:01.264548)
2024-04-30 16:49:51,056 dotcom INFO ====> Epoch: 293 [2024-04-30 16:49:51] | (0:00:01.319021)
2024-04-30 16:49:52,358 dotcom INFO ====> Epoch: 294 [2024-04-30 16:49:52] | (0:00:01.295127)
2024-04-30 16:49:53,599 dotcom INFO Saving model and optimizer state at epoch 295 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:49:54,488 dotcom INFO Saving model and optimizer state at epoch 295 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:49:58,407 dotcom INFO ====> Epoch: 295 [2024-04-30 16:49:58] | (0:00:06.041742)
2024-04-30 16:50:00,049 dotcom INFO ====> Epoch: 296 [2024-04-30 16:50:00] | (0:00:01.628529)
2024-04-30 16:50:01,402 dotcom INFO ====> Epoch: 297 [2024-04-30 16:50:01] | (0:00:01.344369)
2024-04-30 16:50:02,834 dotcom INFO ====> Epoch: 298 [2024-04-30 16:50:02] | (0:00:01.423107)
2024-04-30 16:50:04,193 dotcom INFO ====> Epoch: 299 [2024-04-30 16:50:04] | (0:00:01.351852)
2024-04-30 16:50:07,994 dotcom INFO Saving model and optimizer state at epoch 300 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:50:22,538 dotcom INFO Saving model and optimizer state at epoch 300 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:50:34,070 dotcom INFO ====> Epoch: 300 [2024-04-30 16:50:34] | (0:00:27.589775)
2024-04-30 16:50:34,952 dotcom INFO Train Epoch: 301 [0%]
2024-04-30 16:50:34,953 dotcom INFO [600, 9.631921600483981e-05]
2024-04-30 16:50:34,953 dotcom INFO loss_disc=3.760, loss_gen=3.147, loss_fm=3.798,loss_mel=6.459, loss_kl=0.468
2024-04-30 16:50:35,912 dotcom INFO ====> Epoch: 301 [2024-04-30 16:50:35] | (0:00:01.835533)
2024-04-30 16:50:37,115 dotcom INFO ====> Epoch: 302 [2024-04-30 16:50:37] | (0:00:01.193952)
2024-04-30 16:50:38,359 dotcom INFO ====> Epoch: 303 [2024-04-30 16:50:38] | (0:00:01.237795)
2024-04-30 16:50:39,577 dotcom INFO ====> Epoch: 304 [2024-04-30 16:50:39] | (0:00:01.211661)
2024-04-30 16:50:40,807 dotcom INFO Saving model and optimizer state at epoch 305 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:50:47,036 dotcom INFO Saving model and optimizer state at epoch 305 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:51:01,325 dotcom INFO ====> Epoch: 305 [2024-04-30 16:51:01] | (0:00:21.740495)
2024-04-30 16:51:02,890 dotcom INFO ====> Epoch: 306 [2024-04-30 16:51:02] | (0:00:01.558405)
2024-04-30 16:51:04,190 dotcom INFO ====> Epoch: 307 [2024-04-30 16:51:04] | (0:00:01.292395)
2024-04-30 16:51:05,401 dotcom INFO ====> Epoch: 308 [2024-04-30 16:51:05] | (0:00:01.203525)
2024-04-30 16:51:06,692 dotcom INFO ====> Epoch: 309 [2024-04-30 16:51:06] | (0:00:01.284064)
2024-04-30 16:51:07,913 dotcom INFO Saving model and optimizer state at epoch 310 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:51:08,675 dotcom INFO Saving model and optimizer state at epoch 310 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:51:29,110 dotcom INFO ====> Epoch: 310 [2024-04-30 16:51:29] | (0:00:22.412101)
2024-04-30 16:51:30,905 dotcom INFO ====> Epoch: 311 [2024-04-30 16:51:30] | (0:00:01.785961)
2024-04-30 16:51:32,261 dotcom INFO ====> Epoch: 312 [2024-04-30 16:51:32] | (0:00:01.349994)
2024-04-30 16:51:33,686 dotcom INFO ====> Epoch: 313 [2024-04-30 16:51:33] | (0:00:01.417303)
2024-04-30 16:51:35,001 dotcom INFO ====> Epoch: 314 [2024-04-30 16:51:35] | (0:00:01.309952)
2024-04-30 16:51:36,289 dotcom INFO Saving model and optimizer state at epoch 315 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:51:37,097 dotcom INFO Saving model and optimizer state at epoch 315 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:51:40,321 dotcom INFO ====> Epoch: 315 [2024-04-30 16:51:40] | (0:00:05.310309)
2024-04-30 16:51:41,753 dotcom INFO ====> Epoch: 316 [2024-04-30 16:51:41] | (0:00:01.425781)
2024-04-30 16:51:43,096 dotcom INFO ====> Epoch: 317 [2024-04-30 16:51:43] | (0:00:01.336210)
2024-04-30 16:51:44,359 dotcom INFO ====> Epoch: 318 [2024-04-30 16:51:44] | (0:00:01.254846)
2024-04-30 16:51:45,674 dotcom INFO ====> Epoch: 319 [2024-04-30 16:51:45] | (0:00:01.290515)
2024-04-30 16:51:46,915 dotcom INFO Saving model and optimizer state at epoch 320 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:52:12,428 dotcom INFO Saving model and optimizer state at epoch 320 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:52:31,514 dotcom INFO ====> Epoch: 320 [2024-04-30 16:52:31] | (0:00:45.833585)
2024-04-30 16:52:33,063 dotcom INFO ====> Epoch: 321 [2024-04-30 16:52:33] | (0:00:01.540777)
2024-04-30 16:52:34,451 dotcom INFO ====> Epoch: 322 [2024-04-30 16:52:34] | (0:00:01.382770)
2024-04-30 16:52:35,854 dotcom INFO ====> Epoch: 323 [2024-04-30 16:52:35] | (0:00:01.396778)
2024-04-30 16:52:37,147 dotcom INFO ====> Epoch: 324 [2024-04-30 16:52:37] | (0:00:01.282339)
2024-04-30 16:52:38,450 dotcom INFO Saving model and optimizer state at epoch 325 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:52:39,269 dotcom INFO Saving model and optimizer state at epoch 325 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:52:44,666 dotcom INFO ====> Epoch: 325 [2024-04-30 16:52:44] | (0:00:07.512897)
2024-04-30 16:52:46,183 dotcom INFO ====> Epoch: 326 [2024-04-30 16:52:46] | (0:00:01.510757)
2024-04-30 16:52:47,493 dotcom INFO ====> Epoch: 327 [2024-04-30 16:52:47] | (0:00:01.304269)
2024-04-30 16:52:48,806 dotcom INFO ====> Epoch: 328 [2024-04-30 16:52:48] | (0:00:01.305876)
2024-04-30 16:52:50,221 dotcom INFO ====> Epoch: 329 [2024-04-30 16:52:50] | (0:00:01.407176)
2024-04-30 16:52:51,534 dotcom INFO Saving model and optimizer state at epoch 330 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:52:52,882 dotcom INFO Saving model and optimizer state at epoch 330 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:53:11,619 dotcom INFO ====> Epoch: 330 [2024-04-30 16:53:11] | (0:00:21.390924)
2024-04-30 16:53:13,183 dotcom INFO ====> Epoch: 331 [2024-04-30 16:53:13] | (0:00:01.557519)
2024-04-30 16:53:14,619 dotcom INFO ====> Epoch: 332 [2024-04-30 16:53:14] | (0:00:01.428980)
2024-04-30 16:53:16,075 dotcom INFO ====> Epoch: 333 [2024-04-30 16:53:16] | (0:00:01.446995)
2024-04-30 16:53:17,425 dotcom INFO ====> Epoch: 334 [2024-04-30 16:53:17] | (0:00:01.342979)
2024-04-30 16:53:18,864 dotcom INFO Saving model and optimizer state at epoch 335 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:53:19,697 dotcom INFO Saving model and optimizer state at epoch 335 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:53:36,087 dotcom INFO ====> Epoch: 335 [2024-04-30 16:53:36] | (0:00:18.651317)
2024-04-30 16:53:37,478 dotcom INFO ====> Epoch: 336 [2024-04-30 16:53:37] | (0:00:01.383398)
2024-04-30 16:53:38,911 dotcom INFO ====> Epoch: 337 [2024-04-30 16:53:38] | (0:00:01.424184)
2024-04-30 16:53:40,300 dotcom INFO ====> Epoch: 338 [2024-04-30 16:53:40] | (0:00:01.382882)
2024-04-30 16:53:41,620 dotcom INFO ====> Epoch: 339 [2024-04-30 16:53:41] | (0:00:01.312977)
2024-04-30 16:53:43,035 dotcom INFO Saving model and optimizer state at epoch 340 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:53:43,930 dotcom INFO Saving model and optimizer state at epoch 340 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:53:46,933 dotcom INFO ====> Epoch: 340 [2024-04-30 16:53:46] | (0:00:05.303348)
2024-04-30 16:53:48,333 dotcom INFO ====> Epoch: 341 [2024-04-30 16:53:48] | (0:00:01.394653)
2024-04-30 16:53:49,770 dotcom INFO ====> Epoch: 342 [2024-04-30 16:53:49] | (0:00:01.429013)
2024-04-30 16:53:51,352 dotcom INFO ====> Epoch: 343 [2024-04-30 16:53:51] | (0:00:01.573350)
2024-04-30 16:53:52,769 dotcom INFO ====> Epoch: 344 [2024-04-30 16:53:52] | (0:00:01.408582)
2024-04-30 16:53:54,247 dotcom INFO Saving model and optimizer state at epoch 345 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:54:05,394 dotcom INFO Saving model and optimizer state at epoch 345 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:54:19,854 dotcom INFO ====> Epoch: 345 [2024-04-30 16:54:19] | (0:00:27.076022)
2024-04-30 16:54:21,389 dotcom INFO ====> Epoch: 346 [2024-04-30 16:54:21] | (0:00:01.527887)
2024-04-30 16:54:22,782 dotcom INFO ====> Epoch: 347 [2024-04-30 16:54:22] | (0:00:01.385434)
2024-04-30 16:54:24,127 dotcom INFO ====> Epoch: 348 [2024-04-30 16:54:24] | (0:00:01.338679)
2024-04-30 16:54:25,525 dotcom INFO ====> Epoch: 349 [2024-04-30 16:54:25] | (0:00:01.391010)
2024-04-30 16:54:26,986 dotcom INFO Saving model and optimizer state at epoch 350 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:54:27,845 dotcom INFO Saving model and optimizer state at epoch 350 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:54:40,735 dotcom INFO ====> Epoch: 350 [2024-04-30 16:54:40] | (0:00:15.201615)
2024-04-30 16:54:42,173 dotcom INFO ====> Epoch: 351 [2024-04-30 16:54:42] | (0:00:01.427931)
2024-04-30 16:54:43,571 dotcom INFO ====> Epoch: 352 [2024-04-30 16:54:43] | (0:00:01.390932)
2024-04-30 16:54:44,942 dotcom INFO ====> Epoch: 353 [2024-04-30 16:54:44] | (0:00:01.364450)
2024-04-30 16:54:46,342 dotcom INFO ====> Epoch: 354 [2024-04-30 16:54:46] | (0:00:01.393786)
2024-04-30 16:54:47,680 dotcom INFO Saving model and optimizer state at epoch 355 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:54:48,454 dotcom INFO Saving model and optimizer state at epoch 355 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:54:54,094 dotcom INFO ====> Epoch: 355 [2024-04-30 16:54:54] | (0:00:07.745114)
2024-04-30 16:54:55,786 dotcom INFO ====> Epoch: 356 [2024-04-30 16:54:55] | (0:00:01.684947)
2024-04-30 16:54:57,195 dotcom INFO ====> Epoch: 357 [2024-04-30 16:54:57] | (0:00:01.400268)
2024-04-30 16:54:58,578 dotcom INFO ====> Epoch: 358 [2024-04-30 16:54:58] | (0:00:01.376469)
2024-04-30 16:55:00,046 dotcom INFO ====> Epoch: 359 [2024-04-30 16:55:00] | (0:00:01.461799)
2024-04-30 16:55:01,448 dotcom INFO Saving model and optimizer state at epoch 360 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:55:02,248 dotcom INFO Saving model and optimizer state at epoch 360 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:55:08,393 dotcom INFO ====> Epoch: 360 [2024-04-30 16:55:08] | (0:00:08.340606)
2024-04-30 16:55:10,082 dotcom INFO ====> Epoch: 361 [2024-04-30 16:55:10] | (0:00:01.682527)
2024-04-30 16:55:11,701 dotcom INFO ====> Epoch: 362 [2024-04-30 16:55:11] | (0:00:01.605695)
2024-04-30 16:55:13,246 dotcom INFO ====> Epoch: 363 [2024-04-30 16:55:13] | (0:00:01.535152)
2024-04-30 16:55:14,649 dotcom INFO ====> Epoch: 364 [2024-04-30 16:55:14] | (0:00:01.396054)
2024-04-30 16:55:15,978 dotcom INFO Saving model and optimizer state at epoch 365 to ./logs\dotcom\G_2333333.pth
2024-04-30 16:55:21,528 dotcom INFO Saving model and optimizer state at epoch 365 to ./logs\dotcom\D_2333333.pth
2024-04-30 16:55:35,085 dotcom INFO ====> Epoch: 365 [2024-04-30 16:55:35] | (0:00:20.430333)
2024-04-30 16:55:36,740 dotcom INFO ====> Epoch: 366 [2024-04-30 16:55:36] | (0:00:01.646841)
2024-04-30 16:55:38,096 dotcom INFO ====> Epoch: 367 [2024-04-30 16:55:38] | (0:00:01.349975)
2024-04-30 16:55:38,097 dotcom INFO Training is done. The program is closed.
2024-04-30 16:55:38,235 dotcom INFO saving final ckpt:Success.
|