SDGPA / rain1 /log.txt
roujin's picture
init
44a8b4b verified
raw
history blame
16.1 kB
Model pushed to 1 GPU(s), type NVIDIA GeForce RTX 3090.
--- Training ---
Epoch 0 train loss: 1.5886, acc: 0.7797
--- Validation - Source ---
* Acc 0.869
--- Validation - Target ---
* Acc 0.825
mIoU improved from 0.0000 to 0.2571.
mIoU improved from 0.0000 to 0.3402.
--- Training ---
Epoch 1 train loss: 0.9981, acc: 0.8539
--- Validation - Source ---
* Acc 0.889
--- Validation - Target ---
* Acc 0.841
mIoU improved from 0.2571 to 0.3165.
mIoU improved from 0.3402 to 0.4311.
--- Training ---
Epoch 2 train loss: 0.8780, acc: 0.8694
--- Validation - Source ---
* Acc 0.898
--- Validation - Target ---
* Acc 0.845
mIoU improved from 0.3165 to 0.3412.
mIoU improved from 0.4311 to 0.4731.
--- Training ---
Epoch 3 train loss: 0.8068, acc: 0.8793
--- Validation - Source ---
* Acc 0.898
--- Validation - Target ---
* Acc 0.842
mIoU improved from 0.3412 to 0.3498.
mIoU improved from 0.4731 to 0.4941.
--- Training ---
Epoch 4 train loss: 0.7539, acc: 0.8871
--- Validation - Source ---
* Acc 0.907
--- Validation - Target ---
* Acc 0.849
mIoU improved from 0.3498 to 0.3643.
mIoU improved from 0.4941 to 0.5162.
--- Training ---
Epoch 5 train loss: 0.7164, acc: 0.8923
--- Validation - Source ---
* Acc 0.910
--- Validation - Target ---
* Acc 0.858
mIoU improved from 0.3643 to 0.3687.
mIoU improved from 0.5162 to 0.5333.
--- Training ---
Epoch 6 train loss: 0.6887, acc: 0.8964
--- Validation - Source ---
* Acc 0.912
--- Validation - Target ---
* Acc 0.852
mIoU improved from 0.5333 to 0.5438.
--- Training ---
Epoch 7 train loss: 0.6609, acc: 0.8998
--- Validation - Source ---
* Acc 0.912
--- Validation - Target ---
* Acc 0.840
--- Training ---
Epoch 8 train loss: 0.6437, acc: 0.9027
--- Validation - Source ---
* Acc 0.914
--- Validation - Target ---
* Acc 0.852
mIoU improved from 0.3687 to 0.3888.
mIoU improved from 0.5438 to 0.5545.
--- Training ---
Epoch 9 train loss: 0.6323, acc: 0.9047
--- Validation - Source ---
* Acc 0.917
--- Validation - Target ---
* Acc 0.856
mIoU improved from 0.5545 to 0.5607.
--- Training ---
Epoch 10 train loss: 0.6090, acc: 0.9077
--- Validation - Source ---
* Acc 0.918
--- Validation - Target ---
* Acc 0.852
mIoU improved from 0.3888 to 0.3947.
mIoU improved from 0.5607 to 0.5751.
--- Training ---
Epoch 11 train loss: 0.6005, acc: 0.9085
--- Validation - Source ---
* Acc 0.919
--- Validation - Target ---
* Acc 0.843
--- Training ---
Epoch 12 train loss: 0.5850, acc: 0.9112
--- Validation - Source ---
* Acc 0.919
--- Validation - Target ---
* Acc 0.838
mIoU improved from 0.5751 to 0.5797.
--- Training ---
Epoch 13 train loss: 0.5736, acc: 0.9129
--- Validation - Source ---
* Acc 0.919
--- Validation - Target ---
* Acc 0.849
--- Training ---
Epoch 14 train loss: 0.5643, acc: 0.9143
--- Validation - Source ---
* Acc 0.920
--- Validation - Target ---
* Acc 0.834
mIoU improved from 0.5797 to 0.5873.
--- Training ---
Epoch 15 train loss: 0.5590, acc: 0.9151
--- Validation - Source ---
* Acc 0.922
--- Validation - Target ---
* Acc 0.827
mIoU improved from 0.3947 to 0.3978.
mIoU improved from 0.5873 to 0.5899.
--- Training ---
Epoch 16 train loss: 0.5511, acc: 0.9164
--- Validation - Source ---
* Acc 0.923
--- Validation - Target ---
* Acc 0.815
--- Training ---
Epoch 17 train loss: 0.5452, acc: 0.9170
--- Validation - Source ---
* Acc 0.923
--- Validation - Target ---
* Acc 0.841
mIoU improved from 0.5899 to 0.5969.
--- Training ---
Epoch 18 train loss: 0.5350, acc: 0.9183
--- Validation - Source ---
* Acc 0.922
--- Validation - Target ---
* Acc 0.840
--- Training ---
Epoch 19 train loss: 0.5263, acc: 0.9194
--- Validation - Source ---
* Acc 0.924
--- Validation - Target ---
* Acc 0.856
mIoU improved from 0.3978 to 0.4071.
mIoU improved from 0.5969 to 0.6048.
--- Training ---
Epoch 20 train loss: 0.5233, acc: 0.9198
--- Validation - Source ---
* Acc 0.925
--- Validation - Target ---
* Acc 0.824
mIoU improved from 0.6048 to 0.6106.
--- Training ---
Epoch 21 train loss: 0.5145, acc: 0.9211
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.801
mIoU improved from 0.6106 to 0.6122.
--- Training ---
Epoch 22 train loss: 0.5135, acc: 0.9213
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.828
mIoU improved from 0.4071 to 0.4077.
mIoU improved from 0.6122 to 0.6234.
--- Training ---
Epoch 23 train loss: 0.5052, acc: 0.9229
--- Validation - Source ---
* Acc 0.927
--- Validation - Target ---
* Acc 0.857
mIoU improved from 0.4077 to 0.4140.
--- Training ---
Epoch 24 train loss: 0.5023, acc: 0.9233
--- Validation - Source ---
* Acc 0.926
--- Validation - Target ---
* Acc 0.819
--- Training ---
Epoch 25 train loss: 0.5000, acc: 0.9234
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.833
--- Training ---
Epoch 26 train loss: 0.4934, acc: 0.9242
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.833
--- Training ---
Epoch 27 train loss: 0.4895, acc: 0.9249
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.847
mIoU improved from 0.6234 to 0.6247.
--- Training ---
Epoch 28 train loss: 0.4844, acc: 0.9257
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.846
--- Training ---
Epoch 29 train loss: 0.4820, acc: 0.9258
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.853
mIoU improved from 0.6247 to 0.6255.
--- Training ---
Epoch 30 train loss: 0.4782, acc: 0.9263
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.865
mIoU improved from 0.4140 to 0.4214.
--- Training ---
Epoch 31 train loss: 0.4744, acc: 0.9271
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.859
--- Training ---
Epoch 32 train loss: 0.4735, acc: 0.9270
--- Validation - Source ---
* Acc 0.928
--- Validation - Target ---
* Acc 0.826
--- Training ---
Epoch 33 train loss: 0.4668, acc: 0.9280
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.856
mIoU improved from 0.6255 to 0.6305.
--- Training ---
Epoch 34 train loss: 0.4647, acc: 0.9285
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.854
--- Training ---
Epoch 35 train loss: 0.4637, acc: 0.9285
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.825
mIoU improved from 0.6305 to 0.6307.
--- Training ---
Epoch 36 train loss: 0.4617, acc: 0.9290
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.830
--- Training ---
Epoch 37 train loss: 0.4631, acc: 0.9288
--- Validation - Source ---
* Acc 0.931
--- Validation - Target ---
* Acc 0.834
mIoU improved from 0.6307 to 0.6340.
--- Training ---
Epoch 38 train loss: 0.4565, acc: 0.9293
--- Validation - Source ---
* Acc 0.931
--- Validation - Target ---
* Acc 0.835
--- Training ---
Epoch 39 train loss: 0.4572, acc: 0.9295
--- Validation - Source ---
* Acc 0.931
--- Validation - Target ---
* Acc 0.836
mIoU improved from 0.6340 to 0.6382.
--- Training ---
Epoch 40 train loss: 0.4515, acc: 0.9303
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.839
--- Training ---
Epoch 41 train loss: 0.4481, acc: 0.9307
--- Validation - Source ---
* Acc 0.930
--- Validation - Target ---
* Acc 0.834
--- Training ---
Epoch 42 train loss: 0.4491, acc: 0.9309
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.856
mIoU improved from 0.4214 to 0.4279.
mIoU improved from 0.6382 to 0.6403.
--- Training ---
Epoch 43 train loss: 0.4428, acc: 0.9316
--- Validation - Source ---
* Acc 0.929
--- Validation - Target ---
* Acc 0.837
--- Training ---
Epoch 44 train loss: 0.4423, acc: 0.9316
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.849
mIoU improved from 0.6403 to 0.6410.
--- Training ---
Epoch 45 train loss: 0.4405, acc: 0.9320
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.852
mIoU improved from 0.4279 to 0.4284.
mIoU improved from 0.6410 to 0.6444.
--- Training ---
Epoch 46 train loss: 0.4419, acc: 0.9316
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.844
--- Training ---
Epoch 47 train loss: 0.4390, acc: 0.9321
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.824
--- Training ---
Epoch 48 train loss: 0.4370, acc: 0.9323
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.835
--- Training ---
Epoch 49 train loss: 0.4335, acc: 0.9332
--- Validation - Source ---
* Acc 0.932
--- Validation - Target ---
* Acc 0.803
--- Training ---
Epoch 50 train loss: 0.4338, acc: 0.9327
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.807
--- Training ---
Epoch 51 train loss: 0.4297, acc: 0.9336
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.863
mIoU improved from 0.6444 to 0.6506.
--- Training ---
Epoch 52 train loss: 0.4277, acc: 0.9337
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.834
--- Training ---
Epoch 53 train loss: 0.4302, acc: 0.9334
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.839
--- Training ---
Epoch 54 train loss: 0.4259, acc: 0.9339
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.860
--- Training ---
Epoch 55 train loss: 0.4261, acc: 0.9342
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.871
mIoU improved from 0.4284 to 0.4417.
--- Training ---
Epoch 56 train loss: 0.4261, acc: 0.9339
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.840
--- Training ---
Epoch 57 train loss: 0.4238, acc: 0.9341
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.864
--- Training ---
Epoch 58 train loss: 0.4234, acc: 0.9345
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.855
mIoU improved from 0.6506 to 0.6508.
--- Training ---
Epoch 59 train loss: 0.4191, acc: 0.9349
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.836
--- Training ---
Epoch 60 train loss: 0.4184, acc: 0.9352
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.867
--- Training ---
Epoch 61 train loss: 0.4198, acc: 0.9349
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.864
mIoU improved from 0.4417 to 0.4419.
--- Training ---
Epoch 62 train loss: 0.4187, acc: 0.9352
--- Validation - Source ---
* Acc 0.933
--- Validation - Target ---
* Acc 0.851
--- Training ---
Epoch 63 train loss: 0.4160, acc: 0.9355
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.866
mIoU improved from 0.4419 to 0.4442.
mIoU improved from 0.6508 to 0.6509.
--- Training ---
Epoch 64 train loss: 0.4167, acc: 0.9352
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.864
mIoU improved from 0.4442 to 0.4511.
mIoU improved from 0.6509 to 0.6580.
--- Training ---
Epoch 65 train loss: 0.4151, acc: 0.9356
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.832
--- Training ---
Epoch 66 train loss: 0.4135, acc: 0.9358
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.852
--- Training ---
Epoch 67 train loss: 0.4124, acc: 0.9359
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.847
--- Training ---
Epoch 68 train loss: 0.4115, acc: 0.9363
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.855
--- Training ---
Epoch 69 train loss: 0.4111, acc: 0.9361
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.862
--- Training ---
Epoch 70 train loss: 0.4107, acc: 0.9361
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.863
mIoU improved from 0.4511 to 0.4552.
--- Training ---
Epoch 71 train loss: 0.4111, acc: 0.9362
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.864
--- Training ---
Epoch 72 train loss: 0.4067, acc: 0.9368
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.839
--- Training ---
Epoch 73 train loss: 0.4073, acc: 0.9366
--- Validation - Source ---
* Acc 0.935
--- Validation - Target ---
* Acc 0.828
--- Training ---
Epoch 74 train loss: 0.4077, acc: 0.9367
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.854
--- Training ---
Epoch 75 train loss: 0.4069, acc: 0.9366
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.850
mIoU improved from 0.6580 to 0.6609.
--- Training ---
Epoch 76 train loss: 0.4085, acc: 0.9366
--- Validation - Source ---
* Acc 0.934
--- Validation - Target ---
* Acc 0.832
--- Training ---
Epoch 77 train loss: 0.4027, acc: 0.9373
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.843
--- Training ---
Epoch 78 train loss: 0.4054, acc: 0.9368
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.830
--- Training ---
Epoch 79 train loss: 0.4056, acc: 0.9368
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.858
--- Training ---
Epoch 80 train loss: 0.4047, acc: 0.9372
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.871
--- Training ---
Epoch 81 train loss: 0.4007, acc: 0.9377
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.830
--- Training ---
Epoch 82 train loss: 0.4040, acc: 0.9374
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.829
--- Training ---
Epoch 83 train loss: 0.4013, acc: 0.9376
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.819
mIoU improved from 0.6609 to 0.6627.
--- Training ---
Epoch 84 train loss: 0.4019, acc: 0.9375
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.841
--- Training ---
Epoch 85 train loss: 0.4015, acc: 0.9375
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.855
--- Training ---
Epoch 86 train loss: 0.4010, acc: 0.9375
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.851
--- Training ---
Epoch 87 train loss: 0.3984, acc: 0.9380
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.844
--- Training ---
Epoch 88 train loss: 0.3987, acc: 0.9380
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.824
--- Training ---
Epoch 89 train loss: 0.3995, acc: 0.9380
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.834
--- Training ---
Epoch 90 train loss: 0.3990, acc: 0.9378
--- Validation - Source ---
* Acc 0.938
--- Validation - Target ---
* Acc 0.852
mIoU improved from 0.6627 to 0.6652.
--- Training ---
Epoch 91 train loss: 0.3976, acc: 0.9381
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.839
--- Training ---
Epoch 92 train loss: 0.3985, acc: 0.9378
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.834
--- Training ---
Epoch 93 train loss: 0.3998, acc: 0.9379
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.849
--- Training ---
Epoch 94 train loss: 0.3965, acc: 0.9383
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.834
--- Training ---
Epoch 95 train loss: 0.3980, acc: 0.9380
--- Validation - Source ---
* Acc 0.938
--- Validation - Target ---
* Acc 0.842
--- Training ---
Epoch 96 train loss: 0.3960, acc: 0.9384
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.836
--- Training ---
Epoch 97 train loss: 0.3989, acc: 0.9379
--- Validation - Source ---
* Acc 0.936
--- Validation - Target ---
* Acc 0.841
--- Training ---
Epoch 98 train loss: 0.4000, acc: 0.9377
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.854
--- Training ---
Epoch 99 train loss: 0.3959, acc: 0.9383
--- Validation - Source ---
* Acc 0.937
--- Validation - Target ---
* Acc 0.841
Training complete in 658m 32s
Best mIoU target: 0.455213