| [2024-07-03 10:14:37,392][__main__][INFO] - Using GPU for training. Main device : cuda:0 | |
| [2024-07-03 10:14:37,392][__main__][INFO] - Using multiple GPUs : [0, 1, 2, 3] | |
| [2024-07-03 10:14:46,318][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-07-03 10:14:46,336][__main__][INFO] - PSF min : 0.0 | |
| [2024-07-03 10:14:46,350][__main__][INFO] - PSF max : 0.12337537109851837 | |
| [2024-07-03 10:14:46,351][__main__][INFO] - PSF dtype : torch.float32 | |
| [2024-07-03 10:14:46,379][__main__][INFO] - PSF norm : 1.7320507764816284 | |
| [2024-07-03 10:14:46,379][__main__][INFO] - Reconstruction a few images with ADMM... | |
| [2024-07-03 10:14:46,958][__main__][INFO] - Cropped shape : (135, 240, 3) | |
| [2024-07-03 10:14:48,240][__main__][INFO] - Train test size : 24000 | |
| [2024-07-03 10:14:48,240][__main__][INFO] - Test test size : 999 | |
| [2024-07-03 10:14:48,393][__main__][INFO] - Training model with 8210565 parameters | |
| [2024-07-03 10:14:48,393][__main__][INFO] - -- Post-process model with 4659424 parameters | |
| [2024-07-03 10:14:48,393][__main__][INFO] - Setup time : 0.1531672477722168 s | |
| [2024-07-03 10:14:48,394][__main__][INFO] - PSF shape : torch.Size([1, 135, 240, 3]) | |
| [2024-07-03 10:14:48,394][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-07-03/10-14-31 | |
| [2024-07-03 10:16:07,314][__main__][INFO] - Epoch 0 with learning rate [0.0001] | |
| [2024-07-03 11:06:16,136][__main__][INFO] - loss : 0.37400118413567446 | |
| [2024-07-03 11:07:31,618][__main__][INFO] - Epoch 1 with learning rate [0.0001] | |
| [2024-07-03 12:03:51,889][__main__][INFO] - loss : 0.2890715430751448 | |
| [2024-07-03 12:05:08,557][__main__][INFO] - Epoch 2 with learning rate [0.0001] | |
| [2024-07-03 12:55:54,158][__main__][INFO] - loss : 0.2682848064427578 | |
| [2024-07-03 12:57:09,029][__main__][INFO] - Epoch 3 with learning rate [0.0001] | |
| [2024-07-03 13:46:31,710][__main__][INFO] - loss : 0.2574984178567926 | |
| [2024-07-03 13:47:45,864][__main__][INFO] - Epoch 4 with learning rate [0.0001] | |
| [2024-07-03 14:37:01,760][__main__][INFO] - loss : 0.24936617012322013 | |
| [2024-07-03 14:38:17,327][__main__][INFO] - Epoch 5 with learning rate [0.0001] | |
| [2024-07-03 15:27:27,271][__main__][INFO] - loss : 0.2428666595642768 | |
| [2024-07-03 15:28:42,981][__main__][INFO] - Epoch 6 with learning rate [0.0001] | |
| [2024-07-03 16:18:04,987][__main__][INFO] - loss : 0.2369095754077043 | |
| [2024-07-03 16:19:20,066][__main__][INFO] - Epoch 7 with learning rate [0.0001] | |
| [2024-07-03 17:08:30,837][__main__][INFO] - loss : 0.23276281046122338 | |
| [2024-07-03 17:09:46,416][__main__][INFO] - Epoch 8 with learning rate [0.0001] | |
| [2024-07-03 17:58:56,449][__main__][INFO] - loss : 0.2275098766858378 | |
| [2024-07-03 18:00:11,064][__main__][INFO] - Epoch 9 with learning rate [0.0001] | |
| [2024-07-03 18:49:17,607][__main__][INFO] - loss : 0.2253867843101423 | |
| [2024-07-03 18:50:32,772][__main__][INFO] - Epoch 10 with learning rate [0.0001] | |
| [2024-07-03 19:39:52,488][__main__][INFO] - loss : 0.22232582383975288 | |
| [2024-07-03 19:41:07,972][__main__][INFO] - Epoch 11 with learning rate [0.0001] | |
| [2024-07-03 20:30:09,455][__main__][INFO] - loss : 0.21964246877282817 | |
| [2024-07-03 20:31:25,035][__main__][INFO] - Epoch 12 with learning rate [0.0001] | |
| [2024-07-03 21:20:43,221][__main__][INFO] - loss : 0.2171587786823514 | |
| [2024-07-03 21:21:57,622][__main__][INFO] - Epoch 13 with learning rate [0.0001] | |
| [2024-07-03 22:11:03,129][__main__][INFO] - loss : 0.21505841370920434 | |
| [2024-07-03 22:12:18,852][__main__][INFO] - Epoch 14 with learning rate [0.0001] | |
| [2024-07-03 23:01:41,662][__main__][INFO] - loss : 0.21256804884100924 | |
| [2024-07-03 23:02:56,623][__main__][INFO] - Epoch 15 with learning rate [0.0001] | |
| [2024-07-03 23:52:14,667][__main__][INFO] - loss : 0.21101288639878216 | |
| [2024-07-03 23:53:30,340][__main__][INFO] - Epoch 16 with learning rate [0.0001] | |
| [2024-07-04 00:42:52,277][__main__][INFO] - loss : 0.20856485366821287 | |
| [2024-07-04 00:44:07,814][__main__][INFO] - Epoch 17 with learning rate [0.0001] | |
| [2024-07-04 01:33:26,027][__main__][INFO] - loss : 0.20685569836571793 | |
| [2024-07-04 01:34:41,114][__main__][INFO] - Epoch 18 with learning rate [0.0001] | |
| [2024-07-04 02:23:57,784][__main__][INFO] - loss : 0.20563763129090235 | |
| [2024-07-04 02:25:13,162][__main__][INFO] - Epoch 19 with learning rate [0.0001] | |
| [2024-07-04 03:14:31,385][__main__][INFO] - loss : 0.20367287252843422 | |
| [2024-07-04 03:15:45,507][__main__][INFO] - Epoch 20 with learning rate [0.0001] | |
| [2024-07-04 04:04:56,572][__main__][INFO] - loss : 0.20284826010217294 | |
| [2024-07-04 04:06:11,560][__main__][INFO] - Epoch 21 with learning rate [0.0001] | |
| [2024-07-04 04:55:31,328][__main__][INFO] - loss : 0.2014715137742463 | |
| [2024-07-04 04:56:46,524][__main__][INFO] - Epoch 22 with learning rate [0.0001] | |
| [2024-07-04 05:45:59,110][__main__][INFO] - loss : 0.19999060107643404 | |
| [2024-07-04 05:47:13,927][__main__][INFO] - Epoch 23 with learning rate [0.0001] | |
| [2024-07-04 06:36:30,374][__main__][INFO] - loss : 0.19883501069123546 | |
| [2024-07-04 06:37:46,483][__main__][INFO] - Epoch 24 with learning rate [0.0001] | |
| [2024-07-04 07:26:51,707][__main__][INFO] - loss : 0.19798426587755466 | |
| [2024-07-04 07:28:07,779][__main__][INFO] - Train time [hour] : 21.22163891924752 h | |
| [2024-07-04 07:28:07,779][__main__][INFO] - Results saved in /root/LenslessPiCam/outputs/2024-07-03/10-14-31 | |