Training in progress, step 1000
Browse files- runs/May24_20-48-13_890e8b3ca76b/events.out.tfevents.1716583720.890e8b3ca76b.34.5 +2 -2
- wandb/debug-internal.log +260 -0
- wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json +1 -1
- wandb/run-20240524_202737-n1w0kmmv/logs/debug-internal.log +260 -0
- wandb/run-20240524_202737-n1w0kmmv/run-n1w0kmmv.wandb +0 -0
runs/May24_20-48-13_890e8b3ca76b/events.out.tfevents.1716583720.890e8b3ca76b.34.5
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3b052e679d19e753ecddf09ce22af3b664c712683ca47651d499ea3a38810696
|
| 3 |
+
size 19817
|
wandb/debug-internal.log
CHANGED
|
@@ -2231,3 +2231,263 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 2231 |
2024-05-24 21:03:31,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2232 |
2024-05-24 21:03:32,262 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/config.yaml
|
| 2233 |
2024-05-24 21:03:37,080 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2231 |
2024-05-24 21:03:31,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2232 |
2024-05-24 21:03:32,262 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/config.yaml
|
| 2233 |
2024-05-24 21:03:37,080 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2234 |
+
2024-05-24 21:03:42,081 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2235 |
+
2024-05-24 21:03:45,762 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2236 |
+
2024-05-24 21:03:45,762 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2237 |
+
2024-05-24 21:03:45,802 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2238 |
+
2024-05-24 21:03:47,878 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2239 |
+
2024-05-24 21:03:52,130 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2240 |
+
2024-05-24 21:03:53,131 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2241 |
+
2024-05-24 21:03:58,132 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2242 |
+
2024-05-24 21:04:01,056 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2243 |
+
2024-05-24 21:04:01,057 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2244 |
+
2024-05-24 21:04:01,097 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2245 |
+
2024-05-24 21:04:03,187 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2246 |
+
2024-05-24 21:04:08,188 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2247 |
+
2024-05-24 21:04:13,189 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2248 |
+
2024-05-24 21:04:16,396 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2249 |
+
2024-05-24 21:04:16,396 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2250 |
+
2024-05-24 21:04:16,436 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2251 |
+
2024-05-24 21:04:18,564 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2252 |
+
2024-05-24 21:04:22,131 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2253 |
+
2024-05-24 21:04:24,132 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2254 |
+
2024-05-24 21:04:29,133 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2255 |
+
2024-05-24 21:04:31,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2256 |
+
2024-05-24 21:04:31,343 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2257 |
+
2024-05-24 21:04:31,383 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2258 |
+
2024-05-24 21:04:34,416 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2259 |
+
2024-05-24 21:04:39,417 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2260 |
+
2024-05-24 21:04:44,418 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2261 |
+
2024-05-24 21:04:46,341 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2262 |
+
2024-05-24 21:04:46,341 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2263 |
+
2024-05-24 21:04:46,381 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2264 |
+
2024-05-24 21:04:49,499 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2265 |
+
2024-05-24 21:04:52,132 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2266 |
+
2024-05-24 21:04:55,133 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2267 |
+
2024-05-24 21:05:00,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2268 |
+
2024-05-24 21:05:01,892 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2269 |
+
2024-05-24 21:05:01,893 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2270 |
+
2024-05-24 21:05:01,894 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2271 |
+
2024-05-24 21:05:05,970 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2272 |
+
2024-05-24 21:05:10,972 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2273 |
+
2024-05-24 21:05:15,973 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2274 |
+
2024-05-24 21:05:16,818 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2275 |
+
2024-05-24 21:05:16,818 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2276 |
+
2024-05-24 21:05:16,828 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2277 |
+
2024-05-24 21:05:21,903 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2278 |
+
2024-05-24 21:05:22,133 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2279 |
+
2024-05-24 21:05:27,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2280 |
+
2024-05-24 21:05:32,042 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2281 |
+
2024-05-24 21:05:32,043 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2282 |
+
2024-05-24 21:05:32,045 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2283 |
+
2024-05-24 21:05:32,150 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2284 |
+
2024-05-24 21:05:37,151 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2285 |
+
2024-05-24 21:05:42,152 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2286 |
+
2024-05-24 21:05:46,997 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2287 |
+
2024-05-24 21:05:46,997 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2288 |
+
2024-05-24 21:05:47,037 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2289 |
+
2024-05-24 21:05:48,112 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2290 |
+
2024-05-24 21:05:52,133 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2291 |
+
2024-05-24 21:05:53,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2292 |
+
2024-05-24 21:05:58,135 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2293 |
+
2024-05-24 21:06:02,395 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2294 |
+
2024-05-24 21:06:02,396 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2295 |
+
2024-05-24 21:06:02,436 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2296 |
+
2024-05-24 21:06:03,516 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2297 |
+
2024-05-24 21:06:08,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2298 |
+
2024-05-24 21:06:13,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2299 |
+
2024-05-24 21:06:17,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2300 |
+
2024-05-24 21:06:17,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2301 |
+
2024-05-24 21:06:17,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2302 |
+
2024-05-24 21:06:19,489 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2303 |
+
2024-05-24 21:06:22,134 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2304 |
+
2024-05-24 21:06:25,135 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2305 |
+
2024-05-24 21:06:30,136 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2306 |
+
2024-05-24 21:06:32,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2307 |
+
2024-05-24 21:06:32,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2308 |
+
2024-05-24 21:06:32,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2309 |
+
2024-05-24 21:06:35,483 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2310 |
+
2024-05-24 21:06:40,484 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2311 |
+
2024-05-24 21:06:45,485 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2312 |
+
2024-05-24 21:06:47,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2313 |
+
2024-05-24 21:06:47,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2314 |
+
2024-05-24 21:06:47,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2315 |
+
2024-05-24 21:06:50,519 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2316 |
+
2024-05-24 21:06:52,135 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2317 |
+
2024-05-24 21:06:56,136 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2318 |
+
2024-05-24 21:07:01,137 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2319 |
+
2024-05-24 21:07:02,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2320 |
+
2024-05-24 21:07:02,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2321 |
+
2024-05-24 21:07:02,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2322 |
+
2024-05-24 21:07:06,515 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2323 |
+
2024-05-24 21:07:11,516 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2324 |
+
2024-05-24 21:07:16,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2325 |
+
2024-05-24 21:07:17,610 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2326 |
+
2024-05-24 21:07:17,612 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2327 |
+
2024-05-24 21:07:17,612 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2328 |
+
2024-05-24 21:07:21,718 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2329 |
+
2024-05-24 21:07:22,136 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2330 |
+
2024-05-24 21:07:27,137 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2331 |
+
2024-05-24 21:07:32,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2332 |
+
2024-05-24 21:07:32,802 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2333 |
+
2024-05-24 21:07:32,803 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2334 |
+
2024-05-24 21:07:32,804 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2335 |
+
2024-05-24 21:07:37,961 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2336 |
+
2024-05-24 21:07:42,962 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2337 |
+
2024-05-24 21:07:47,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2338 |
+
2024-05-24 21:07:47,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2339 |
+
2024-05-24 21:07:47,765 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2340 |
+
2024-05-24 21:07:48,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2341 |
+
2024-05-24 21:07:52,137 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2342 |
+
2024-05-24 21:07:54,138 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2343 |
+
2024-05-24 21:07:59,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2344 |
+
2024-05-24 21:08:02,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2345 |
+
2024-05-24 21:08:02,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2346 |
+
2024-05-24 21:08:02,765 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2347 |
+
2024-05-24 21:08:04,916 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2348 |
+
2024-05-24 21:08:09,917 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2349 |
+
2024-05-24 21:08:14,919 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2350 |
+
2024-05-24 21:08:17,763 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2351 |
+
2024-05-24 21:08:17,764 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2352 |
+
2024-05-24 21:08:17,803 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2353 |
+
2024-05-24 21:08:20,848 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2354 |
+
2024-05-24 21:08:22,138 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2355 |
+
2024-05-24 21:08:26,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2356 |
+
2024-05-24 21:08:31,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2357 |
+
2024-05-24 21:08:32,844 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2358 |
+
2024-05-24 21:08:32,844 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2359 |
+
2024-05-24 21:08:32,845 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2360 |
+
2024-05-24 21:08:37,018 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2361 |
+
2024-05-24 21:08:42,019 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2362 |
+
2024-05-24 21:08:47,021 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2363 |
+
2024-05-24 21:08:47,788 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2364 |
+
2024-05-24 21:08:47,819 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2365 |
+
2024-05-24 21:08:47,819 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2366 |
+
2024-05-24 21:08:52,139 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2367 |
+
2024-05-24 21:08:52,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2368 |
+
2024-05-24 21:08:57,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2369 |
+
2024-05-24 21:09:02,141 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2370 |
+
2024-05-24 21:09:02,788 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2371 |
+
2024-05-24 21:09:02,819 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2372 |
+
2024-05-24 21:09:02,820 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2373 |
+
2024-05-24 21:09:07,934 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2374 |
+
2024-05-24 21:09:12,935 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2375 |
+
2024-05-24 21:09:17,793 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2376 |
+
2024-05-24 21:09:17,820 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2377 |
+
2024-05-24 21:09:17,821 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2378 |
+
2024-05-24 21:09:17,943 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2379 |
+
2024-05-24 21:09:22,140 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2380 |
+
2024-05-24 21:09:23,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2381 |
+
2024-05-24 21:09:28,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2382 |
+
2024-05-24 21:09:32,792 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2383 |
+
2024-05-24 21:09:32,820 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2384 |
+
2024-05-24 21:09:32,820 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2385 |
+
2024-05-24 21:09:33,916 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2386 |
+
2024-05-24 21:09:38,917 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2387 |
+
2024-05-24 21:09:43,918 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2388 |
+
2024-05-24 21:09:47,910 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2389 |
+
2024-05-24 21:09:47,911 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2390 |
+
2024-05-24 21:09:47,915 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2391 |
+
2024-05-24 21:09:49,018 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2392 |
+
2024-05-24 21:09:52,141 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2393 |
+
2024-05-24 21:09:54,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2394 |
+
2024-05-24 21:09:59,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2395 |
+
2024-05-24 21:10:03,315 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2396 |
+
2024-05-24 21:10:03,315 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2397 |
+
2024-05-24 21:10:03,355 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2398 |
+
2024-05-24 21:10:04,448 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2399 |
+
2024-05-24 21:10:09,449 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2400 |
+
2024-05-24 21:10:14,450 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2401 |
+
2024-05-24 21:10:18,525 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2402 |
+
2024-05-24 21:10:18,526 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2403 |
+
2024-05-24 21:10:18,527 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2404 |
+
2024-05-24 21:10:19,619 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2405 |
+
2024-05-24 21:10:22,141 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2406 |
+
2024-05-24 21:10:25,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2407 |
+
2024-05-24 21:10:30,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2408 |
+
2024-05-24 21:10:34,057 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2409 |
+
2024-05-24 21:10:34,058 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2410 |
+
2024-05-24 21:10:34,059 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2411 |
+
2024-05-24 21:10:35,218 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2412 |
+
2024-05-24 21:10:40,220 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2413 |
+
2024-05-24 21:10:45,221 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2414 |
+
2024-05-24 21:10:49,682 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2415 |
+
2024-05-24 21:10:49,683 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2416 |
+
2024-05-24 21:10:49,683 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2417 |
+
2024-05-24 21:10:50,871 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2418 |
+
2024-05-24 21:10:52,142 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2419 |
+
2024-05-24 21:10:56,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2420 |
+
2024-05-24 21:11:01,144 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2421 |
+
2024-05-24 21:11:04,606 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2422 |
+
2024-05-24 21:11:04,631 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2423 |
+
2024-05-24 21:11:04,632 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2424 |
+
2024-05-24 21:11:06,806 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2425 |
+
2024-05-24 21:11:11,807 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2426 |
+
2024-05-24 21:11:16,808 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2427 |
+
2024-05-24 21:11:19,606 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2428 |
+
2024-05-24 21:11:19,631 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2429 |
+
2024-05-24 21:11:19,632 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2430 |
+
2024-05-24 21:11:22,143 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2431 |
+
2024-05-24 21:11:22,144 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2432 |
+
2024-05-24 21:11:27,145 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2433 |
+
2024-05-24 21:11:32,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2434 |
+
2024-05-24 21:11:34,919 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2435 |
+
2024-05-24 21:11:34,920 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2436 |
+
2024-05-24 21:11:34,960 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2437 |
+
2024-05-24 21:11:38,045 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2438 |
+
2024-05-24 21:11:43,046 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2439 |
+
2024-05-24 21:11:48,047 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2440 |
+
2024-05-24 21:11:49,883 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2441 |
+
2024-05-24 21:11:49,884 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2442 |
+
2024-05-24 21:11:49,923 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2443 |
+
2024-05-24 21:11:52,144 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2444 |
+
2024-05-24 21:11:53,145 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2445 |
+
2024-05-24 21:11:58,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2446 |
+
2024-05-24 21:12:03,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2447 |
+
2024-05-24 21:12:05,401 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2448 |
+
2024-05-24 21:12:05,402 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2449 |
+
2024-05-24 21:12:05,402 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2450 |
+
2024-05-24 21:12:08,553 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2451 |
+
2024-05-24 21:12:13,554 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2452 |
+
2024-05-24 21:12:18,555 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2453 |
+
2024-05-24 21:12:20,325 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2454 |
+
2024-05-24 21:12:20,326 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2455 |
+
2024-05-24 21:12:20,366 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2456 |
+
2024-05-24 21:12:22,145 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2457 |
+
2024-05-24 21:12:24,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2458 |
+
2024-05-24 21:12:29,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2459 |
+
2024-05-24 21:12:34,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2460 |
+
2024-05-24 21:12:35,324 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2461 |
+
2024-05-24 21:12:35,325 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2462 |
+
2024-05-24 21:12:35,365 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2463 |
+
2024-05-24 21:12:39,487 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2464 |
+
2024-05-24 21:12:44,488 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2465 |
+
2024-05-24 21:12:49,489 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2466 |
+
2024-05-24 21:12:50,861 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2467 |
+
2024-05-24 21:12:50,862 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2468 |
+
2024-05-24 21:12:50,863 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2469 |
+
2024-05-24 21:12:52,146 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2470 |
+
2024-05-24 21:12:55,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2471 |
+
2024-05-24 21:13:00,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2472 |
+
2024-05-24 21:13:05,149 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2473 |
+
2024-05-24 21:13:05,811 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2474 |
+
2024-05-24 21:13:05,812 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2475 |
+
2024-05-24 21:13:05,851 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2476 |
+
2024-05-24 21:13:10,937 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2477 |
+
2024-05-24 21:13:11,231 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: partial_history
|
| 2478 |
+
2024-05-24 21:13:11,232 DEBUG SenderThread:1201 [sender.py:send():379] send: history
|
| 2479 |
+
2024-05-24 21:13:11,232 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: summary_record
|
| 2480 |
+
2024-05-24 21:13:11,233 INFO SenderThread:1201 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
|
| 2481 |
+
2024-05-24 21:13:11,486 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json
|
| 2482 |
+
2024-05-24 21:13:16,234 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2483 |
+
2024-05-24 21:13:20,903 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2484 |
+
2024-05-24 21:13:20,903 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2485 |
+
2024-05-24 21:13:20,943 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2486 |
+
2024-05-24 21:13:21,249 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: partial_history
|
| 2487 |
+
2024-05-24 21:13:21,250 DEBUG SenderThread:1201 [sender.py:send():379] send: history
|
| 2488 |
+
2024-05-24 21:13:21,251 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: summary_record
|
| 2489 |
+
2024-05-24 21:13:21,251 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2490 |
+
2024-05-24 21:13:21,252 INFO SenderThread:1201 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
|
| 2491 |
+
2024-05-24 21:13:21,490 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json
|
| 2492 |
+
2024-05-24 21:13:22,147 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2493 |
+
2024-05-24 21:13:27,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"train/loss":
|
|
|
|
| 1 |
+
{"train/loss": 0.0, "train/grad_norm": NaN, "train/learning_rate": 3.6e-06, "train/epoch": 22.73, "train/global_step": 1000, "_timestamp": 1716585201.2488916, "_runtime": 2743.8254675865173, "_step": 3, "eval/loss": NaN, "eval/wer": 0.9984338292873923, "eval/runtime": 10.0143, "eval/samples_per_second": 19.971, "eval/steps_per_second": 2.496}
|
wandb/run-20240524_202737-n1w0kmmv/logs/debug-internal.log
CHANGED
|
@@ -2231,3 +2231,263 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
|
|
| 2231 |
2024-05-24 21:03:31,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2232 |
2024-05-24 21:03:32,262 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/config.yaml
|
| 2233 |
2024-05-24 21:03:37,080 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2231 |
2024-05-24 21:03:31,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2232 |
2024-05-24 21:03:32,262 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/config.yaml
|
| 2233 |
2024-05-24 21:03:37,080 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2234 |
+
2024-05-24 21:03:42,081 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2235 |
+
2024-05-24 21:03:45,762 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2236 |
+
2024-05-24 21:03:45,762 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2237 |
+
2024-05-24 21:03:45,802 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2238 |
+
2024-05-24 21:03:47,878 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2239 |
+
2024-05-24 21:03:52,130 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2240 |
+
2024-05-24 21:03:53,131 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2241 |
+
2024-05-24 21:03:58,132 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2242 |
+
2024-05-24 21:04:01,056 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2243 |
+
2024-05-24 21:04:01,057 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2244 |
+
2024-05-24 21:04:01,097 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2245 |
+
2024-05-24 21:04:03,187 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2246 |
+
2024-05-24 21:04:08,188 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2247 |
+
2024-05-24 21:04:13,189 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2248 |
+
2024-05-24 21:04:16,396 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2249 |
+
2024-05-24 21:04:16,396 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2250 |
+
2024-05-24 21:04:16,436 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2251 |
+
2024-05-24 21:04:18,564 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2252 |
+
2024-05-24 21:04:22,131 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2253 |
+
2024-05-24 21:04:24,132 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2254 |
+
2024-05-24 21:04:29,133 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2255 |
+
2024-05-24 21:04:31,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2256 |
+
2024-05-24 21:04:31,343 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2257 |
+
2024-05-24 21:04:31,383 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2258 |
+
2024-05-24 21:04:34,416 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2259 |
+
2024-05-24 21:04:39,417 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2260 |
+
2024-05-24 21:04:44,418 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2261 |
+
2024-05-24 21:04:46,341 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2262 |
+
2024-05-24 21:04:46,341 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2263 |
+
2024-05-24 21:04:46,381 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2264 |
+
2024-05-24 21:04:49,499 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2265 |
+
2024-05-24 21:04:52,132 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2266 |
+
2024-05-24 21:04:55,133 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2267 |
+
2024-05-24 21:05:00,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2268 |
+
2024-05-24 21:05:01,892 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2269 |
+
2024-05-24 21:05:01,893 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2270 |
+
2024-05-24 21:05:01,894 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2271 |
+
2024-05-24 21:05:05,970 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2272 |
+
2024-05-24 21:05:10,972 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2273 |
+
2024-05-24 21:05:15,973 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2274 |
+
2024-05-24 21:05:16,818 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2275 |
+
2024-05-24 21:05:16,818 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2276 |
+
2024-05-24 21:05:16,828 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2277 |
+
2024-05-24 21:05:21,903 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2278 |
+
2024-05-24 21:05:22,133 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2279 |
+
2024-05-24 21:05:27,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2280 |
+
2024-05-24 21:05:32,042 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2281 |
+
2024-05-24 21:05:32,043 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2282 |
+
2024-05-24 21:05:32,045 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2283 |
+
2024-05-24 21:05:32,150 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2284 |
+
2024-05-24 21:05:37,151 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2285 |
+
2024-05-24 21:05:42,152 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2286 |
+
2024-05-24 21:05:46,997 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2287 |
+
2024-05-24 21:05:46,997 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2288 |
+
2024-05-24 21:05:47,037 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2289 |
+
2024-05-24 21:05:48,112 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2290 |
+
2024-05-24 21:05:52,133 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2291 |
+
2024-05-24 21:05:53,134 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2292 |
+
2024-05-24 21:05:58,135 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2293 |
+
2024-05-24 21:06:02,395 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2294 |
+
2024-05-24 21:06:02,396 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2295 |
+
2024-05-24 21:06:02,436 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2296 |
+
2024-05-24 21:06:03,516 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2297 |
+
2024-05-24 21:06:08,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2298 |
+
2024-05-24 21:06:13,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2299 |
+
2024-05-24 21:06:17,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2300 |
+
2024-05-24 21:06:17,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2301 |
+
2024-05-24 21:06:17,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2302 |
+
2024-05-24 21:06:19,489 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2303 |
+
2024-05-24 21:06:22,134 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2304 |
+
2024-05-24 21:06:25,135 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2305 |
+
2024-05-24 21:06:30,136 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2306 |
+
2024-05-24 21:06:32,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2307 |
+
2024-05-24 21:06:32,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2308 |
+
2024-05-24 21:06:32,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2309 |
+
2024-05-24 21:06:35,483 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2310 |
+
2024-05-24 21:06:40,484 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2311 |
+
2024-05-24 21:06:45,485 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2312 |
+
2024-05-24 21:06:47,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2313 |
+
2024-05-24 21:06:47,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2314 |
+
2024-05-24 21:06:47,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2315 |
+
2024-05-24 21:06:50,519 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2316 |
+
2024-05-24 21:06:52,135 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2317 |
+
2024-05-24 21:06:56,136 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2318 |
+
2024-05-24 21:07:01,137 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2319 |
+
2024-05-24 21:07:02,342 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2320 |
+
2024-05-24 21:07:02,342 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2321 |
+
2024-05-24 21:07:02,382 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2322 |
+
2024-05-24 21:07:06,515 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2323 |
+
2024-05-24 21:07:11,516 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2324 |
+
2024-05-24 21:07:16,517 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2325 |
+
2024-05-24 21:07:17,610 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2326 |
+
2024-05-24 21:07:17,612 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2327 |
+
2024-05-24 21:07:17,612 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2328 |
+
2024-05-24 21:07:21,718 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2329 |
+
2024-05-24 21:07:22,136 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2330 |
+
2024-05-24 21:07:27,137 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2331 |
+
2024-05-24 21:07:32,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2332 |
+
2024-05-24 21:07:32,802 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2333 |
+
2024-05-24 21:07:32,803 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2334 |
+
2024-05-24 21:07:32,804 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2335 |
+
2024-05-24 21:07:37,961 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2336 |
+
2024-05-24 21:07:42,962 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2337 |
+
2024-05-24 21:07:47,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2338 |
+
2024-05-24 21:07:47,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2339 |
+
2024-05-24 21:07:47,765 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2340 |
+
2024-05-24 21:07:48,920 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2341 |
+
2024-05-24 21:07:52,137 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2342 |
+
2024-05-24 21:07:54,138 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2343 |
+
2024-05-24 21:07:59,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2344 |
+
2024-05-24 21:08:02,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2345 |
+
2024-05-24 21:08:02,764 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2346 |
+
2024-05-24 21:08:02,765 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2347 |
+
2024-05-24 21:08:04,916 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2348 |
+
2024-05-24 21:08:09,917 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2349 |
+
2024-05-24 21:08:14,919 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2350 |
+
2024-05-24 21:08:17,763 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2351 |
+
2024-05-24 21:08:17,764 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2352 |
+
2024-05-24 21:08:17,803 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2353 |
+
2024-05-24 21:08:20,848 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2354 |
+
2024-05-24 21:08:22,138 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2355 |
+
2024-05-24 21:08:26,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2356 |
+
2024-05-24 21:08:31,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2357 |
+
2024-05-24 21:08:32,844 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2358 |
+
2024-05-24 21:08:32,844 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2359 |
+
2024-05-24 21:08:32,845 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2360 |
+
2024-05-24 21:08:37,018 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2361 |
+
2024-05-24 21:08:42,019 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2362 |
+
2024-05-24 21:08:47,021 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2363 |
+
2024-05-24 21:08:47,788 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2364 |
+
2024-05-24 21:08:47,819 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2365 |
+
2024-05-24 21:08:47,819 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2366 |
+
2024-05-24 21:08:52,139 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2367 |
+
2024-05-24 21:08:52,139 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2368 |
+
2024-05-24 21:08:57,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2369 |
+
2024-05-24 21:09:02,141 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2370 |
+
2024-05-24 21:09:02,788 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2371 |
+
2024-05-24 21:09:02,819 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2372 |
+
2024-05-24 21:09:02,820 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2373 |
+
2024-05-24 21:09:07,934 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2374 |
+
2024-05-24 21:09:12,935 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2375 |
+
2024-05-24 21:09:17,793 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2376 |
+
2024-05-24 21:09:17,820 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2377 |
+
2024-05-24 21:09:17,821 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2378 |
+
2024-05-24 21:09:17,943 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2379 |
+
2024-05-24 21:09:22,140 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2380 |
+
2024-05-24 21:09:23,140 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2381 |
+
2024-05-24 21:09:28,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2382 |
+
2024-05-24 21:09:32,792 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2383 |
+
2024-05-24 21:09:32,820 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2384 |
+
2024-05-24 21:09:32,820 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2385 |
+
2024-05-24 21:09:33,916 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2386 |
+
2024-05-24 21:09:38,917 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2387 |
+
2024-05-24 21:09:43,918 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2388 |
+
2024-05-24 21:09:47,910 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2389 |
+
2024-05-24 21:09:47,911 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2390 |
+
2024-05-24 21:09:47,915 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2391 |
+
2024-05-24 21:09:49,018 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2392 |
+
2024-05-24 21:09:52,141 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2393 |
+
2024-05-24 21:09:54,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2394 |
+
2024-05-24 21:09:59,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2395 |
+
2024-05-24 21:10:03,315 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2396 |
+
2024-05-24 21:10:03,315 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2397 |
+
2024-05-24 21:10:03,355 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2398 |
+
2024-05-24 21:10:04,448 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2399 |
+
2024-05-24 21:10:09,449 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2400 |
+
2024-05-24 21:10:14,450 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2401 |
+
2024-05-24 21:10:18,525 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2402 |
+
2024-05-24 21:10:18,526 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2403 |
+
2024-05-24 21:10:18,527 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2404 |
+
2024-05-24 21:10:19,619 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2405 |
+
2024-05-24 21:10:22,141 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2406 |
+
2024-05-24 21:10:25,142 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2407 |
+
2024-05-24 21:10:30,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2408 |
+
2024-05-24 21:10:34,057 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2409 |
+
2024-05-24 21:10:34,058 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2410 |
+
2024-05-24 21:10:34,059 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2411 |
+
2024-05-24 21:10:35,218 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2412 |
+
2024-05-24 21:10:40,220 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2413 |
+
2024-05-24 21:10:45,221 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2414 |
+
2024-05-24 21:10:49,682 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2415 |
+
2024-05-24 21:10:49,683 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2416 |
+
2024-05-24 21:10:49,683 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2417 |
+
2024-05-24 21:10:50,871 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2418 |
+
2024-05-24 21:10:52,142 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2419 |
+
2024-05-24 21:10:56,143 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2420 |
+
2024-05-24 21:11:01,144 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2421 |
+
2024-05-24 21:11:04,606 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2422 |
+
2024-05-24 21:11:04,631 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2423 |
+
2024-05-24 21:11:04,632 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2424 |
+
2024-05-24 21:11:06,806 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2425 |
+
2024-05-24 21:11:11,807 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2426 |
+
2024-05-24 21:11:16,808 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2427 |
+
2024-05-24 21:11:19,606 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2428 |
+
2024-05-24 21:11:19,631 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2429 |
+
2024-05-24 21:11:19,632 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2430 |
+
2024-05-24 21:11:22,143 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2431 |
+
2024-05-24 21:11:22,144 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2432 |
+
2024-05-24 21:11:27,145 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2433 |
+
2024-05-24 21:11:32,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2434 |
+
2024-05-24 21:11:34,919 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2435 |
+
2024-05-24 21:11:34,920 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2436 |
+
2024-05-24 21:11:34,960 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2437 |
+
2024-05-24 21:11:38,045 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2438 |
+
2024-05-24 21:11:43,046 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2439 |
+
2024-05-24 21:11:48,047 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2440 |
+
2024-05-24 21:11:49,883 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2441 |
+
2024-05-24 21:11:49,884 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2442 |
+
2024-05-24 21:11:49,923 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2443 |
+
2024-05-24 21:11:52,144 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2444 |
+
2024-05-24 21:11:53,145 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2445 |
+
2024-05-24 21:11:58,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2446 |
+
2024-05-24 21:12:03,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2447 |
+
2024-05-24 21:12:05,401 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2448 |
+
2024-05-24 21:12:05,402 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2449 |
+
2024-05-24 21:12:05,402 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2450 |
+
2024-05-24 21:12:08,553 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2451 |
+
2024-05-24 21:12:13,554 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2452 |
+
2024-05-24 21:12:18,555 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2453 |
+
2024-05-24 21:12:20,325 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2454 |
+
2024-05-24 21:12:20,326 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2455 |
+
2024-05-24 21:12:20,366 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2456 |
+
2024-05-24 21:12:22,145 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2457 |
+
2024-05-24 21:12:24,146 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2458 |
+
2024-05-24 21:12:29,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2459 |
+
2024-05-24 21:12:34,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2460 |
+
2024-05-24 21:12:35,324 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2461 |
+
2024-05-24 21:12:35,325 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2462 |
+
2024-05-24 21:12:35,365 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2463 |
+
2024-05-24 21:12:39,487 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2464 |
+
2024-05-24 21:12:44,488 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2465 |
+
2024-05-24 21:12:49,489 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2466 |
+
2024-05-24 21:12:50,861 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2467 |
+
2024-05-24 21:12:50,862 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2468 |
+
2024-05-24 21:12:50,863 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2469 |
+
2024-05-24 21:12:52,146 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2470 |
+
2024-05-24 21:12:55,147 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2471 |
+
2024-05-24 21:13:00,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2472 |
+
2024-05-24 21:13:05,149 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2473 |
+
2024-05-24 21:13:05,811 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2474 |
+
2024-05-24 21:13:05,812 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2475 |
+
2024-05-24 21:13:05,851 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2476 |
+
2024-05-24 21:13:10,937 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2477 |
+
2024-05-24 21:13:11,231 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: partial_history
|
| 2478 |
+
2024-05-24 21:13:11,232 DEBUG SenderThread:1201 [sender.py:send():379] send: history
|
| 2479 |
+
2024-05-24 21:13:11,232 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: summary_record
|
| 2480 |
+
2024-05-24 21:13:11,233 INFO SenderThread:1201 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
|
| 2481 |
+
2024-05-24 21:13:11,486 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json
|
| 2482 |
+
2024-05-24 21:13:16,234 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2483 |
+
2024-05-24 21:13:20,903 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: stop_status
|
| 2484 |
+
2024-05-24 21:13:20,903 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: stop_status
|
| 2485 |
+
2024-05-24 21:13:20,943 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: internal_messages
|
| 2486 |
+
2024-05-24 21:13:21,249 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: partial_history
|
| 2487 |
+
2024-05-24 21:13:21,250 DEBUG SenderThread:1201 [sender.py:send():379] send: history
|
| 2488 |
+
2024-05-24 21:13:21,251 DEBUG SenderThread:1201 [sender.py:send_request():406] send_request: summary_record
|
| 2489 |
+
2024-05-24 21:13:21,251 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
| 2490 |
+
2024-05-24 21:13:21,252 INFO SenderThread:1201 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
|
| 2491 |
+
2024-05-24 21:13:21,490 INFO Thread-12 :1201 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240524_202737-n1w0kmmv/files/wandb-summary.json
|
| 2492 |
+
2024-05-24 21:13:22,147 DEBUG SenderThread:1201 [sender.py:send():379] send: stats
|
| 2493 |
+
2024-05-24 21:13:27,148 DEBUG HandlerThread:1201 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240524_202737-n1w0kmmv/run-n1w0kmmv.wandb
CHANGED
|
Binary files a/wandb/run-20240524_202737-n1w0kmmv/run-n1w0kmmv.wandb and b/wandb/run-20240524_202737-n1w0kmmv/run-n1w0kmmv.wandb differ
|
|
|