| 2023-12-26 17:43:26,500 INFO StreamThr :99 [internal.py:wandb_internal():86] W&B internal server running at pid: 99, started at: 2023-12-26 17:43:26.499927 | |
| 2023-12-26 17:43:26,502 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status | |
| 2023-12-26 17:43:27,886 INFO WriterThread:99 [datastore.py:open_for_write():85] open: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/run-ci9t5w07.wandb | |
| 2023-12-26 17:43:27,887 DEBUG SenderThread:99 [sender.py:send():382] send: header | |
| 2023-12-26 17:43:27,890 DEBUG SenderThread:99 [sender.py:send():382] send: run | |
| 2023-12-26 17:43:28,375 INFO SenderThread:99 [dir_watcher.py:__init__():211] watching files in: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files | |
| 2023-12-26 17:43:28,376 INFO SenderThread:99 [sender.py:_start_run_threads():1136] run started: ci9t5w07 with start time 1703612606.500992 | |
| 2023-12-26 17:43:28,384 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: check_version | |
| 2023-12-26 17:43:28,384 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: check_version | |
| 2023-12-26 17:43:28,468 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: run_start | |
| 2023-12-26 17:43:28,472 DEBUG HandlerThread:99 [system_info.py:__init__():32] System info init | |
| 2023-12-26 17:43:28,472 DEBUG HandlerThread:99 [system_info.py:__init__():47] System info init done | |
| 2023-12-26 17:43:28,472 INFO HandlerThread:99 [system_monitor.py:start():194] Starting system monitor | |
| 2023-12-26 17:43:28,472 INFO SystemMonitor:99 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2023-12-26 17:43:28,473 INFO HandlerThread:99 [system_monitor.py:probe():214] Collecting system info | |
| 2023-12-26 17:43:28,473 INFO SystemMonitor:99 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-12-26 17:43:28,474 INFO SystemMonitor:99 [interfaces.py:start():190] Started disk monitoring | |
| 2023-12-26 17:43:28,474 INFO SystemMonitor:99 [interfaces.py:start():190] Started gpu monitoring | |
| 2023-12-26 17:43:28,476 INFO SystemMonitor:99 [interfaces.py:start():190] Started memory monitoring | |
| 2023-12-26 17:43:28,477 INFO SystemMonitor:99 [interfaces.py:start():190] Started network monitoring | |
| 2023-12-26 17:43:28,482 DEBUG HandlerThread:99 [system_info.py:probe():196] Probing system | |
| 2023-12-26 17:43:28,485 DEBUG HandlerThread:99 [gitlib.py:_init_repo():56] git repository is invalid | |
| 2023-12-26 17:43:28,485 DEBUG HandlerThread:99 [system_info.py:probe():244] Probing system done | |
| 2023-12-26 17:43:28,486 DEBUG HandlerThread:99 [system_monitor.py:probe():223] {'os': 'Linux-5.15.133+-x86_64-with-glibc2.35', 'python': '3.10.12', 'heartbeatAt': '2023-12-26T17:43:28.482306', 'startedAt': '2023-12-26T17:43:26.494008', 'docker': None, 'cuda': None, 'args': (), 'state': 'running', 'program': 'kaggle.ipynb', 'codePathLocal': None, 'root': '/kaggle/working', 'host': 'bee8f6c649ae', 'username': 'root', 'executable': '/opt/conda/bin/python3.10', 'cpu_count': 2, 'cpu_count_logical': 4, 'cpu_freq': {'current': 2000.146, 'min': 0.0, 'max': 0.0}, 'cpu_freq_per_core': [{'current': 2000.146, 'min': 0.0, 'max': 0.0}, {'current': 2000.146, 'min': 0.0, 'max': 0.0}, {'current': 2000.146, 'min': 0.0, 'max': 0.0}, {'current': 2000.146, 'min': 0.0, 'max': 0.0}], 'disk': {'/': {'total': 8062.387607574463, 'used': 5311.076290130615}}, 'gpu': 'Tesla P100-PCIE-16GB', 'gpu_count': 1, 'gpu_devices': [{'name': 'Tesla P100-PCIE-16GB', 'memory_total': 17071734784}], 'memory': {'total': 31.357559204101562}} | |
| 2023-12-26 17:43:28,486 INFO HandlerThread:99 [system_monitor.py:probe():224] Finished collecting system info | |
| 2023-12-26 17:43:28,486 INFO HandlerThread:99 [system_monitor.py:probe():227] Publishing system info | |
| 2023-12-26 17:43:28,486 DEBUG HandlerThread:99 [system_info.py:_save_pip():52] Saving list of pip packages installed into the current environment | |
| 2023-12-26 17:43:28,487 DEBUG HandlerThread:99 [system_info.py:_save_pip():68] Saving pip packages done | |
| 2023-12-26 17:43:28,487 DEBUG HandlerThread:99 [system_info.py:_save_conda():75] Saving list of conda packages installed into the current environment | |
| 2023-12-26 17:43:29,377 INFO Thread-12 :99 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/requirements.txt | |
| 2023-12-26 17:43:29,378 INFO Thread-12 :99 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/conda-environment.yaml | |
| 2023-12-26 17:44:20,392 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/conda-environment.yaml | |
| 2023-12-26 17:44:20,449 DEBUG HandlerThread:99 [system_info.py:_save_conda():87] Saving conda packages done | |
| 2023-12-26 17:44:20,450 INFO HandlerThread:99 [system_monitor.py:probe():229] Finished publishing system info | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,458 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: stop_status | |
| 2023-12-26 17:44:20,459 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: internal_messages | |
| 2023-12-26 17:44:20,460 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,461 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: stop_status | |
| 2023-12-26 17:44:20,461 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,464 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,464 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,464 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,465 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,465 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:20,465 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:20,659 DEBUG SenderThread:99 [sender.py:send():382] send: telemetry | |
| 2023-12-26 17:44:20,659 DEBUG SenderThread:99 [sender.py:send():382] send: config | |
| 2023-12-26 17:44:20,660 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:44:20,660 DEBUG SenderThread:99 [sender.py:send():382] send: telemetry | |
| 2023-12-26 17:44:20,660 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:44:20,660 WARNING SenderThread:99 [sender.py:send_metric():1343] Seen metric with glob (shouldn't happen) | |
| 2023-12-26 17:44:20,660 DEBUG SenderThread:99 [sender.py:send():382] send: telemetry | |
| 2023-12-26 17:44:20,661 DEBUG SenderThread:99 [sender.py:send():382] send: files | |
| 2023-12-26 17:44:20,661 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-metadata.json with policy now | |
| 2023-12-26 17:44:21,393 INFO Thread-12 :99 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-metadata.json | |
| 2023-12-26 17:44:21,483 INFO wandb-upload_0:99 [upload_job.py:push():131] Uploaded file /tmp/tmp_cu8vqsnwandb/oy2aevri-wandb-metadata.json | |
| 2023-12-26 17:44:22,662 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:24,468 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:27,668 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:28,395 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/config.yaml | |
| 2023-12-26 17:44:28,477 DEBUG SystemMonitor:99 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2023-12-26 17:44:28,478 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:44:29,469 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:33,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:34,470 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:38,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:39,470 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:43,481 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:44,471 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:48,482 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:49,472 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:53,483 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:44:54,477 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:58,479 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:44:59,478 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:44:59,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:04,479 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:04,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:09,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:09,481 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:14,482 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:14,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:19,483 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:19,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:24,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:24,486 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:28,480 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:45:29,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:30,480 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:34,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:35,481 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:39,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:40,482 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:44,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:45,483 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:49,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:50,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:54,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:45:55,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:45:58,480 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:45:59,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:01,481 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:04,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:06,482 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:07,809 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:46:07,811 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:46:07,811 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:46:07,811 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:46:07,811 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:46:07,812 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:46:07,812 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:46:08,429 INFO Thread-12 :99 [dir_watcher.py:_on_file_created():271] file/dir created: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:46:09,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:11,813 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:14,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:16,814 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:19,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:21,815 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:24,503 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:26,816 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:28,481 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:46:29,504 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:32,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:33,439 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/config.yaml | |
| 2023-12-26 17:46:34,505 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:37,774 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:39,506 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:42,775 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:44,507 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:47,776 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:49,508 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:52,777 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:54,509 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:46:57,778 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:46:58,482 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:46:59,512 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:03,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:04,514 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:08,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:09,515 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:13,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:14,516 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:18,486 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:19,524 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:23,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:24,525 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:28,483 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:47:29,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:29,526 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:34,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:34,527 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:39,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:39,528 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:44,486 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:44,529 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:49,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:49,530 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:54,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:47:54,532 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:47:58,483 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:47:59,533 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:00,484 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:04,534 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:05,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:09,535 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:10,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:14,536 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:14,588 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:48:14,589 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:48:14,590 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:48:14,591 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:48:15,474 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:48:15,592 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:19,539 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:20,593 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:24,541 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:25,594 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:28,484 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:48:29,542 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:31,485 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:34,543 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:36,486 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:39,544 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:41,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:44,545 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:46,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:49,546 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:51,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:54,547 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:48:56,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:48:58,485 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:48:59,548 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:02,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:04,549 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:07,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:09,550 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:12,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:14,551 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:17,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:19,552 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:22,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:24,553 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:27,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:28,486 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:49:29,555 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:33,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:34,556 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:38,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:39,557 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:43,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:44,558 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:48,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:49,560 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:53,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:54,561 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:49:58,486 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:49:59,487 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:49:59,562 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:04,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:04,563 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:09,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:09,564 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:14,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:14,565 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:19,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:19,566 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:21,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:50:21,497 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:50:21,497 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:50:21,498 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:50:21,517 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:50:24,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:24,567 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:28,487 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:50:29,568 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:30,488 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:34,569 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:35,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:39,570 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:40,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:44,573 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:45,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:49,574 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:50,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:54,575 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:50:55,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:50:58,488 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:50:59,576 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:01,489 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:04,577 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:06,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:09,578 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:11,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:14,579 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:16,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:19,580 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:21,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:24,581 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:26,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:28,489 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:51:29,582 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:32,490 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:34,583 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:37,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:39,585 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:42,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:44,586 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:47,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:49,587 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:52,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:54,588 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:51:57,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:51:58,490 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:51:59,589 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:03,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:04,590 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:08,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:09,591 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:13,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:14,594 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:18,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:19,594 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:23,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:24,595 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:28,467 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:52:28,468 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:52:28,468 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:52:28,469 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:52:28,490 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:52:28,558 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:52:29,491 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:29,596 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:34,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:34,597 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:39,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:39,599 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:44,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:44,600 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:49,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:49,601 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:54,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:52:54,607 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:52:58,491 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:52:59,608 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:00,492 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:04,608 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:05,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:09,609 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:10,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:14,610 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:15,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:19,611 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:20,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:24,612 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:25,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:28,492 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:53:29,612 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:31,493 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:34,613 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:36,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:39,614 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:41,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:44,615 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:46,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:49,616 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:51,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:54,617 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:53:56,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:53:58,493 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:53:59,618 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:02,494 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:04,619 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:07,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:09,620 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:12,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:14,623 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:17,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:19,624 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:22,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:24,625 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:27,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:28,494 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:54:29,626 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:33,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:34,627 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:35,399 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:54:35,400 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:54:35,400 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:54:35,400 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:54:35,602 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:54:39,401 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:39,627 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:44,402 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:44,628 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:49,403 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:49,630 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:54,404 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:54,631 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:54:58,494 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:54:59,495 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:54:59,632 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:04,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:04,634 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:09,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:09,635 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:14,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:14,636 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:19,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:19,637 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:24,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:24,645 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:28,495 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:55:29,646 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:30,496 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:34,647 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:35,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:39,657 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:40,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:44,663 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:45,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:49,664 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:50,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:54,665 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:55:55,501 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:55:58,496 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:55:59,666 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:01,497 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:04,667 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:06,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:09,669 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:11,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:14,670 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:16,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:19,671 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:21,501 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:24,674 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:26,502 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:28,497 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:56:29,675 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:32,498 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:34,676 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:37,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:39,679 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:42,461 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:56:42,462 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:56:42,462 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:56:42,463 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:56:42,645 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:56:43,463 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:44,680 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:48,464 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:49,681 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:53,465 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:54,683 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:56:58,466 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:56:58,497 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:56:59,684 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:03,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:04,685 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:08,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:09,686 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:13,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:14,687 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:18,501 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:19,688 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:23,502 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:24,689 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:28,498 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:57:29,499 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:29,690 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:34,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:34,691 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:39,501 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:39,692 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:44,502 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:44,693 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:49,503 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:49,694 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:54,504 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:57:54,697 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:57:58,499 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:57:59,698 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:00,500 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:04,699 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:05,501 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:09,700 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:10,502 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:14,701 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:15,503 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:19,702 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:20,504 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:24,708 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:25,505 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:27,248 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: partial_history | |
| 2023-12-26 17:58:27,251 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:58:27,251 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:58:27,251 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:58:27,252 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:58:27,252 DEBUG SenderThread:99 [sender.py:send():382] send: metric | |
| 2023-12-26 17:58:27,252 DEBUG SenderThread:99 [sender.py:send():382] send: history | |
| 2023-12-26 17:58:27,252 DEBUG SenderThread:99 [sender.py:send_request():409] send_request: summary_record | |
| 2023-12-26 17:58:27,252 INFO SenderThread:99 [sender.py:_save_file():1392] saving file wandb-summary.json with policy end | |
| 2023-12-26 17:58:27,254 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: pause | |
| 2023-12-26 17:58:27,254 INFO HandlerThread:99 [handler.py:handle_request_pause():705] stopping system metrics thread | |
| 2023-12-26 17:58:27,254 INFO HandlerThread:99 [system_monitor.py:finish():203] Stopping system monitor | |
| 2023-12-26 17:58:27,254 DEBUG SystemMonitor:99 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2023-12-26 17:58:27,255 DEBUG SystemMonitor:99 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2023-12-26 17:58:27,255 INFO HandlerThread:99 [interfaces.py:finish():202] Joined cpu monitor | |
| 2023-12-26 17:58:27,256 INFO HandlerThread:99 [interfaces.py:finish():202] Joined disk monitor | |
| 2023-12-26 17:58:27,264 INFO HandlerThread:99 [interfaces.py:finish():202] Joined gpu monitor | |
| 2023-12-26 17:58:27,264 INFO HandlerThread:99 [interfaces.py:finish():202] Joined memory monitor | |
| 2023-12-26 17:58:27,264 INFO HandlerThread:99 [interfaces.py:finish():202] Joined network monitor | |
| 2023-12-26 17:58:27,264 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: resume | |
| 2023-12-26 17:58:27,265 INFO HandlerThread:99 [handler.py:handle_request_resume():696] starting system metrics thread | |
| 2023-12-26 17:58:27,265 INFO HandlerThread:99 [system_monitor.py:start():194] Starting system monitor | |
| 2023-12-26 17:58:27,265 INFO SystemMonitor:99 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2023-12-26 17:58:27,265 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:58:27,265 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: pause | |
| 2023-12-26 17:58:27,266 INFO HandlerThread:99 [handler.py:handle_request_pause():705] stopping system metrics thread | |
| 2023-12-26 17:58:27,266 INFO HandlerThread:99 [system_monitor.py:finish():203] Stopping system monitor | |
| 2023-12-26 17:58:27,266 WARNING HandlerThread:99 [interfaces.py:finish():207] Failed to finish cpu monitoring: cannot join thread before it is started | |
| 2023-12-26 17:58:27,267 INFO SystemMonitor:99 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-12-26 17:58:27,267 DEBUG SystemMonitor:99 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2023-12-26 17:58:27,267 DEBUG SystemMonitor:99 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2023-12-26 17:58:27,267 DEBUG SystemMonitor:99 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2023-12-26 17:58:27,268 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 17:58:27,681 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/wandb-summary.json | |
| 2023-12-26 17:58:29,709 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:31,269 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:34,710 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:36,270 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:39,711 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:41,272 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:44,713 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:46,273 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:49,714 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:51,274 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:54,715 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:58:56,280 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:58:56,692 INFO Thread-12 :99 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20231226_174326-ci9t5w07/files/config.yaml | |
| 2023-12-26 17:58:59,716 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:01,589 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:04,717 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:06,591 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:09,718 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:11,592 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:14,719 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:16,593 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:19,720 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:21,594 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:24,721 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:26,595 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:29,722 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:31,596 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:34,723 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:36,597 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:39,724 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:41,598 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:44,725 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:46,599 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:49,726 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:51,600 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:54,728 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 17:59:56,601 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 17:59:59,729 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:01,602 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:04,730 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:06,603 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:09,731 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:11,604 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:14,732 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:16,605 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:19,733 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:21,606 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:24,734 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:26,607 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:29,735 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:31,608 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:34,736 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:36,609 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:39,737 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:41,611 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:44,738 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:46,612 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:49,739 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:51,612 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:54,740 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:00:56,613 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:00:59,741 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:01,614 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:04,742 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:06,615 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:09,743 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:11,616 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:14,744 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:16,617 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:19,745 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:21,619 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:24,746 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:26,620 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:29,747 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:31,621 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:34,748 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:36,622 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:39,749 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:41,623 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:44,750 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:46,624 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:49,751 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:51,625 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:54,752 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:01:56,626 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:01:59,753 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:01,627 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:04,754 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:06,628 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:09,755 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:11,629 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:14,757 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:16,630 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:19,758 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:21,631 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:24,759 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:26,632 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:29,760 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:31,633 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:34,761 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:36,634 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:39,762 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:41,635 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:44,763 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:46,636 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:49,765 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:51,637 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:54,766 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:02:56,638 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:02:59,766 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:01,639 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:04,767 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:06,640 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:09,768 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:11,641 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:14,770 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:16,642 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:19,771 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:21,643 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:24,771 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:26,644 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:29,772 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:31,645 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:34,773 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:36,646 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:39,774 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:41,647 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:44,775 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:46,648 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:49,776 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:51,649 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:54,778 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:03:56,650 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:03:59,779 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:01,651 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:04,780 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:06,652 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:09,781 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:11,653 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:14,782 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:16,654 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:19,783 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:21,656 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:24,784 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:26,657 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:29,786 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:31,658 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:34,787 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:36,659 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:39,788 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:41,660 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:44,789 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:46,661 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:49,789 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:51,662 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:54,790 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:04:56,663 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:04:59,791 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:01,664 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:04,792 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:06,665 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:09,793 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:11,666 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:14,794 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:16,667 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:19,796 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:21,668 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:24,797 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:26,669 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:29,797 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:31,670 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:34,798 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:36,672 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:39,799 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:41,673 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:44,801 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:46,674 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:49,801 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:51,675 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:54,803 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:05:56,676 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:05:59,804 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:01,677 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:04,805 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:06,679 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:09,806 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:11,680 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:14,807 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:16,681 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:19,808 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:21,682 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:24,809 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:26,683 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:29,810 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:31,684 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:34,811 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:36,685 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:39,812 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:41,686 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:44,813 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:46,687 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:49,814 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:51,688 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:54,815 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:06:56,689 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:06:59,816 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:01,690 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:04,817 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:06,691 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:08,272 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: resume | |
| 2023-12-26 18:07:08,272 INFO HandlerThread:99 [handler.py:handle_request_resume():696] starting system metrics thread | |
| 2023-12-26 18:07:08,272 INFO HandlerThread:99 [system_monitor.py:start():194] Starting system monitor | |
| 2023-12-26 18:07:08,272 INFO SystemMonitor:99 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2023-12-26 18:07:08,273 INFO SystemMonitor:99 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-12-26 18:07:08,274 INFO SystemMonitor:99 [interfaces.py:start():190] Started disk monitoring | |
| 2023-12-26 18:07:08,275 INFO SystemMonitor:99 [interfaces.py:start():190] Started gpu monitoring | |
| 2023-12-26 18:07:08,277 INFO SystemMonitor:99 [interfaces.py:start():190] Started memory monitoring | |
| 2023-12-26 18:07:08,278 INFO SystemMonitor:99 [interfaces.py:start():190] Started network monitoring | |
| 2023-12-26 18:07:08,278 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: pause | |
| 2023-12-26 18:07:08,278 INFO HandlerThread:99 [handler.py:handle_request_pause():705] stopping system metrics thread | |
| 2023-12-26 18:07:08,278 INFO HandlerThread:99 [system_monitor.py:finish():203] Stopping system monitor | |
| 2023-12-26 18:07:08,279 INFO HandlerThread:99 [interfaces.py:finish():202] Joined cpu monitor | |
| 2023-12-26 18:07:08,279 DEBUG SystemMonitor:99 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2023-12-26 18:07:08,279 DEBUG SystemMonitor:99 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2023-12-26 18:07:08,279 DEBUG SystemMonitor:99 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2023-12-26 18:07:08,281 INFO HandlerThread:99 [interfaces.py:finish():202] Joined disk monitor | |
| 2023-12-26 18:07:08,290 INFO HandlerThread:99 [interfaces.py:finish():202] Joined gpu monitor | |
| 2023-12-26 18:07:08,291 INFO HandlerThread:99 [interfaces.py:finish():202] Joined memory monitor | |
| 2023-12-26 18:07:08,291 INFO HandlerThread:99 [interfaces.py:finish():202] Joined network monitor | |
| 2023-12-26 18:07:08,291 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 18:07:09,818 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:12,292 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:14,819 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:17,293 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:19,820 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:21,699 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: resume | |
| 2023-12-26 18:07:21,699 INFO HandlerThread:99 [handler.py:handle_request_resume():696] starting system metrics thread | |
| 2023-12-26 18:07:21,699 INFO HandlerThread:99 [system_monitor.py:start():194] Starting system monitor | |
| 2023-12-26 18:07:21,699 INFO SystemMonitor:99 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2023-12-26 18:07:21,700 INFO SystemMonitor:99 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-12-26 18:07:21,700 INFO SystemMonitor:99 [interfaces.py:start():190] Started disk monitoring | |
| 2023-12-26 18:07:21,701 INFO SystemMonitor:99 [interfaces.py:start():190] Started gpu monitoring | |
| 2023-12-26 18:07:21,701 INFO SystemMonitor:99 [interfaces.py:start():190] Started memory monitoring | |
| 2023-12-26 18:07:21,702 INFO SystemMonitor:99 [interfaces.py:start():190] Started network monitoring | |
| 2023-12-26 18:07:22,295 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:22,918 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: pause | |
| 2023-12-26 18:07:22,918 INFO HandlerThread:99 [handler.py:handle_request_pause():705] stopping system metrics thread | |
| 2023-12-26 18:07:22,918 INFO HandlerThread:99 [system_monitor.py:finish():203] Stopping system monitor | |
| 2023-12-26 18:07:22,919 DEBUG SystemMonitor:99 [system_monitor.py:_start():172] Starting system metrics aggregation loop | |
| 2023-12-26 18:07:22,919 DEBUG SystemMonitor:99 [system_monitor.py:_start():179] Finished system metrics aggregation loop | |
| 2023-12-26 18:07:22,919 DEBUG SystemMonitor:99 [system_monitor.py:_start():183] Publishing last batch of metrics | |
| 2023-12-26 18:07:22,920 INFO HandlerThread:99 [interfaces.py:finish():202] Joined cpu monitor | |
| 2023-12-26 18:07:22,920 INFO HandlerThread:99 [interfaces.py:finish():202] Joined disk monitor | |
| 2023-12-26 18:07:22,926 INFO HandlerThread:99 [interfaces.py:finish():202] Joined gpu monitor | |
| 2023-12-26 18:07:22,927 INFO HandlerThread:99 [interfaces.py:finish():202] Joined memory monitor | |
| 2023-12-26 18:07:22,927 INFO HandlerThread:99 [interfaces.py:finish():202] Joined network monitor | |
| 2023-12-26 18:07:22,927 DEBUG SenderThread:99 [sender.py:send():382] send: stats | |
| 2023-12-26 18:07:24,827 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:26,841 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: resume | |
| 2023-12-26 18:07:26,841 INFO HandlerThread:99 [handler.py:handle_request_resume():696] starting system metrics thread | |
| 2023-12-26 18:07:26,841 INFO HandlerThread:99 [system_monitor.py:start():194] Starting system monitor | |
| 2023-12-26 18:07:26,842 INFO SystemMonitor:99 [system_monitor.py:_start():158] Starting system asset monitoring threads | |
| 2023-12-26 18:07:26,842 INFO SystemMonitor:99 [interfaces.py:start():190] Started cpu monitoring | |
| 2023-12-26 18:07:26,843 INFO SystemMonitor:99 [interfaces.py:start():190] Started disk monitoring | |
| 2023-12-26 18:07:26,844 INFO SystemMonitor:99 [interfaces.py:start():190] Started gpu monitoring | |
| 2023-12-26 18:07:26,846 INFO SystemMonitor:99 [interfaces.py:start():190] Started memory monitoring | |
| 2023-12-26 18:07:26,847 INFO SystemMonitor:99 [interfaces.py:start():190] Started network monitoring | |
| 2023-12-26 18:07:27,928 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:29,835 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:32,929 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:34,836 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:37,930 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:39,838 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:42,931 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:44,839 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:47,933 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:49,840 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |
| 2023-12-26 18:07:52,934 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: status_report | |
| 2023-12-26 18:07:54,841 DEBUG HandlerThread:99 [handler.py:handle_request():146] handle_request: keepalive | |