| 2024-12-31 20:46:23,179 INFO StreamThr :1737239 [internal.py:wandb_internal():85] W&B internal server running at pid: 1737239, started at: 2024-12-31 20:46:23.178761 |
| 2024-12-31 20:46:23,180 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status |
| 2024-12-31 20:46:23,197 INFO WriterThread:1737239 [datastore.py:open_for_write():87] open: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/run-kccehv5k.wandb |
| 2024-12-31 20:46:23,197 DEBUG SenderThread:1737239 [sender.py:send():379] send: header |
| 2024-12-31 20:46:23,205 DEBUG SenderThread:1737239 [sender.py:send():379] send: run |
| 2024-12-31 20:46:23,451 INFO SenderThread:1737239 [dir_watcher.py:__init__():211] watching files in: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files |
| 2024-12-31 20:46:23,452 INFO SenderThread:1737239 [sender.py:_start_run_threads():1188] run started: kccehv5k with start time 1735695983.180525 |
| 2024-12-31 20:46:23,475 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: check_version |
| 2024-12-31 20:46:23,475 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: check_version |
| 2024-12-31 20:46:23,544 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: run_start |
| 2024-12-31 20:46:23,553 DEBUG HandlerThread:1737239 [system_info.py:__init__():26] System info init |
| 2024-12-31 20:46:23,554 DEBUG HandlerThread:1737239 [system_info.py:__init__():41] System info init done |
| 2024-12-31 20:46:23,554 INFO HandlerThread:1737239 [system_monitor.py:start():194] Starting system monitor |
| 2024-12-31 20:46:23,554 INFO SystemMonitor:1737239 [system_monitor.py:_start():158] Starting system asset monitoring threads |
| 2024-12-31 20:46:23,554 INFO HandlerThread:1737239 [system_monitor.py:probe():214] Collecting system info |
| 2024-12-31 20:46:23,555 INFO SystemMonitor:1737239 [interfaces.py:start():188] Started cpu monitoring |
| 2024-12-31 20:46:23,555 INFO SystemMonitor:1737239 [interfaces.py:start():188] Started disk monitoring |
| 2024-12-31 20:46:23,556 INFO SystemMonitor:1737239 [interfaces.py:start():188] Started gpu monitoring |
| 2024-12-31 20:46:23,556 INFO SystemMonitor:1737239 [interfaces.py:start():188] Started memory monitoring |
| 2024-12-31 20:46:23,557 INFO SystemMonitor:1737239 [interfaces.py:start():188] Started network monitoring |
| 2024-12-31 20:46:23,566 DEBUG HandlerThread:1737239 [system_info.py:probe():152] Probing system |
| 2024-12-31 20:46:23,567 DEBUG HandlerThread:1737239 [system_info.py:_probe_git():137] Probing git |
| 2024-12-31 20:46:23,572 DEBUG HandlerThread:1737239 [system_info.py:_probe_git():145] Probing git done |
| 2024-12-31 20:46:23,572 DEBUG HandlerThread:1737239 [system_info.py:probe():200] Probing system done |
| 2024-12-31 20:46:23,572 DEBUG HandlerThread:1737239 [system_monitor.py:probe():223] {'os': 'Linux-5.15.0-125-generic-x86_64-with-glibc2.31', 'python': '3.10.14', 'heartbeatAt': '2025-01-01T01:46:23.566585', 'startedAt': '2025-01-01T01:46:23.167015', 'docker': None, 'cuda': None, 'args': ('agent=diffusion', 'suite=frankagym', 'suite/frankagym_task@_global_=insertion'), 'state': 'running', 'program': '/home/leonmkim/fish_leon/FISH/eval_robot.py', 'codePathLocal': None, 'codePath': 'FISH/eval_robot.py', 'git': {'remote': 'https://github.com/leonmkim/fish_leon.git', 'commit': '284407f87cd673789a10dbd8e4d4f41dcad30ded'}, 'email': 'leonmkim@seas.upenn.edu', 'root': '/home/leonmkim/fish_leon', 'host': 'leonmkim-ROG-Strix-G15CS-G15CS', 'username': 'leonmkim', 'executable': '/home/leonmkim/.pyenv/versions/lerobot/bin/python', 'cpu_count': 8, 'cpu_count_logical': 8, 'cpu_freq': {'current': 3749.995, 'min': 800.0, 'max': 4700.0}, 'cpu_freq_per_core': [{'current': 3000.0, 'min': 800.0, 'max': 4700.0}, {'current': 4499.963, 'min': 800.0, 'max': 4700.0}, {'current': 4499.968, 'min': 800.0, 'max': 4700.0}, {'current': 4500.002, 'min': 800.0, 'max': 4700.0}, {'current': 4499.993, 'min': 800.0, 'max': 4700.0}, {'current': 3000.0, 'min': 800.0, 'max': 4700.0}, {'current': 3000.0, 'min': 800.0, 'max': 4700.0}, {'current': 4499.999, 'min': 800.0, 'max': 4700.0}], 'disk': {'/': {'total': 915.3232879638672, 'used': 488.8013000488281}}, 'gpu': 'NVIDIA GeForce RTX 2070 SUPER', 'gpu_count': 1, 'gpu_devices': [{'name': 'NVIDIA GeForce RTX 2070 SUPER', 'memory_total': 8589934592}], 'memory': {'total': 62.71595764160156}} |
| 2024-12-31 20:46:23,572 INFO HandlerThread:1737239 [system_monitor.py:probe():224] Finished collecting system info |
| 2024-12-31 20:46:23,572 INFO HandlerThread:1737239 [system_monitor.py:probe():227] Publishing system info |
| 2024-12-31 20:46:23,573 DEBUG HandlerThread:1737239 [system_info.py:_save_code():44] Saving code |
| 2024-12-31 20:46:23,574 DEBUG HandlerThread:1737239 [system_info.py:_save_code():67] Saving code done |
| 2024-12-31 20:46:23,574 DEBUG HandlerThread:1737239 [system_info.py:_save_patches():84] Saving git patches |
| 2024-12-31 20:46:23,637 DEBUG HandlerThread:1737239 [system_info.py:_save_patches():126] Saving git patches done |
| 2024-12-31 20:46:23,638 INFO HandlerThread:1737239 [system_monitor.py:probe():229] Finished publishing system info |
| 2024-12-31 20:46:23,645 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:46:23,645 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-metadata.json with policy now |
| 2024-12-31 20:46:23,645 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file code/FISH/eval_robot.py with policy now |
| 2024-12-31 20:46:23,645 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file diff.patch with policy now |
| 2024-12-31 20:46:23,914 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: python_packages |
| 2024-12-31 20:46:23,915 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: python_packages |
| 2024-12-31 20:46:23,916 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: stop_status |
| 2024-12-31 20:46:23,916 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: stop_status |
| 2024-12-31 20:46:23,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:23,918 INFO HandlerThread:1737239 [handler.py:handle_tbrecord():783] handling tbrecord: tbrecord { |
| log_dir: "/home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/tb" |
| save: true |
| } |
| control { |
| relay_id: "5f4965b8c2e34f0181637e6010b99766" |
| } |
| _info { |
| stream_id: "kccehv5k" |
| } |
|
|
| 2024-12-31 20:46:23,919 DEBUG HandlerThread:1737239 [config_util.py:dict_from_config_file():70] no default config file found in config-defaults.yaml |
| 2024-12-31 20:46:23,920 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/6wde7y2z-wandb-metadata.json |
| 2024-12-31 20:46:23,935 INFO wandb-upload_2:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/thrz3lhd-diff.patch |
| 2024-12-31 20:46:23,960 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/gf5ock7d-code/FISH/eval_robot.py |
| 2024-12-31 20:46:24,453 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-metadata.json |
| 2024-12-31 20:46:24,453 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:46:24,453 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/diff.patch |
| 2024-12-31 20:46:24,454 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/code/FISH/eval_robot.py |
| 2024-12-31 20:46:24,454 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/requirements.txt |
| 2024-12-31 20:46:24,454 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/code |
| 2024-12-31 20:46:24,454 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/code/FISH |
| 2024-12-31 20:46:24,670 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/z7vm580p-events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:46:24,917 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:25,917 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:26,917 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:27,917 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:28,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:29,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:30,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:31,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:32,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:33,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:34,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:35,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:36,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:37,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:38,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:39,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:40,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:41,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:42,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:43,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:44,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:45,314 DEBUG SenderThread:1737239 [sender.py:send():379] send: telemetry |
| 2024-12-31 20:46:45,314 DEBUG SenderThread:1737239 [sender.py:send():379] send: tbrecord |
| 2024-12-31 20:46:45,314 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:46:45,315 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:46:45,315 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 with policy live |
| 2024-12-31 20:46:45,315 DEBUG SenderThread:1737239 [sender.py:send():379] send: config |
| 2024-12-31 20:46:45,457 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:46:45,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:46,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:47,458 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:46:47,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:48,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:49,459 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:46:49,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:50,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:51,197 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:46:51,459 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:46:51,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:52,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:53,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:54,921 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:55,921 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:56,201 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:46:56,461 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/config.yaml |
| 2024-12-31 20:46:56,921 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:57,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:58,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:46:59,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:00,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:01,318 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:01,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:02,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:03,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:04,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:05,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:06,319 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:06,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:07,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:08,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:09,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:10,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:11,320 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:11,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:12,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:13,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:14,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:15,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:16,321 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:16,924 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:17,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:18,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:19,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:20,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:21,321 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:21,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:22,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:23,557 DEBUG SystemMonitor:1737239 [system_monitor.py:_start():172] Starting system metrics aggregation loop |
| 2024-12-31 20:47:23,558 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:47:23,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:24,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:25,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:26,558 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:26,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:27,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:28,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:29,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:30,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:31,559 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:31,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:32,927 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:33,471 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:33,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:34,927 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:35,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:36,715 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:36,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:37,472 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:37,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:38,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:39,472 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:39,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:40,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:41,473 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:41,801 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:41,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:42,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:43,473 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:43,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:44,928 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:45,474 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:45,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:46,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:46,937 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:47,475 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:47,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:48,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:49,475 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:49,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:50,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:51,476 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:51,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:52,138 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:52,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:53,477 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:53,558 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:47:53,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:54,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:55,477 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:55,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:56,929 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:57,141 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:47:57,478 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:57,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:58,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:47:59,478 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:47:59,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:00,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:01,479 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:01,930 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:02,145 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:02,931 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:03,321 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:48:03,321 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 with policy now |
| 2024-12-31 20:48:03,321 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 20:48:03,322 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:48:03,322 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:48:03,323 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos |
| 2024-12-31 20:48:03,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 20:48:03,576 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/bfcifyvh-media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 |
| 2024-12-31 20:48:03,840 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/5sr4pn21-media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 |
| 2024-12-31 20:48:03,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:04,931 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:05,480 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:05,932 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:06,973 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:07,481 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:07,932 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:07,973 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:08,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:09,932 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:10,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:11,482 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:48:11,483 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:11,761 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/pulmzem4-events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:48:11,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:12,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:13,483 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:13,509 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:13,933 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:14,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:15,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:16,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:17,484 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:17,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:18,698 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:18,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:19,485 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:19,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:20,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:21,486 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:21,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:22,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:23,559 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:48:23,894 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:23,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:24,487 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:24,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:25,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:26,488 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:26,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:27,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:28,488 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:28,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:29,092 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:29,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:30,489 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:30,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:31,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:32,490 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:32,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:33,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:34,289 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:34,490 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:34,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:35,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:36,491 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:36,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:37,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:38,492 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:38,936 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:39,487 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:39,937 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:40,493 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:40,937 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:41,937 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:42,493 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:42,937 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:43,161 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 20:48:43,161 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:48:43,161 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 with policy now |
| 2024-12-31 20:48:43,162 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:48:43,162 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:48:43,162 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:48:43,424 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/rhfg4oqz-media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 |
| 2024-12-31 20:48:43,494 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:48:43,494 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 |
| 2024-12-31 20:48:43,494 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 20:48:43,760 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/jq399vyr-media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 |
| 2024-12-31 20:48:43,947 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:44,494 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:44,941 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:45,165 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:45,942 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:46,494 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:46,947 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:47,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:48,495 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:48,944 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:49,941 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:50,589 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:50,945 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:51,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:52,496 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:48:52,950 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:53,559 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:48:53,952 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:54,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:55,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:56,560 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:48:56,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:57,952 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:58,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:48:59,950 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:00,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:01,560 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:01,956 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:02,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:03,374 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:49:03,374 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:49:03,375 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:49:03,500 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:49:03,500 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:49:03,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:04,500 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:04,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:05,960 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:06,501 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:06,792 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:06,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:07,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:08,502 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:08,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:09,956 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:10,503 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:10,956 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:11,925 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:11,956 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:12,503 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:12,956 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:13,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:14,504 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:14,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:15,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:16,505 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:16,926 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:16,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:17,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:18,505 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:18,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:19,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:20,506 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:20,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:21,935 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:21,957 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:22,507 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:22,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:23,559 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:49:23,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:24,508 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:24,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:25,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:26,509 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:26,942 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:26,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:27,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:28,510 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:28,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:29,958 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:30,511 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:30,959 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:31,959 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:32,131 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:32,512 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:32,959 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:33,962 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:34,512 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:34,798 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:49:34,798 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 with policy now |
| 2024-12-31 20:49:34,801 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 20:49:34,802 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:49:34,802 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:49:34,802 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:49:34,963 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:35,093 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/ax5t9rrt-media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 |
| 2024-12-31 20:49:35,513 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:49:35,513 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 |
| 2024-12-31 20:49:35,513 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 20:49:35,788 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/136e1m9w-media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 |
| 2024-12-31 20:49:35,968 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:36,513 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:36,969 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:37,824 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:37,969 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:38,978 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:39,970 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:40,514 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:40,969 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:41,968 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:42,515 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:42,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:43,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:43,973 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:44,976 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:46,005 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:46,216 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:49:46,216 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:49:46,217 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:49:46,516 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:49:46,517 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:49:46,774 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/xkps3yje-events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:49:46,990 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:47,987 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:48,517 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:48,984 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:49,073 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:49,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:50,976 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:51,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:52,518 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:52,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:53,560 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:49:53,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:54,182 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:54,519 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:54,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:55,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:56,520 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:56,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:57,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:58,521 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:49:58,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:49:59,372 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:49:59,978 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:00,522 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:00,978 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:01,978 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:02,522 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:02,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:03,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:04,384 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:04,523 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:04,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:05,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:06,524 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:06,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:07,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:08,525 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:08,979 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:09,578 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:09,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:10,525 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:10,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:11,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:12,526 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:12,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:13,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:14,527 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:14,772 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:14,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:15,981 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:16,528 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:16,986 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:17,939 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:50:17,939 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 with policy now |
| 2024-12-31 20:50:17,946 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 20:50:17,946 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:50:17,946 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:50:17,947 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:50:17,984 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:18,196 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/v104jt0i-media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 |
| 2024-12-31 20:50:18,528 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:50:18,529 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:18,529 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 |
| 2024-12-31 20:50:18,529 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 20:50:18,805 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/6q36fotf-media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 |
| 2024-12-31 20:50:18,987 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:19,977 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:19,993 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:20,529 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:20,991 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:21,990 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:22,991 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:23,560 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:50:23,995 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:24,531 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:24,998 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:25,505 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:25,999 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:26,531 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:27,004 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:28,013 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:28,994 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:29,996 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:30,506 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:31,000 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:32,017 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:33,008 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:34,003 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:35,021 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:35,276 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:50:35,276 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:50:35,277 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:50:35,534 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:50:35,534 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:50:35,998 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:36,063 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:36,534 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:37,019 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:38,015 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:38,535 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:39,008 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:40,011 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:40,536 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:41,010 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:41,160 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:42,010 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:42,537 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:43,010 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:44,011 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:44,537 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:45,011 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:46,011 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:46,198 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:46,538 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:47,012 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:48,012 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:48,539 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:49,012 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:50,012 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:50,540 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:51,013 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:51,389 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:52,013 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:52,540 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:53,014 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:53,561 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:50:54,014 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:54,541 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:55,013 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:56,013 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:56,542 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:56,589 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:50:57,015 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:58,015 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:50:58,543 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:50:59,014 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:00,015 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:00,544 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:01,015 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:01,790 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:02,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:02,544 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:03,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:04,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:04,545 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:05,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:06,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:06,546 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:06,807 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:07,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:08,016 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:08,546 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:09,023 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:09,345 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 20:51:09,345 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 20:51:09,345 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 with policy now |
| 2024-12-31 20:51:09,346 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:51:09,346 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:51:09,346 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:51:09,547 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:51:09,547 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 20:51:09,547 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 20:51:09,645 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/ge0ui9g0-media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 20:51:09,912 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/g212tycz-media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 20:51:10,020 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:10,547 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:11,024 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:12,027 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:12,365 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:13,030 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:14,035 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:14,549 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:15,032 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:16,046 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:17,045 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:17,909 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:18,046 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:18,550 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:19,056 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:20,083 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:21,066 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:22,054 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:22,910 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:23,056 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:23,561 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:51:24,059 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:25,066 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:26,066 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:27,065 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:28,061 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:28,562 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:29,068 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:30,068 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:31,071 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:32,079 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:33,099 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:33,562 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:34,083 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:35,085 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:36,085 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:37,090 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:38,091 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:38,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:39,100 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:40,090 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:41,091 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:42,096 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:43,099 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:43,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:44,112 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:44,361 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 20:51:44,361 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 20:51:44,361 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 20:51:44,559 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:51:44,559 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 20:51:44,559 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:44,810 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/gknw2j08-events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 20:51:45,108 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:46,115 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:46,560 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 20:51:47,126 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:48,123 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:49,121 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:49,362 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:50,129 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:51,122 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:52,137 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:53,127 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:53,562 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:51:54,126 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:54,562 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:51:55,127 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:56,131 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:57,132 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:58,141 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:59,144 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:51:59,562 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:00,149 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:01,144 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:02,158 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:03,157 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:04,159 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:04,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:05,160 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:06,155 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:07,159 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:08,173 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:09,163 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:09,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:10,173 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:11,178 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:12,179 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:13,177 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:14,178 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:14,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:15,176 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:16,173 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:17,176 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:18,181 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:19,178 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:19,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:20,184 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:21,189 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:22,192 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:23,196 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:23,562 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:52:24,198 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:25,195 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:25,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:26,201 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:27,207 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:28,199 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:29,204 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:30,207 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:30,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:31,209 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:32,213 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:33,217 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:34,208 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:35,213 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:35,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:36,217 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:37,208 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:38,216 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:39,217 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:40,219 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:40,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:41,221 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:42,222 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:43,220 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:44,221 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:45,230 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:45,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:46,229 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:47,246 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:48,234 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:49,241 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:50,241 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:50,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:51,242 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:52,250 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:53,243 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:53,562 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:52:54,249 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:55,252 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:56,250 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:56,563 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:52:57,245 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:58,250 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:52:59,248 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:00,256 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:01,258 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:01,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:02,256 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:03,252 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:04,256 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:05,259 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:06,258 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:06,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:07,273 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:08,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:09,275 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:10,262 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:11,265 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:11,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:12,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:13,273 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:14,265 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:15,272 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:16,272 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:16,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:17,273 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:18,302 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:19,289 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:20,294 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:21,289 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:21,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:22,297 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:23,308 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:23,563 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:53:24,307 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:25,321 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:26,317 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:27,300 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:27,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:28,329 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:29,317 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:30,325 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:31,333 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:32,330 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:32,564 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:33,340 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:34,328 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:35,329 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:36,327 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:37,333 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:37,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:38,341 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:39,339 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:40,333 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:41,332 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:42,335 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:42,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:43,336 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:44,336 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:45,346 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:46,346 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:47,341 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:47,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:48,341 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:49,345 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:50,349 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:51,354 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:52,348 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:52,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:53,357 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:53,571 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:53:54,359 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:55,362 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:56,362 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:57,359 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:57,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:53:58,360 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:53:59,363 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:00,361 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:01,357 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:02,359 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:02,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:03,359 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:04,364 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:05,367 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:06,364 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:07,362 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:07,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:08,385 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:09,370 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:10,376 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:11,379 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:12,375 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:12,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:13,376 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:14,387 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:15,392 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:16,400 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:17,388 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:17,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:18,393 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:19,386 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:20,398 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:21,392 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:22,399 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:22,574 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:23,397 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:23,564 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:54:24,397 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:25,400 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:26,404 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:27,420 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:28,399 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:28,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:29,405 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:30,402 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:31,409 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:32,413 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:33,421 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:33,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:34,426 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:35,430 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:36,429 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:37,424 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:38,426 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:38,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:39,428 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:40,433 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:41,447 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:42,449 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:43,447 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:43,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:44,452 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:45,455 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:46,444 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:47,451 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:48,450 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:48,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:49,451 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:50,458 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:51,464 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:52,470 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:53,453 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:53,565 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:54:54,461 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:54,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:54:55,465 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:56,472 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:57,472 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:58,471 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:59,497 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:54:59,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:00,483 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:01,476 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:02,484 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:03,475 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:04,482 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:04,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:05,479 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:06,487 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:07,492 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:08,488 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:09,503 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:09,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:10,497 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:11,501 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:12,492 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:13,495 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:14,497 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:14,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:15,494 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:16,494 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:17,496 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:18,501 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:19,520 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:19,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:20,518 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:21,527 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:22,522 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:23,513 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:23,565 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:55:24,510 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:25,516 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:25,565 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:26,516 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:27,521 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:28,520 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:29,520 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:30,538 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:30,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:31,528 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:32,533 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:33,544 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:34,530 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:35,526 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:35,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:36,536 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:37,542 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:38,539 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:39,542 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:40,544 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:40,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:41,539 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:42,535 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:43,542 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:44,549 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:45,545 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:45,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:46,548 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:47,556 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:48,539 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:49,556 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:50,549 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:50,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:51,557 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:52,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:53,565 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:55:53,574 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:54,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:55,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:56,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:55:56,582 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:57,576 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:58,578 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:55:59,584 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:00,588 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:01,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:01,582 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:02,588 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:03,588 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:04,585 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:05,597 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:06,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:06,595 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:07,590 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:08,593 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:09,594 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:10,595 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:11,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:11,613 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:12,601 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:13,618 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:14,618 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:15,616 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:16,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:16,606 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:17,621 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:18,620 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:19,622 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:20,628 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:21,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:21,634 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:22,629 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:23,566 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:56:23,634 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:24,638 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:25,642 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:26,641 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:27,566 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:27,642 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:28,659 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:29,657 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:30,644 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:31,641 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:32,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:32,653 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:33,653 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:34,654 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:35,651 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:36,653 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:37,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:37,651 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:38,663 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:39,665 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:40,659 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:41,658 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:42,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:42,658 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:43,684 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:44,674 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:45,663 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:46,669 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:47,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:47,676 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:48,681 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:49,691 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:50,690 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:51,694 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:52,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:52,697 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:53,566 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:56:53,707 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:54,696 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:55,695 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:56,713 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:57,713 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:58,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:56:58,722 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:56:59,713 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:00,710 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:01,709 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:02,714 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:03,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:03,741 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:04,740 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:05,739 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:06,739 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:07,745 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:08,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:08,742 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:09,749 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:10,748 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:11,742 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:12,763 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:13,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:13,746 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:14,745 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:15,748 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:16,745 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:17,752 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:18,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:18,749 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:19,754 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:20,762 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:21,761 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:22,772 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:23,567 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:57:23,763 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:24,567 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:24,775 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:25,762 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:26,760 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:27,762 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:28,762 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:29,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:29,781 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:30,778 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:31,771 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:32,777 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:33,774 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:34,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:34,767 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:35,770 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:36,778 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:37,777 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:38,780 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:39,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:39,781 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:40,788 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:41,785 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:42,795 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:43,794 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:44,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:44,800 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:45,800 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:46,799 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:47,808 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:48,801 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:49,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:49,807 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:50,812 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:51,811 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:52,825 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:53,567 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:57:53,805 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:54,811 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:55,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:57:55,808 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:56,806 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:57,812 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:58,812 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:57:59,816 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:00,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:00,814 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:01,818 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:02,822 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:03,822 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:04,828 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:05,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:05,822 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:06,823 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:07,828 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:08,825 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:09,831 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:10,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:10,831 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:11,839 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:12,849 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:13,851 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:14,846 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:15,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:15,842 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:16,851 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:17,849 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:18,860 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:19,854 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:20,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:20,850 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:21,854 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:22,855 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:23,568 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:58:23,865 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:24,869 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:25,870 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:26,568 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:26,871 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:27,871 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:28,874 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:29,875 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:30,879 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:31,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:31,893 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:32,887 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:33,893 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:34,891 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:35,893 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:36,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:36,890 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:37,893 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:38,892 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:39,898 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:40,909 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:41,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:41,922 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:42,901 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:43,921 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:44,907 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:45,910 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:46,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:46,913 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:47,915 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:48,920 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:49,914 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:50,912 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:51,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:51,919 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:52,918 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:53,568 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:58:53,915 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:54,931 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:55,923 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:56,932 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:57,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:58:57,942 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:58,944 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:58:59,934 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:00,954 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:01,948 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:02,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:02,952 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:03,950 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:04,954 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:05,955 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:06,971 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:07,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:07,974 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:08,975 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:09,993 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:10,973 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:11,982 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:12,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:12,982 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:13,980 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:14,985 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:15,993 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:16,999 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:17,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:18,007 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:19,003 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:19,995 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:21,000 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:22,007 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:22,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:23,008 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:23,569 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:59:24,009 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:25,023 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:26,026 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:27,024 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:28,024 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:28,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:29,027 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:30,027 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:31,034 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:32,044 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:33,038 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:33,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:34,032 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:35,055 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:36,050 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:37,054 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:38,048 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:38,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:39,053 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:40,048 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:41,062 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:42,063 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:43,064 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:43,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:44,075 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:45,073 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:46,072 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:47,075 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:48,092 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:48,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:49,078 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:50,080 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:51,085 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:52,085 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:53,090 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:53,569 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 20:59:54,089 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:54,569 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 20:59:55,095 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:56,102 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:57,120 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:58,107 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:59,121 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 20:59:59,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:00,127 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:01,116 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:02,131 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:03,113 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:04,136 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:04,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:05,117 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:06,122 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:07,121 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:08,138 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:09,126 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:09,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:10,124 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:11,125 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:12,134 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:13,135 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:14,133 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:14,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:15,138 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:16,137 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:17,143 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:18,150 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:19,148 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:19,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:20,149 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:21,152 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:22,163 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:23,180 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:23,570 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 21:00:24,178 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:25,166 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:25,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:26,175 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:27,176 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:28,172 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:29,171 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:30,169 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:30,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:31,176 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:32,175 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:33,179 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:34,176 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:35,190 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:35,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:36,180 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:37,204 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:38,182 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:39,194 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:40,194 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:40,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:41,189 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:42,192 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:43,183 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:44,189 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:45,195 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:45,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:46,193 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:47,190 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:48,196 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:49,196 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:50,193 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:50,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:51,195 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:52,193 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:53,196 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:53,570 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 21:00:54,224 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:55,212 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:56,213 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:56,570 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:00:57,213 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:58,209 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:00:59,213 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:00,215 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:01,215 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:01,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:02,222 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:03,219 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:04,223 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:05,222 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:06,223 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:06,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:07,225 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:08,233 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:09,235 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:10,237 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:11,243 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:11,572 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:12,244 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:13,245 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:14,244 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:15,250 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:16,256 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:16,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:17,256 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:18,264 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:19,264 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:20,266 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:21,273 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:21,573 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:22,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:23,271 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:23,570 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 21:01:24,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:25,267 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:26,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:27,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:27,571 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:28,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:29,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:30,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:30,766 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 21:01:31,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:32,268 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:32,686 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:33,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:34,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:35,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:36,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:37,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:37,686 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:38,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:39,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:40,269 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:41,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:42,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:42,687 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:43,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:44,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:45,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:46,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:47,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:47,688 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:48,270 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:49,271 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:01:49,889 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: partial_history |
| 2024-12-31 21:01:49,889 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: server_info |
| 2024-12-31 21:01:49,890 DEBUG SenderThread:1737239 [sender.py:send():379] send: files |
| 2024-12-31 21:01:49,890 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 with policy now |
| 2024-12-31 21:01:49,890 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 21:01:49,890 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 21:01:49,891 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 21:01:49,891 DEBUG SenderThread:1737239 [sender.py:send():379] send: telemetry |
| 2024-12-31 21:01:49,891 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: server_info |
| 2024-12-31 21:01:49,973 DEBUG SenderThread:1737239 [sender.py:send():379] send: exit |
| 2024-12-31 21:01:49,973 INFO SenderThread:1737239 [sender.py:send_exit():586] handling exit code: 0 |
| 2024-12-31 21:01:49,973 INFO SenderThread:1737239 [sender.py:send_exit():588] handling runtime: 926 |
| 2024-12-31 21:01:49,974 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 21:01:49,974 INFO SenderThread:1737239 [sender.py:send_exit():594] send defer |
| 2024-12-31 21:01:49,974 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:49,974 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 0 |
| 2024-12-31 21:01:49,974 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:49,974 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 0 |
| 2024-12-31 21:01:49,974 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 1 |
| 2024-12-31 21:01:49,974 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:49,974 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 1 |
| 2024-12-31 21:01:49,975 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:49,975 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 1 |
| 2024-12-31 21:01:49,975 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 2 |
| 2024-12-31 21:01:49,975 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:49,975 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 2 |
| 2024-12-31 21:01:49,975 INFO HandlerThread:1737239 [system_monitor.py:finish():203] Stopping system monitor |
| 2024-12-31 21:01:49,975 DEBUG SystemMonitor:1737239 [system_monitor.py:_start():179] Finished system metrics aggregation loop |
| 2024-12-31 21:01:49,975 DEBUG SystemMonitor:1737239 [system_monitor.py:_start():183] Publishing last batch of metrics |
| 2024-12-31 21:01:49,976 INFO HandlerThread:1737239 [interfaces.py:finish():200] Joined cpu monitor |
| 2024-12-31 21:01:49,976 INFO HandlerThread:1737239 [interfaces.py:finish():200] Joined disk monitor |
| 2024-12-31 21:01:50,028 INFO HandlerThread:1737239 [interfaces.py:finish():200] Joined gpu monitor |
| 2024-12-31 21:01:50,028 INFO HandlerThread:1737239 [interfaces.py:finish():200] Joined memory monitor |
| 2024-12-31 21:01:50,028 INFO HandlerThread:1737239 [interfaces.py:finish():200] Joined network monitor |
| 2024-12-31 21:01:50,028 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:50,029 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 2 |
| 2024-12-31 21:01:50,029 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 3 |
| 2024-12-31 21:01:50,029 DEBUG SenderThread:1737239 [sender.py:send():379] send: stats |
| 2024-12-31 21:01:50,029 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:50,029 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 3 |
| 2024-12-31 21:01:50,029 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:50,029 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 3 |
| 2024-12-31 21:01:50,029 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 4 |
| 2024-12-31 21:01:50,029 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:50,029 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 4 |
| 2024-12-31 21:01:50,169 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/qqawmlse-media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 21:01:50,773 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 21:01:50,774 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 21:01:50,774 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_created():271] file/dir created: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 21:01:50,774 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval |
| 2024-12-31 21:01:51,039 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /tmp/tmp9bpkh5biwandb/h9z1qd6j-media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 21:01:55,416 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: poll_exit |
| 2024-12-31 21:01:55,416 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:55,417 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:55,417 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 4 |
| 2024-12-31 21:01:55,417 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 5 |
| 2024-12-31 21:01:55,417 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: poll_exit |
| 2024-12-31 21:01:55,417 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:55,418 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 5 |
| 2024-12-31 21:01:55,418 DEBUG SenderThread:1737239 [sender.py:send():379] send: history |
| 2024-12-31 21:01:55,418 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: summary_record |
| 2024-12-31 21:01:55,419 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 21:01:55,419 DEBUG SenderThread:1737239 [sender.py:send():379] send: summary |
| 2024-12-31 21:01:55,423 INFO SenderThread:1737239 [sender.py:_save_file():1454] saving file wandb-summary.json with policy end |
| 2024-12-31 21:01:55,423 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:55,423 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 5 |
| 2024-12-31 21:01:55,423 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 6 |
| 2024-12-31 21:01:55,424 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:55,424 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 6 |
| 2024-12-31 21:01:55,424 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:55,424 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 6 |
| 2024-12-31 21:01:55,427 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: status_report |
| 2024-12-31 21:01:55,553 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 7 |
| 2024-12-31 21:01:55,554 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:55,554 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 7 |
| 2024-12-31 21:01:55,554 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:55,554 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 7 |
| 2024-12-31 21:01:55,776 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/config.yaml |
| 2024-12-31 21:01:55,777 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 21:01:55,974 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: keepalive |
| 2024-12-31 21:01:55,975 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: poll_exit |
| 2024-12-31 21:01:58,233 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 8 |
| 2024-12-31 21:01:58,233 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: poll_exit |
| 2024-12-31 21:01:58,233 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:58,234 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 8 |
| 2024-12-31 21:01:58,234 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:58,234 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 8 |
| 2024-12-31 21:01:58,234 INFO SenderThread:1737239 [job_builder.py:build():440] Attempting to build job artifact |
| 2024-12-31 21:01:58,240 INFO SenderThread:1737239 [job_builder.py:_get_source_type():569] is repo sourced job |
| 2024-12-31 21:01:58,254 INFO SenderThread:1737239 [job_builder.py:build():545] adding wandb-job metadata file |
| 2024-12-31 21:01:58,263 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 9 |
| 2024-12-31 21:01:58,263 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:01:58,263 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 9 |
| 2024-12-31 21:01:58,264 DEBUG SenderThread:1737239 [sender.py:send():379] send: artifact |
| 2024-12-31 21:01:58,778 INFO Thread-12 :1737239 [dir_watcher.py:_on_file_modified():288] file/dir modified: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 21:01:58,975 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: poll_exit |
| 2024-12-31 21:01:59,219 INFO wandb-upload_1:1737239 [upload_job.py:push():88] Uploaded file /tmp/tmpx0ryqqaf/wandb-job.json |
| 2024-12-31 21:01:59,269 INFO wandb-upload_2:1737239 [upload_job.py:push():88] Uploaded file /home/leonmkim/.local/share/wandb/artifacts/staging/tmpsqvtcw6o |
| 2024-12-31 21:01:59,273 INFO wandb-upload_0:1737239 [upload_job.py:push():88] Uploaded file /home/leonmkim/.local/share/wandb/artifacts/staging/tmpmzppz3e_ |
| 2024-12-31 21:01:59,790 INFO SenderThread:1737239 [sender.py:send_artifact():1537] sent artifact job-https___github.com_leonmkim_fish_leon.git_FISH_eval_robot.py - {'id': 'QXJ0aWZhY3Q6MTQxNDExMjAxNQ==', 'state': 'PENDING', 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjMxNzk5NjkyNQ==', 'latestArtifact': {'id': 'QXJ0aWZhY3Q6MTQxMjA3MTYzNw==', 'versionIndex': 388}}} |
| 2024-12-31 21:01:59,790 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:01:59,790 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 9 |
| 2024-12-31 21:01:59,790 INFO SenderThread:1737239 [dir_watcher.py:finish():358] shutting down directory watcher |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():388] scan: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/config.yaml config.yaml |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json wandb-summary.json |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/requirements.txt requirements.txt |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-metadata.json wandb-metadata.json |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 events.out.tfevents.1735695983.leonmkim-ROG-Strix-G15CS-G15CS.1737022.0 |
| 2024-12-31 21:02:00,779 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log output.log |
| 2024-12-31 21:02:00,780 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/diff.patch diff.patch |
| 2024-12-31 21:02:00,784 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/code/FISH/eval_robot.py code/FISH/eval_robot.py |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 media/videos/eval/video_5_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 media/videos/eval/4_eval_4_d8469a9945cf9312a1f4.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 media/videos/eval/1_eval_1_f99c821ca0f3dcf058d7.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 media/videos/eval/3_eval_3_0f8beb81bb83090b35f9.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 media/videos/eval/2_eval_2_497369a7fef0c32f3ee5.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [dir_watcher.py:finish():402] scan save: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 media/videos/eval/0_eval_0_94c4871aa0a38b24cd6b.mp4 |
| 2024-12-31 21:02:00,786 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 10 |
| 2024-12-31 21:02:00,786 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: poll_exit |
| 2024-12-31 21:02:00,787 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:02:00,787 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 10 |
| 2024-12-31 21:02:00,787 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:02:00,787 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 10 |
| 2024-12-31 21:02:00,787 INFO SenderThread:1737239 [file_pusher.py:finish():169] shutting down file pusher |
| 2024-12-31 21:02:00,976 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: poll_exit |
| 2024-12-31 21:02:00,977 INFO wandb-upload_1:1737239 [upload_job.py:push():130] Uploaded file /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/config.yaml |
| 2024-12-31 21:02:00,977 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: poll_exit |
| 2024-12-31 21:02:00,978 INFO wandb-upload_0:1737239 [upload_job.py:push():130] Uploaded file /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/requirements.txt |
| 2024-12-31 21:02:00,990 INFO wandb-upload_2:1737239 [upload_job.py:push():130] Uploaded file /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/wandb-summary.json |
| 2024-12-31 21:02:01,082 INFO wandb-upload_3:1737239 [upload_job.py:push():130] Uploaded file /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/files/output.log |
| 2024-12-31 21:02:01,282 INFO Thread-11 (_thread_body):1737239 [sender.py:transition_state():614] send defer: 11 |
| 2024-12-31 21:02:01,282 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:02:01,282 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 11 |
| 2024-12-31 21:02:01,282 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:02:01,283 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 11 |
| 2024-12-31 21:02:01,283 INFO SenderThread:1737239 [file_pusher.py:join():175] waiting for file pusher |
| 2024-12-31 21:02:01,284 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 12 |
| 2024-12-31 21:02:01,284 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:02:01,284 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 12 |
| 2024-12-31 21:02:01,284 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:02:01,284 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 12 |
| 2024-12-31 21:02:01,284 INFO SenderThread:1737239 [file_stream.py:finish():601] file stream finish called |
| 2024-12-31 21:02:01,457 INFO SenderThread:1737239 [file_stream.py:finish():605] file stream finish is done |
| 2024-12-31 21:02:01,457 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 13 |
| 2024-12-31 21:02:01,458 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:02:01,458 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 13 |
| 2024-12-31 21:02:01,458 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:02:01,458 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 13 |
| 2024-12-31 21:02:01,458 INFO SenderThread:1737239 [sender.py:transition_state():614] send defer: 14 |
| 2024-12-31 21:02:01,458 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: defer |
| 2024-12-31 21:02:01,458 INFO HandlerThread:1737239 [handler.py:handle_request_defer():184] handle defer: 14 |
| 2024-12-31 21:02:01,459 DEBUG SenderThread:1737239 [sender.py:send():379] send: final |
| 2024-12-31 21:02:01,459 DEBUG SenderThread:1737239 [sender.py:send():379] send: footer |
| 2024-12-31 21:02:01,459 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: defer |
| 2024-12-31 21:02:01,459 INFO SenderThread:1737239 [sender.py:send_request_defer():610] handle sender defer: 14 |
| 2024-12-31 21:02:01,460 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: poll_exit |
| 2024-12-31 21:02:01,460 DEBUG SenderThread:1737239 [sender.py:send_request():406] send_request: poll_exit |
| 2024-12-31 21:02:01,461 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: internal_messages |
| 2024-12-31 21:02:01,471 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: get_summary |
| 2024-12-31 21:02:01,471 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: sampled_history |
| 2024-12-31 21:02:01,472 DEBUG HandlerThread:1737239 [handler.py:handle_request():158] handle_request: shutdown |
| 2024-12-31 21:02:01,472 INFO HandlerThread:1737239 [handler.py:finish():882] shutting down handler |
| 2024-12-31 21:02:02,460 INFO WriterThread:1737239 [datastore.py:close():296] close: /home/leonmkim/fish_leon/FISH/exp_local/frankagym_pixels/FrankaInsertion-v1/1002_0/kccehv5k/wandb/run-20241231_204623-kccehv5k/run-kccehv5k.wandb |
| 2024-12-31 21:02:02,460 INFO SenderThread:1737239 [sender.py:finish():1615] shutting down sender |
| 2024-12-31 21:02:02,460 INFO SenderThread:1737239 [file_pusher.py:finish():169] shutting down file pusher |
| 2024-12-31 21:02:02,460 INFO SenderThread:1737239 [file_pusher.py:join():175] waiting for file pusher |
|
|
