| 2025-05-03 13:08:34,147 INFO MainThread:283620 [wandb_setup.py:_flush():68] Current SDK version is 0.19.10 | |
| 2025-05-03 13:08:34,147 INFO MainThread:283620 [wandb_setup.py:_flush():68] Configure stats pid to 283620 | |
| 2025-05-03 13:08:34,147 INFO MainThread:283620 [wandb_setup.py:_flush():68] Loading settings from /root/.config/wandb/settings | |
| 2025-05-03 13:08:34,148 INFO MainThread:283620 [wandb_setup.py:_flush():68] Loading settings from /workspace/project/wandb/settings | |
| 2025-05-03 13:08:34,148 INFO MainThread:283620 [wandb_setup.py:_flush():68] Loading settings from environment variables | |
| 2025-05-03 13:08:34,148 INFO MainThread:283620 [wandb_init.py:setup_run_log_directory():724] Logging user logs to ./output-1x50/wandb/run-20250503_130834-wfpfqj42/logs/debug.log | |
| 2025-05-03 13:08:34,148 INFO MainThread:283620 [wandb_init.py:setup_run_log_directory():725] Logging internal logs to ./output-1x50/wandb/run-20250503_130834-wfpfqj42/logs/debug-internal.log | |
| 2025-05-03 13:08:34,148 INFO MainThread:283620 [wandb_init.py:init():852] calling init triggers | |
| 2025-05-03 13:08:34,149 INFO MainThread:283620 [wandb_init.py:init():857] wandb.init called with sweep_config: {} | |
| config: {'_wandb': {}} | |
| 2025-05-03 13:08:34,149 INFO MainThread:283620 [wandb_init.py:init():893] starting backend | |
| 2025-05-03 13:08:34,149 INFO MainThread:283620 [wandb_init.py:init():897] sending inform_init request | |
| 2025-05-03 13:08:34,216 INFO MainThread:283620 [backend.py:_multiprocessing_setup():101] multiprocessing start_methods=fork,spawn,forkserver, using: spawn | |
| 2025-05-03 13:08:34,216 INFO MainThread:283620 [wandb_init.py:init():907] backend started and connected | |
| 2025-05-03 13:08:34,223 INFO MainThread:283620 [wandb_init.py:init():1002] updated telemetry | |
| 2025-05-03 13:08:34,224 INFO MainThread:283620 [wandb_init.py:init():1026] communicating run to backend with 90.0 second timeout | |
| 2025-05-03 13:08:35,046 INFO MainThread:283620 [wandb_init.py:init():1101] starting run threads in backend | |
| 2025-05-03 13:08:35,425 INFO MainThread:283620 [wandb_run.py:_console_start():2566] atexit reg | |
| 2025-05-03 13:08:35,426 INFO MainThread:283620 [wandb_run.py:_redirect():2414] redirect: wrap_raw | |
| 2025-05-03 13:08:35,426 INFO MainThread:283620 [wandb_run.py:_redirect():2483] Wrapping output streams. | |
| 2025-05-03 13:08:35,427 INFO MainThread:283620 [wandb_run.py:_redirect():2506] Redirects installed. | |
| 2025-05-03 13:08:35,431 INFO MainThread:283620 [wandb_init.py:init():1147] run started, returning control to user process | |
| 2025-05-03 13:08:35,433 INFO MainThread:283620 [wandb_run.py:_config_callback():1429] config_cb None None {'base_model': 'timbrooks/instruct-pix2pix', 'data_dir': './data', 'output_dir': './output-1x50', 'epochs': 4, 'batch_size': 20, 'split_episode': 90, 'max_episodes': 100, 'learning_rate': 1e-05, 'gpus': 1, 'precision': '16', 'accumulate_grad_batches': 1, 'num_workers': 16, 'checkpoint_every_n_steps': 500, 'eval_every_steps': 500, 'frame_offset': 50, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_weight_decay': 0.01, 'adam_epsilon': 1e-08, 'lr_scheduler': 'cosine', 'lr_warmup_steps': 500, 'wandb_project': 'instruct-pix2pix-robotwin', 'wandb_entity': 'nitrous-dev'} | |
| 2025-05-03 18:15:21,384 INFO MsgRouterThr:283620 [mailbox.py:close():129] [no run ID] Closing mailbox, abandoning 1 handles. | |