wandb/debug.log

2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Current SDK version is 0.18.5
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Configure stats pid to 1168332
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Loading settings from /home/tiger/.config/wandb/settings
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Loading settings from /mnt/bn/themis/yijiangli/project/EmbodiedVideoRL/wandb/settings
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Loading settings from environment variables: {'disabled': 'false', 'project': 'Corrective-Reflow', 'api_key': '***REDACTED***', 'mode': 'online'}
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Applying setup settings: {'mode': 'online', '_disable_service': None}
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Inferring run settings from compute environment: {'program_relpath': 'fastvideo/train_creflow_wan_2_2_ti2v.py', 'program_abspath': '/mnt/bn/themis/yijiangli/project/EmbodiedVideoRL/fastvideo/train_creflow_wan_2_2_ti2v.py', 'program': '/mnt/bn/themis/yijiangli/project/EmbodiedVideoRL/fastvideo/train_creflow_wan_2_2_ti2v.py'}
2026-04-08 16:49:19,387 INFO    MainThread:1168332 [wandb_setup.py:_flush():79] Applying login settings: {}
2026-04-08 16:49:19,389 INFO    MainThread:1168332 [wandb_init.py:_log_setup():534] Logging user logs to data/outputs/creflow_stack_blocks_three/wandb/run-20260408_164919-x63spn6n/logs/debug.log
2026-04-08 16:49:19,390 INFO    MainThread:1168332 [wandb_init.py:_log_setup():535] Logging internal logs to data/outputs/creflow_stack_blocks_three/wandb/run-20260408_164919-x63spn6n/logs/debug-internal.log
2026-04-08 16:49:19,390 INFO    MainThread:1168332 [wandb_init.py:init():621] calling init triggers
2026-04-08 16:49:19,390 INFO    MainThread:1168332 [wandb_init.py:init():628] wandb.init called with sweep_config: {}
config: {'vidar_root': '', 'task': 'ti2v-5B', 'size': '640*736', 'frame_num': 121, 'ckpt_dir': 'ckpts/Wan2.2-TI2V-5B', 'pt_dir': 'ckpts/vidar_ckpt/merged_vidar_lora.pt', 'convert_model_dtype': True, 'offload_model': False, 'dataset_json': 'data/rl_train/robotwin_stack_blocks_three.json', 'max_samples': -1, 'output_dir': 'data/outputs/creflow_stack_blocks_three', 'num_ode_steps': 20, 'sample_shift': 5.0, 'sample_guide_scale': 5.0, 'neg_prompt': '色调艳丽，过曝，静态，细节模糊不清，字幕，风格，作品，画作，画面，静止，整体发灰，最差质量，低质量，JPEG压缩残留，丑陋的，残缺的，多余的手指，画得不好的手部，画得不好的脸部，畸形的，毁容的，形态畸形的肢体，手指融合，静止不动的画面，杂乱的背景，三条腿，背景人很多，倒着走', 'seed': 42, 'K': 16, 'num_rounds': 10, 'epochs_per_round': 100, 'effective_batch_size': 16, 'w_bad': 1.0, 'max_per_condition': 64, 'lambda_gripper': 1.0, 'reset_optimizer_per_round': False, 'num_train_timesteps': 1000, 'learning_rate': 1e-05, 'weight_decay': 0.01, 'max_grad_norm': 2.0, 'checkpointing_steps': 10, 'gradient_checkpointing': True, 'use_8bit_adam': True, 'lora_rank': 64, 'lora_alpha': 64, 'lora_target_modules': None, 'resume_from_lora_checkpoint': None, 'reward_config': 'blocks_stack_v2', 'reward_backend': 'blocks_stack_v2', 'skip_reward_debug_video': True, 'wandb_project': 'Corrective-Reflow', 'wandb_run_name': 'creflow_stack_blocks_three', 'hallucination_crop_top_ratio': 0.6667, 'bsv2_prompts': ['red block', 'green block', 'blue block'], 'bsv2_pick_thr': 0.05, 'bsv2_place_thr': 0.05, 'bsv2_vertical_sep_thr': 0.03, 'bsv2_x_align_thr': 0.025, 'bsv2_check_window_frac': 0.2, 'bsv2_dup_max_frames': 0, 'bsv2_expected_grip_changes': 6, 'bsv2_mj_lo': 0.6, 'bsv2_mj_hi': 1.3, 'bsv2_idm_ckpt_path': 'ckpts/vidar_ckpt/idm.pt'}
2026-04-08 16:49:19,390 INFO    MainThread:1168332 [wandb_init.py:init():671] starting backend
2026-04-08 16:49:19,390 INFO    MainThread:1168332 [wandb_init.py:init():675] sending inform_init request
2026-04-08 16:49:19,415 INFO    MainThread:1168332 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2026-04-08 16:49:19,415 INFO    MainThread:1168332 [wandb_init.py:init():688] backend started and connected
2026-04-08 16:49:19,465 INFO    MainThread:1168332 [wandb_init.py:init():783] updated telemetry
2026-04-08 16:49:19,620 INFO    MainThread:1168332 [wandb_init.py:init():816] communicating run to backend with 90.0 second timeout
2026-04-08 16:49:20,302 INFO    MainThread:1168332 [wandb_init.py:init():867] starting run threads in backend
2026-04-08 16:49:20,654 INFO    MainThread:1168332 [wandb_run.py:_console_start():2463] atexit reg
2026-04-08 16:49:20,655 INFO    MainThread:1168332 [wandb_run.py:_redirect():2311] redirect: wrap_raw
2026-04-08 16:49:20,655 INFO    MainThread:1168332 [wandb_run.py:_redirect():2376] Wrapping output streams.
2026-04-08 16:49:20,655 INFO    MainThread:1168332 [wandb_run.py:_redirect():2401] Redirects installed.
2026-04-08 16:49:20,659 INFO    MainThread:1168332 [wandb_init.py:init():911] run started, returning control to user process