wandb/debug.log

2026-04-20 06:41:32,840 INFO    MainThread:1095566 [wandb_setup.py:_flush():81] Current SDK version is 0.25.1
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_setup.py:_flush():81] Configure stats pid to 1095566
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_setup.py:_flush():81] Loading settings from environment variables
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_init.py:setup_run_log_directory():717] Logging user logs to /home/ubuntu/thoughtformer/wandb/run-20260420_064132-fettlxv1/logs/debug.log
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_init.py:setup_run_log_directory():718] Logging internal logs to /home/ubuntu/thoughtformer/wandb/run-20260420_064132-fettlxv1/logs/debug-internal.log
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_init.py:init():844] calling init triggers
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_init.py:init():849] wandb.init called with sweep_config: {}
config: {'_wandb': {}}
2026-04-20 06:41:32,841 INFO    MainThread:1095566 [wandb_init.py:init():892] starting backend
2026-04-20 06:41:33,058 INFO    MainThread:1095566 [wandb_init.py:init():895] sending inform_init request
2026-04-20 06:41:33,061 INFO    MainThread:1095566 [wandb_init.py:init():903] backend started and connected
2026-04-20 06:41:33,064 INFO    MainThread:1095566 [wandb_init.py:init():973] updated telemetry
2026-04-20 06:41:33,070 INFO    MainThread:1095566 [wandb_init.py:init():997] communicating run to backend with 90.0 second timeout
2026-04-20 06:41:33,678 INFO    MainThread:1095566 [wandb_init.py:init():1042] starting run threads in backend
2026-04-20 06:41:33,735 INFO    MainThread:1095566 [wandb_run.py:_console_start():2524] atexit reg
2026-04-20 06:41:33,737 INFO    MainThread:1095566 [wandb_run.py:_redirect():2373] redirect: wrap_raw
2026-04-20 06:41:33,737 INFO    MainThread:1095566 [wandb_run.py:_redirect():2442] Wrapping output streams.
2026-04-20 06:41:33,737 INFO    MainThread:1095566 [wandb_run.py:_redirect():2465] Redirects installed.
2026-04-20 06:41:33,738 INFO    MainThread:1095566 [wandb_init.py:init():1082] run started, returning control to user process
2026-04-20 06:41:33,738 INFO    MainThread:1095566 [wandb_run.py:_config_callback():1403] config_cb None None {'project': 'thoughtformer', 'name': 'tree-n100-no-thought_n10000_qwen3-0.6b-base_thoughtformer_lr1e-4_reset_dc_no-tc_two_pointers-0512d48f', 'only_eval': False, 'method': 'thoughtformer', 'data_curriculum': True, 'thought_curriculum': False, 'staging': 'two_pointers', 'init_thought_stage': 0, 'init_data_stage': 1, 'patience': 5, 'staging_threshold': 0.9, 'c_thought': 0, 'max_latent_stage': 0, 'save_only_improve': False, 'model_id': 'Qwen/Qwen3-0.6B-Base', 'load_model_path': 'None', 'seed': 0, 'resume': 0, 'bf16': False, 'train_path': 'data/tree_n100_10000_train.json', 'val_path': 'data/tree_n100_50_valid.json', 'reset_optimizer': True, 'lr_schedule': 'cosine', 'batch_size_training': 4, 'eval_only_trained': False, 'eval_batch_size': 8, 'eval_every': 1, 'debug': False, 'gradient_accumulation_steps': 1, 'num_epochs': 100, 'lr': 0.0001, 'weight_decay': 0.01}