wandb/debug.log

2023-10-31 16:13:27,656 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Current SDK version is 0.15.12
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Configure stats pid to 1080408
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/.config/wandb/settings
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/wandb/settings
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Loading settings from environment variables: {}
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False}
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'examples/dreambooth/train_dreambooth_lora.py', 'program_abspath': '/home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/train_dreambooth_lora.py', 'program': '/home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/train_dreambooth_lora.py'}
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_init.py:_log_setup():528] Logging user logs to /home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/wandb/run-20231031_161327-8441xowv/logs/debug.log
2023-10-31 16:13:27,657 INFO    MainThread:1080408 [wandb_init.py:_log_setup():529] Logging internal logs to /home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/wandb/run-20231031_161327-8441xowv/logs/debug-internal.log
2023-10-31 16:13:27,658 INFO    MainThread:1080408 [wandb_init.py:init():568] calling init triggers
2023-10-31 16:13:27,658 INFO    MainThread:1080408 [wandb_init.py:init():575] wandb.init called with sweep_config: {}
config: {}
2023-10-31 16:13:27,658 INFO    MainThread:1080408 [wandb_init.py:init():618] starting backend
2023-10-31 16:13:27,658 INFO    MainThread:1080408 [wandb_init.py:init():622] setting up manager
2023-10-31 16:13:27,661 INFO    MainThread:1080408 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
2023-10-31 16:13:27,662 INFO    MainThread:1080408 [wandb_init.py:init():628] backend started and connected
2023-10-31 16:13:27,667 INFO    MainThread:1080408 [wandb_init.py:init():720] updated telemetry
2023-10-31 16:13:27,675 INFO    MainThread:1080408 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout
2023-10-31 16:13:28,280 INFO    MainThread:1080408 [wandb_run.py:_on_init():2220] communicating current version
2023-10-31 16:13:28,428 INFO    MainThread:1080408 [wandb_run.py:_on_init():2229] got version response 
2023-10-31 16:13:28,428 INFO    MainThread:1080408 [wandb_init.py:init():804] starting run threads in backend
2023-10-31 16:13:31,560 INFO    MainThread:1080408 [wandb_run.py:_console_start():2199] atexit reg
2023-10-31 16:13:31,560 INFO    MainThread:1080408 [wandb_run.py:_redirect():2054] redirect: wrap_raw
2023-10-31 16:13:31,561 INFO    MainThread:1080408 [wandb_run.py:_redirect():2119] Wrapping output streams.
2023-10-31 16:13:31,561 INFO    MainThread:1080408 [wandb_run.py:_redirect():2144] Redirects installed.
2023-10-31 16:13:31,562 INFO    MainThread:1080408 [wandb_init.py:init():845] run started, returning control to user process
2023-10-31 16:13:31,564 INFO    MainThread:1080408 [wandb_run.py:_config_callback():1324] config_cb None None {'pretrained_model_name_or_path': 'stabilityai/stable-diffusion-2', 'revision': None, 'tokenizer_name': None, 'instance_data_dir': 'dog', 'class_data_dir': None, 'instance_prompt': 'a photo of sks dog', 'class_prompt': None, 'validation_prompt': 'A photo of sks dog in a bucket', 'num_validation_images': 4, 'validation_epochs': 50, 'with_prior_preservation': False, 'prior_loss_weight': 1.0, 'num_class_images': 100, 'output_dir': '/home/ubuntu/Desktop/jaeho/diffusers/examples/dreambooth/', 'seed': 0, 'resolution': 512, 'center_crop': False, 'train_text_encoder': False, 'train_batch_size': 1, 'sample_batch_size': 4, 'num_train_epochs': 100, 'max_train_steps': 500, 'checkpointing_steps': 100, 'checkpoints_total_limit': None, 'resume_from_checkpoint': None, 'gradient_accumulation_steps': 1, 'gradient_checkpointing': False, 'learning_rate': 0.0001, 'scale_lr': False, 'lr_scheduler': 'constant', 'lr_warmup_steps': 0, 'lr_num_cycles': 1, 'lr_power': 1.0, 'dataloader_num_workers': 0, 'use_8bit_adam': False, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_weight_decay': 0.01, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'push_to_hub': True, 'hub_token': None, 'hub_model_id': None, 'logging_dir': 'logs', 'allow_tf32': False, 'report_to': 'wandb', 'mixed_precision': None, 'prior_generation_precision': None, 'local_rank': -1, 'enable_xformers_memory_efficient_attention': False, 'pre_compute_text_embeddings': False, 'tokenizer_max_length': None, 'text_encoder_use_attention_mask': False, 'class_labels_conditioning': None, 'rank': 4}