| NUM_GPUS=1 | |
| MASTER_ADDR=ip-10-0-133-32 | |
| MASTER_PORT=17673 | |
| WORLD_SIZE=1 | |
| ------ ARGS ------- | |
| Namespace(found_model_name='HCPflat_large_gsrFalse_', epoch_checkpoint='epoch99.pth', model_suffix='beta', hcp_flat_path='/weka/proj-medarc/shared/HCP-Flat', batch_size=24, wandb_log=True, num_epochs=20, lr_scheduler_type='cycle', save_ckpt=False, seed=42, max_lr=0.0003, target='sex', num_workers=15, weight_decay=0.001, global_pool=True) | |
| outdir /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ | |
| Loaded config.yaml from ckpt folder /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ | |
| __CONFIG__ | |
| base_lr = 0.001 | |
| batch_size = 32 | |
| ckpt_interval = 5 | |
| ckpt_saving = True | |
| cls_embed = True | |
| contrastive_loss_weight = 1.0 | |
| datasets_to_include = HCP | |
| decoder_embed_dim = 512 | |
| grad_accumulation_steps = 1 | |
| grad_clip = 1.0 | |
| gsr = False | |
| hcp_flat_path = /weka/proj-medarc/shared/HCP-Flat | |
| mask_ratio = 0.75 | |
| model_name = HCPflat_large_gsrFalse_ | |
| no_qkv_bias = False | |
| norm_pix_loss = False | |
| nsd_flat_path = /weka/proj-medarc/shared/NSD-Flat | |
| num_epochs = 100 | |
| num_frames = 16 | |
| num_samples_per_epoch = 200000 | |
| num_workers = 10 | |
| patch_size = 16 | |
| pct_masks_to_decode = 1 | |
| plotting = True | |
| pred_t_dim = 8 | |
| print_interval = 20 | |
| probe_base_lr = 0.0003 | |
| probe_batch_size = 8 | |
| probe_num_epochs = 30 | |
| probe_num_samples_per_epoch = 100000 | |
| resume_from_ckpt = True | |
| seed = 42 | |
| sep_pos_embed = True | |
| t_patch_size = 2 | |
| test_num_samples_per_epoch = 50000 | |
| test_set = False | |
| trunc_init = False | |
| use_contrastive_loss = False | |
| wandb_log = True | |
| WORLD_SIZE=1 | |
| PID of this process = 1888215 | |
| global_pool = True | |
| gsr = False | |
| Creating datasets | |
| Datasets ready | |
| img_size (144, 320) patch_size (16, 16) frames 16 t_patch_size 2 | |
| model initialized | |
| latest_checkpoint: epoch99.pth | |
| Loaded checkpoint epoch99.pth from /weka/proj-fmri/ckadirt/fMRI-foundation-model/src/checkpoints/HCPflat_large_gsrFalse_ | |
| Input dimension: 1024 | |
| total_steps 92760 | |
| wandb_config: | |
| {'model_name': 'HCPflat_large_gsrFalse__HCP_FT_sex', 'batch_size': 24, 'weight_decay': 0.001, 'num_epochs': 20, 'seed': 42, 'lr_scheduler_type': 'cycle', 'save_ckpt': False, 'max_lr': 0.0003, 'target': 'sex', 'num_workers': 15} | |
| wandb_id: HCPflat_large_gsrFalse__beta_sex_HCPFT_83810 | |
| [1;34mwandb[0m: 🚀 View run [33mHCPflat_large_gsrFalse__beta_sex_HCPFT[0m at: [34mhttps://stability.wandb.io/ckadirt/fMRI-foundation-model/runs/HCPflat_large_gsrFalse__beta_sex_HCPFT_83810[0m | |
| [1;34mwandb[0m: Find logs at: [1;35mwandb/run-20241126_213826-HCPflat_large_gsrFalse__beta_sex_HCPFT_83810/logs[0m | |