Running 1 job
{
    "type": "diffusion_trainer",
    "training_folder": "/data/app/output",
    "sqlite_db_path": "/data/app/aitk_db.db",
    "device": "cuda",
    "trigger_word": "a-cold-wall",
    "performance_log_every": 10,
    "network": {
        "type": "lora",
        "linear": 32,
        "linear_alpha": 32,
        "conv": 16,
        "conv_alpha": 16,
        "lokr_full_rank": true,
        "lokr_factor": -1,
        "network_kwargs": {
            "ignore_if_contains": []
        }
    },
    "save": {
        "dtype": "bf16",
        "save_every": 250,
        "max_step_saves_to_keep": 4,
        "save_format": "diffusers",
        "push_to_hub": false
    },
    "datasets": [
        {
            "folder_path": "/data/app/datasets/a_cold_wall",
            "mask_path": null,
            "mask_min_value": 0.1,
            "default_caption": "fashion outfits",
            "caption_ext": "txt",
            "caption_dropout_rate": 0.05,
            "cache_latents_to_disk": false,
            "is_reg": false,
            "network_weight": 1,
            "resolution": [
                512,
                768,
                1024
            ],
            "controls": [],
            "shrink_video_to_frames": true,
            "num_frames": 1,
            "do_i2v": true,
            "flip_x": false,
            "flip_y": false
        }
    ],
    "train": {
        "batch_size": 1,
        "bypass_guidance_embedding": false,
        "steps": 3000,
        "gradient_accumulation": 1,
        "train_unet": true,
        "train_text_encoder": false,
        "gradient_checkpointing": true,
        "noise_scheduler": "flowmatch",
        "optimizer": "adamw8bit",
        "timestep_type": "weighted",
        "content_or_style": "balanced",
        "optimizer_params": {
            "weight_decay": 0.0001
        },
        "unload_text_encoder": false,
        "cache_text_embeddings": false,
        "lr": 0.0001,
        "ema_config": {
            "use_ema": false,
            "ema_decay": 0.99
        },
        "skip_first_sample": true,
        "force_first_sample": false,
        "disable_sampling": false,
        "dtype": "bf16",
        "diff_output_preservation": false,
        "diff_output_preservation_multiplier": 1,
        "diff_output_preservation_class": "person",
        "switch_boundary_every": 1,
        "loss_type": "mse",
        "do_differential_guidance": true,
        "differential_guidance_scale": 3
    },
    "model": {
        "name_or_path": "Tongyi-MAI/Z-Image-Turbo",
        "quantize": true,
        "qtype": "qfloat8",
        "quantize_te": true,
        "qtype_te": "qfloat8",
        "arch": "zimage:turbo",
        "low_vram": false,
        "model_kwargs": {},
        "layer_offloading": false,
        "layer_offloading_text_encoder_percent": 1,
        "layer_offloading_transformer_percent": 1,
        "assistant_lora_path": "ostris/zimage_turbo_training_adapter/zimage_turbo_training_adapter_v2.safetensors"
    },
    "sample": {
        "sampler": "flowmatch",
        "sample_every": 2500,
        "width": 512,
        "height": 512,
        "samples": [],
        "neg": "",
        "seed": 42,
        "walk_seed": true,
        "guidance_scale": 1,
        "sample_steps": 8,
        "num_frames": 1,
        "fps": 1
    }
}
Using SQLite database at /data/app/aitk_db.db
Job ID: "3fb3c5e9-9b42-43dc-8b44-11f5ae2f28da"

#############################################
# Running job: a-cold-wall
#############################################


Running  1 process
Loading ZImage model
Loading transformer

config.json:   0%|          | 0.00/473 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/473 [00:00<?, ?B/s]
config.json: 100%|##########| 473/473 [00:00<00:00, 4.06MB/s]
config.json: 100%|##########| 473/473 [00:00<00:00, 4.06MB/s]


(…)ion_pytorch_model.safetensors.index.json: 0.00B [00:00, ?B/s]
(…)ion_pytorch_model.safetensors.index.json: 0.00B [00:00, ?B/s]
(…)ion_pytorch_model.safetensors.index.json: 49.0kB [00:00, 43.2MB/s]
(…)ion_pytorch_model.safetensors.index.json: 49.0kB [00:00, 43.2MB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<2:05:24, 1.33MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<2:05:24, 1.33MB/s]
transformer/diffusion_pytorch_model-0000(…):   2%|2         | 202M/9.97G [00:00<00:35, 276MB/s]   
transformer/diffusion_pytorch_model-0000(…):   2%|2         | 202M/9.97G [00:00<00:35, 276MB/s]   
transformer/diffusion_pytorch_model-0000(…):   5%|5         | 539M/9.97G [00:01<00:16, 571MB/s]
transformer/diffusion_pytorch_model-0000(…):   5%|5         | 539M/9.97G [00:01<00:16, 571MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 743M/9.97G [00:01<00:11, 778MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 743M/9.97G [00:01<00:11, 778MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|9         | 944M/9.97G [00:01<00:09, 914MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|9         | 944M/9.97G [00:01<00:09, 914MB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#         | 1.08G/9.97G [00:01<00:09, 903MB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#         | 1.08G/9.97G [00:01<00:09, 903MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#2        | 1.22G/9.97G [00:01<00:08, 992MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#2        | 1.22G/9.97G [00:01<00:08, 992MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 1.42G/9.97G [00:01<00:08, 984MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 1.42G/9.97G [00:01<00:08, 984MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.62G/9.97G [00:02<00:07, 1.07GB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.62G/9.97G [00:02<00:07, 1.07GB/s]
transformer/diffusion_pytorch_model-0000(…):  18%|#8        | 1.82G/9.97G [00:02<00:06, 1.18GB/s]
transformer/diffusion_pytorch_model-0000(…):  18%|#8        | 1.82G/9.97G [00:02<00:06, 1.18GB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:02<00:11, 677MB/s] 
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:02<00:11, 677MB/s] 
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:02<00:05, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:02<00:05, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:03<00:05, 1.42GB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:03<00:05, 1.42GB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.02G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.02G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.22G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.22G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:03<00:04, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.62G/9.97G [00:03<00:05, 1.23GB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.62G/9.97G [00:03<00:05, 1.23GB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:03<00:05, 1.22GB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:03<00:05, 1.22GB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:03<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:03<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.23G/9.97G [00:04<00:04, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.23G/9.97G [00:04<00:04, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.43G/9.97G [00:04<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.43G/9.97G [00:04<00:04, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 4.63G/9.97G [00:04<00:03, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 4.63G/9.97G [00:04<00:03, 1.40GB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####8     | 4.83G/9.97G [00:04<00:03, 1.38GB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####8     | 4.83G/9.97G [00:04<00:03, 1.38GB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:04<00:03, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:04<00:03, 1.32GB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####2    | 5.24G/9.97G [00:05<00:05, 862MB/s] 
transformer/diffusion_pytorch_model-0000(…):  53%|#####2    | 5.24G/9.97G [00:05<00:05, 862MB/s] 
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:05<00:03, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:05<00:03, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:05<00:02, 1.36GB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:05<00:02, 1.36GB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:05<00:02, 1.39GB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:05<00:02, 1.39GB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 6.31G/9.97G [00:05<00:02, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 6.31G/9.97G [00:05<00:02, 1.41GB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:05<00:02, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:05<00:02, 1.29GB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:06<00:02, 1.31GB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:06<00:02, 1.31GB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:06<00:02, 1.30GB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:06<00:02, 1.22GB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:06<00:02, 1.22GB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 7.25G/9.97G [00:06<00:02, 1.12GB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 7.25G/9.97G [00:06<00:02, 1.12GB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.38G/9.97G [00:06<00:02, 1.14GB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 7.38G/9.97G [00:06<00:02, 1.14GB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.58G/9.97G [00:06<00:01, 1.31GB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######6  | 7.58G/9.97G [00:06<00:01, 1.31GB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 7.78G/9.97G [00:06<00:01, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######8  | 7.78G/9.97G [00:06<00:01, 1.34GB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|########  | 7.99G/9.97G [00:07<00:01, 1.36GB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|########  | 7.99G/9.97G [00:07<00:01, 1.36GB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########2 | 8.19G/9.97G [00:07<00:01, 1.33GB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########2 | 8.19G/9.97G [00:07<00:01, 1.33GB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 8.39G/9.97G [00:07<00:01, 1.46GB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 8.39G/9.97G [00:07<00:01, 1.46GB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:07<00:00, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:07<00:00, 1.44GB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:07<00:00, 1.48GB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:07<00:00, 1.48GB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:07<00:00, 1.64GB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.03G/9.97G [00:07<00:00, 1.64GB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:07<00:00, 1.68GB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:07<00:00, 1.68GB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:07<00:00, 1.83GB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:07<00:00, 1.83GB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:08<00:00, 1.92GB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:08<00:00, 1.92GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.23GB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:08<00:00, 1.23GB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/9.97G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<2:10:53, 1.27MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 866k/9.97G [00:00<2:10:53, 1.27MB/s]
transformer/diffusion_pytorch_model-0000(…):   1%|1         | 135M/9.97G [00:01<00:59, 165MB/s]   
transformer/diffusion_pytorch_model-0000(…):   1%|1         | 135M/9.97G [00:01<00:59, 165MB/s]   
transformer/diffusion_pytorch_model-0000(…):   6%|6         | 606M/9.97G [00:01<00:14, 643MB/s]
transformer/diffusion_pytorch_model-0000(…):   6%|6         | 606M/9.97G [00:01<00:14, 643MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|9         | 943M/9.97G [00:01<00:09, 981MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|9         | 943M/9.97G [00:01<00:09, 981MB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#1        | 1.14G/9.97G [00:01<00:11, 802MB/s]
transformer/diffusion_pytorch_model-0000(…):  11%|#1        | 1.14G/9.97G [00:01<00:11, 802MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#2        | 1.28G/9.97G [00:01<00:10, 866MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#2        | 1.28G/9.97G [00:01<00:10, 866MB/s]
transformer/diffusion_pytorch_model-0000(…):  15%|#4        | 1.48G/9.97G [00:02<00:08, 1.00GB/s]
transformer/diffusion_pytorch_model-0000(…):  15%|#4        | 1.48G/9.97G [00:02<00:08, 1.00GB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.61G/9.97G [00:02<00:11, 709MB/s] 
transformer/diffusion_pytorch_model-0000(…):  16%|#6        | 1.61G/9.97G [00:02<00:11, 709MB/s] 
transformer/diffusion_pytorch_model-0000(…):  18%|#7        | 1.75G/9.97G [00:03<00:18, 445MB/s]
transformer/diffusion_pytorch_model-0000(…):  18%|#7        | 1.75G/9.97G [00:03<00:18, 445MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 1.88G/9.97G [00:03<00:23, 338MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 1.88G/9.97G [00:03<00:23, 338MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:04<00:25, 310MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|#9        | 1.95G/9.97G [00:04<00:25, 310MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 2.02G/9.97G [00:05<00:41, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 2.02G/9.97G [00:05<00:41, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.08G/9.97G [00:05<00:40, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  21%|##        | 2.08G/9.97G [00:05<00:40, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##2       | 2.28G/9.97G [00:05<00:26, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##2       | 2.28G/9.97G [00:05<00:26, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##3       | 2.35G/9.97G [00:05<00:28, 269MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##3       | 2.35G/9.97G [00:05<00:28, 269MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 2.42G/9.97G [00:06<00:29, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 2.42G/9.97G [00:06<00:29, 257MB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:06<00:30, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  25%|##4       | 2.49G/9.97G [00:06<00:30, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:06<00:31, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 2.55G/9.97G [00:06<00:31, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##6       | 2.62G/9.97G [00:07<00:31, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##6       | 2.62G/9.97G [00:07<00:31, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:07<00:31, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##6       | 2.69G/9.97G [00:07<00:31, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##7       | 2.75G/9.97G [00:07<00:32, 221MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##7       | 2.75G/9.97G [00:07<00:32, 221MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:08<00:32, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  28%|##8       | 2.82G/9.97G [00:08<00:32, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:08<00:32, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 2.89G/9.97G [00:08<00:32, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|##9       | 2.96G/9.97G [00:08<00:37, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|##9       | 2.96G/9.97G [00:08<00:37, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.03G/9.97G [00:09<00:37, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 3.03G/9.97G [00:09<00:37, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###1      | 3.09G/9.97G [00:09<00:36, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  31%|###1      | 3.09G/9.97G [00:09<00:36, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 3.16G/9.97G [00:10<00:36, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 3.16G/9.97G [00:10<00:36, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.23G/9.97G [00:10<00:35, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###2      | 3.23G/9.97G [00:10<00:35, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:10<00:33, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 3.29G/9.97G [00:10<00:33, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###3      | 3.36G/9.97G [00:10<00:30, 218MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###3      | 3.36G/9.97G [00:10<00:30, 218MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:11<00:28, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  34%|###4      | 3.43G/9.97G [00:11<00:28, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.50G/9.97G [00:11<00:26, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###5      | 3.50G/9.97G [00:11<00:26, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 3.56G/9.97G [00:11<00:25, 249MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###5      | 3.56G/9.97G [00:11<00:25, 249MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.63G/9.97G [00:11<00:24, 254MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 3.63G/9.97G [00:11<00:24, 254MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.70G/9.97G [00:12<00:24, 260MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 3.70G/9.97G [00:12<00:24, 260MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###7      | 3.76G/9.97G [00:12<00:23, 261MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###7      | 3.76G/9.97G [00:12<00:23, 261MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:12<00:23, 266MB/s]
transformer/diffusion_pytorch_model-0000(…):  38%|###8      | 3.83G/9.97G [00:12<00:23, 266MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###9      | 3.90G/9.97G [00:12<00:22, 269MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###9      | 3.90G/9.97G [00:12<00:22, 269MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|###9      | 3.96G/9.97G [00:13<00:22, 268MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|###9      | 3.96G/9.97G [00:13<00:22, 268MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:13<00:22, 270MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 4.03G/9.97G [00:13<00:22, 270MB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:13<00:21, 271MB/s]
transformer/diffusion_pytorch_model-0000(…):  41%|####1     | 4.10G/9.97G [00:13<00:21, 271MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 4.17G/9.97G [00:13<00:21, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 4.17G/9.97G [00:13<00:21, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.24G/9.97G [00:14<00:20, 275MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####2     | 4.24G/9.97G [00:14<00:20, 275MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 4.30G/9.97G [00:14<00:20, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 4.30G/9.97G [00:14<00:20, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.44G/9.97G [00:14<00:17, 322MB/s]
transformer/diffusion_pytorch_model-0000(…):  44%|####4     | 4.44G/9.97G [00:14<00:17, 322MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.51G/9.97G [00:14<00:17, 307MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####5     | 4.51G/9.97G [00:14<00:17, 307MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####5     | 4.57G/9.97G [00:15<00:18, 296MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####5     | 4.57G/9.97G [00:15<00:18, 296MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####6     | 4.64G/9.97G [00:15<00:18, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####6     | 4.64G/9.97G [00:15<00:18, 287MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 4.71G/9.97G [00:15<00:18, 282MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 4.71G/9.97G [00:15<00:18, 282MB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:15<00:18, 281MB/s]
transformer/diffusion_pytorch_model-0000(…):  48%|####7     | 4.77G/9.97G [00:15<00:18, 281MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 4.84G/9.97G [00:16<00:18, 279MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 4.84G/9.97G [00:16<00:18, 279MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####9     | 4.91G/9.97G [00:16<00:18, 277MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####9     | 4.91G/9.97G [00:16<00:18, 277MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:16<00:18, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|####9     | 4.97G/9.97G [00:16<00:18, 274MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:16<00:17, 275MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####     | 5.04G/9.97G [00:16<00:17, 275MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####1    | 5.11G/9.97G [00:17<00:19, 246MB/s]
transformer/diffusion_pytorch_model-0000(…):  51%|#####1    | 5.11G/9.97G [00:17<00:19, 246MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:17<00:24, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 5.17G/9.97G [00:17<00:24, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.31G/9.97G [00:18<00:18, 255MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 5.31G/9.97G [00:18<00:18, 255MB/s]
transformer/diffusion_pytorch_model-0000(…):  54%|#####3    | 5.37G/9.97G [00:18<00:19, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  54%|#####3    | 5.37G/9.97G [00:18<00:19, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:18<00:20, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 5.44G/9.97G [00:18<00:20, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####5    | 5.51G/9.97G [00:19<00:20, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####5    | 5.51G/9.97G [00:19<00:20, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####5    | 5.58G/9.97G [00:19<00:20, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####5    | 5.58G/9.97G [00:19<00:20, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:19<00:20, 212MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####6    | 5.64G/9.97G [00:19<00:20, 212MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:20<00:20, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  57%|#####7    | 5.71G/9.97G [00:20<00:20, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 5.78G/9.97G [00:20<00:19, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 5.78G/9.97G [00:20<00:19, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:20<00:19, 212MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 5.84G/9.97G [00:20<00:19, 212MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:21<00:19, 210MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####9    | 5.91G/9.97G [00:21<00:19, 210MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.98G/9.97G [00:21<00:18, 220MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|#####9    | 5.98G/9.97G [00:21<00:18, 220MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######    | 6.04G/9.97G [00:21<00:18, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######    | 6.04G/9.97G [00:21<00:18, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:22<00:18, 211MB/s]
transformer/diffusion_pytorch_model-0000(…):  61%|######1   | 6.11G/9.97G [00:22<00:18, 211MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.18G/9.97G [00:22<00:18, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 6.18G/9.97G [00:22<00:18, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######2   | 6.24G/9.97G [00:22<00:18, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######2   | 6.24G/9.97G [00:22<00:18, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 6.31G/9.97G [00:23<00:19, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 6.31G/9.97G [00:23<00:19, 191MB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.38G/9.97G [00:23<00:18, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  64%|######3   | 6.38G/9.97G [00:23<00:18, 190MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 6.44G/9.97G [00:23<00:18, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 6.44G/9.97G [00:23<00:18, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:24<00:17, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######5   | 6.51G/9.97G [00:24<00:17, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 6.58G/9.97G [00:24<00:17, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 6.58G/9.97G [00:24<00:17, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:24<00:16, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######6   | 6.64G/9.97G [00:24<00:16, 199MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:25<00:17, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 6.71G/9.97G [00:25<00:17, 188MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.78G/9.97G [00:25<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######7   | 6.78G/9.97G [00:25<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######8   | 6.85G/9.97G [00:25<00:16, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######8   | 6.85G/9.97G [00:25<00:16, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:26<00:15, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  69%|######9   | 6.91G/9.97G [00:26<00:15, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 6.98G/9.97G [00:26<00:15, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 6.98G/9.97G [00:26<00:15, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######   | 7.05G/9.97G [00:26<00:15, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######   | 7.05G/9.97G [00:26<00:15, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:27<00:17, 165MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 7.11G/9.97G [00:27<00:17, 165MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######1  | 7.16G/9.97G [00:27<00:16, 169MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######1  | 7.16G/9.97G [00:27<00:16, 169MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######2  | 7.23G/9.97G [00:28<00:15, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  72%|#######2  | 7.23G/9.97G [00:28<00:15, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######3  | 7.30G/9.97G [00:28<00:14, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######3  | 7.30G/9.97G [00:28<00:14, 186MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######3  | 7.36G/9.97G [00:28<00:13, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######3  | 7.36G/9.97G [00:28<00:13, 189MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######4  | 7.43G/9.97G [00:29<00:13, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######4  | 7.43G/9.97G [00:29<00:13, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######5  | 7.50G/9.97G [00:29<00:12, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  75%|#######5  | 7.50G/9.97G [00:29<00:12, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 7.56G/9.97G [00:29<00:11, 202MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 7.56G/9.97G [00:29<00:11, 202MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######6  | 7.63G/9.97G [00:29<00:11, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######6  | 7.63G/9.97G [00:29<00:11, 207MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 7.70G/9.97G [00:30<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 7.70G/9.97G [00:30<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######7  | 7.77G/9.97G [00:30<00:10, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  78%|#######7  | 7.77G/9.97G [00:30<00:10, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 7.83G/9.97G [00:30<00:10, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 7.83G/9.97G [00:30<00:10, 213MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######9  | 7.90G/9.97G [00:31<00:09, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######9  | 7.90G/9.97G [00:31<00:09, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 7.97G/9.97G [00:31<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 7.97G/9.97G [00:31<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########  | 8.03G/9.97G [00:31<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########  | 8.03G/9.97G [00:31<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 8.10G/9.97G [00:32<00:08, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 8.10G/9.97G [00:32<00:08, 208MB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########1 | 8.17G/9.97G [00:32<00:08, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  82%|########1 | 8.17G/9.97G [00:32<00:08, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.24G/9.97G [00:32<00:08, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 8.24G/9.97G [00:32<00:08, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########3 | 8.30G/9.97G [00:33<00:07, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########3 | 8.30G/9.97G [00:33<00:07, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########3 | 8.37G/9.97G [00:33<00:07, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########3 | 8.37G/9.97G [00:33<00:07, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.44G/9.97G [00:33<00:07, 218MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########4 | 8.44G/9.97G [00:33<00:07, 218MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########5 | 8.50G/9.97G [00:34<00:06, 220MB/s]
transformer/diffusion_pytorch_model-0000(…):  85%|########5 | 8.50G/9.97G [00:34<00:06, 220MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:34<00:06, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 8.57G/9.97G [00:34<00:06, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.64G/9.97G [00:34<00:05, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########6 | 8.64G/9.97G [00:34<00:05, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 8.70G/9.97G [00:34<00:05, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 8.70G/9.97G [00:34<00:05, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:35<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  88%|########7 | 8.77G/9.97G [00:35<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.84G/9.97G [00:35<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 8.84G/9.97G [00:35<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########9 | 8.91G/9.97G [00:35<00:04, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########9 | 8.91G/9.97G [00:35<00:04, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 8.97G/9.97G [00:36<00:04, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 8.97G/9.97G [00:36<00:04, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.04G/9.97G [00:36<00:03, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|######### | 9.04G/9.97G [00:36<00:03, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 9.11G/9.97G [00:36<00:03, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 9.11G/9.97G [00:36<00:03, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  92%|#########1| 9.17G/9.97G [00:36<00:03, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  92%|#########1| 9.17G/9.97G [00:36<00:03, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:37<00:03, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 9.24G/9.97G [00:37<00:03, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########3| 9.31G/9.97G [00:37<00:02, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########3| 9.31G/9.97G [00:37<00:02, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########3| 9.37G/9.97G [00:37<00:02, 256MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########3| 9.37G/9.97G [00:37<00:02, 256MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########4| 9.44G/9.97G [00:37<00:02, 255MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########4| 9.44G/9.97G [00:37<00:02, 255MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:38<00:01, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  95%|#########5| 9.50G/9.97G [00:38<00:01, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 9.57G/9.97G [00:38<00:01, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 9.57G/9.97G [00:38<00:01, 247MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########6| 9.64G/9.97G [00:38<00:01, 248MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########6| 9.64G/9.97G [00:38<00:01, 248MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:39<00:01, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 9.71G/9.97G [00:39<00:01, 241MB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:39<00:00, 297MB/s]
transformer/diffusion_pytorch_model-0000(…):  98%|#########7| 9.77G/9.97G [00:39<00:00, 297MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 9.84G/9.97G [00:39<00:00, 288MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 9.84G/9.97G [00:39<00:00, 288MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########9| 9.91G/9.97G [00:39<00:00, 277MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########9| 9.91G/9.97G [00:39<00:00, 277MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 272MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 272MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 250MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 9.97G/9.97G [00:39<00:00, 250MB/s]


transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/4.67G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 0.00/4.67G [00:00<?, ?B/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 925k/4.67G [00:00<56:32, 1.38MB/s]
transformer/diffusion_pytorch_model-0000(…):   0%|          | 925k/4.67G [00:00<56:32, 1.38MB/s]
transformer/diffusion_pytorch_model-0000(…):   1%|1         | 68.0M/4.67G [00:01<00:54, 84.4MB/s]
transformer/diffusion_pytorch_model-0000(…):   1%|1         | 68.0M/4.67G [00:01<00:54, 84.4MB/s]
transformer/diffusion_pytorch_model-0000(…):   4%|4         | 202M/4.67G [00:01<00:22, 200MB/s]  
transformer/diffusion_pytorch_model-0000(…):   4%|4         | 202M/4.67G [00:01<00:22, 200MB/s]  
transformer/diffusion_pytorch_model-0000(…):   6%|5         | 271M/4.67G [00:01<00:25, 174MB/s]
transformer/diffusion_pytorch_model-0000(…):   6%|5         | 271M/4.67G [00:01<00:25, 174MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 338M/4.67G [00:02<00:27, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):   7%|7         | 338M/4.67G [00:02<00:27, 159MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 405M/4.67G [00:02<00:28, 151MB/s]
transformer/diffusion_pytorch_model-0000(…):   9%|8         | 405M/4.67G [00:02<00:28, 151MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 474M/4.67G [00:03<00:28, 146MB/s]
transformer/diffusion_pytorch_model-0000(…):  10%|#         | 474M/4.67G [00:03<00:28, 146MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#1        | 541M/4.67G [00:03<00:28, 143MB/s]
transformer/diffusion_pytorch_model-0000(…):  12%|#1        | 541M/4.67G [00:03<00:28, 143MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#3        | 608M/4.67G [00:04<00:27, 147MB/s]
transformer/diffusion_pytorch_model-0000(…):  13%|#3        | 608M/4.67G [00:04<00:27, 147MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 675M/4.67G [00:04<00:25, 155MB/s]
transformer/diffusion_pytorch_model-0000(…):  14%|#4        | 675M/4.67G [00:04<00:25, 155MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 742M/4.67G [00:04<00:23, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  16%|#5        | 742M/4.67G [00:04<00:23, 167MB/s]
transformer/diffusion_pytorch_model-0000(…):  17%|#7        | 809M/4.67G [00:05<00:22, 174MB/s]
transformer/diffusion_pytorch_model-0000(…):  17%|#7        | 809M/4.67G [00:05<00:22, 174MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 876M/4.67G [00:05<00:21, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  19%|#8        | 876M/4.67G [00:05<00:21, 179MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 943M/4.67G [00:05<00:20, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  20%|##        | 943M/4.67G [00:05<00:20, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##1       | 1.01G/4.67G [00:06<00:19, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  22%|##1       | 1.01G/4.67G [00:06<00:19, 185MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##3       | 1.08G/4.67G [00:06<00:18, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  23%|##3       | 1.08G/4.67G [00:06<00:18, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 1.14G/4.67G [00:07<00:18, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  24%|##4       | 1.14G/4.67G [00:07<00:18, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 1.21G/4.67G [00:07<00:17, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  26%|##5       | 1.21G/4.67G [00:07<00:17, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##7       | 1.28G/4.67G [00:07<00:17, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  27%|##7       | 1.28G/4.67G [00:07<00:17, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 1.35G/4.67G [00:08<00:17, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  29%|##8       | 1.35G/4.67G [00:08<00:17, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 1.41G/4.67G [00:08<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  30%|###       | 1.41G/4.67G [00:08<00:16, 193MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 1.48G/4.67G [00:08<00:16, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  32%|###1      | 1.48G/4.67G [00:08<00:16, 196MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 1.55G/4.67G [00:09<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  33%|###3      | 1.55G/4.67G [00:09<00:15, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###4      | 1.61G/4.67G [00:09<00:15, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  35%|###4      | 1.61G/4.67G [00:09<00:15, 194MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 1.68G/4.67G [00:09<00:15, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  36%|###6      | 1.68G/4.67G [00:09<00:15, 192MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 1.75G/4.67G [00:10<00:14, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  37%|###7      | 1.75G/4.67G [00:10<00:14, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###8      | 1.82G/4.67G [00:10<00:14, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  39%|###8      | 1.82G/4.67G [00:10<00:14, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 1.88G/4.67G [00:10<00:14, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  40%|####      | 1.88G/4.67G [00:10<00:14, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 1.95G/4.67G [00:11<00:13, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  42%|####1     | 1.95G/4.67G [00:11<00:13, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 2.02G/4.67G [00:11<00:13, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  43%|####3     | 2.02G/4.67G [00:11<00:13, 200MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####4     | 2.08G/4.67G [00:11<00:13, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  45%|####4     | 2.08G/4.67G [00:11<00:13, 197MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 2.15G/4.67G [00:12<00:12, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  46%|####6     | 2.15G/4.67G [00:12<00:12, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 2.22G/4.67G [00:12<00:12, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  47%|####7     | 2.22G/4.67G [00:12<00:12, 195MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 2.28G/4.67G [00:12<00:12, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  49%|####8     | 2.28G/4.67G [00:12<00:12, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|#####     | 2.35G/4.67G [00:13<00:11, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  50%|#####     | 2.35G/4.67G [00:13<00:11, 198MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 2.42G/4.67G [00:13<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  52%|#####1    | 2.42G/4.67G [00:13<00:11, 204MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 2.49G/4.67G [00:13<00:10, 209MB/s]
transformer/diffusion_pytorch_model-0000(…):  53%|#####3    | 2.49G/4.67G [00:13<00:10, 209MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 2.55G/4.67G [00:14<00:10, 209MB/s]
transformer/diffusion_pytorch_model-0000(…):  55%|#####4    | 2.55G/4.67G [00:14<00:10, 209MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####6    | 2.62G/4.67G [00:14<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  56%|#####6    | 2.62G/4.67G [00:14<00:09, 206MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 2.69G/4.67G [00:14<00:09, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  58%|#####7    | 2.69G/4.67G [00:14<00:09, 205MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 2.75G/4.67G [00:15<00:08, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  59%|#####8    | 2.75G/4.67G [00:15<00:08, 215MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|######    | 2.82G/4.67G [00:15<00:08, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  60%|######    | 2.82G/4.67G [00:15<00:08, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 2.89G/4.67G [00:15<00:07, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  62%|######1   | 2.89G/4.67G [00:15<00:07, 226MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 2.96G/4.67G [00:15<00:07, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  63%|######3   | 2.96G/4.67G [00:15<00:07, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 3.02G/4.67G [00:16<00:06, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  65%|######4   | 3.02G/4.67G [00:16<00:06, 236MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 3.06G/4.67G [00:16<00:06, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  66%|######5   | 3.06G/4.67G [00:16<00:06, 242MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 3.13G/4.67G [00:16<00:06, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  67%|######7   | 3.13G/4.67G [00:16<00:06, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######8   | 3.20G/4.67G [00:16<00:06, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  68%|######8   | 3.20G/4.67G [00:16<00:06, 233MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 3.27G/4.67G [00:17<00:06, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  70%|######9   | 3.27G/4.67G [00:17<00:06, 229MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 3.33G/4.67G [00:17<00:05, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  71%|#######1  | 3.33G/4.67G [00:17<00:05, 223MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 3.40G/4.67G [00:17<00:05, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  73%|#######2  | 3.40G/4.67G [00:17<00:05, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 3.47G/4.67G [00:18<00:05, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  74%|#######4  | 3.47G/4.67G [00:18<00:05, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 3.53G/4.67G [00:18<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  76%|#######5  | 3.53G/4.67G [00:18<00:05, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 3.60G/4.67G [00:18<00:04, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  77%|#######7  | 3.60G/4.67G [00:18<00:04, 225MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 3.67G/4.67G [00:18<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  79%|#######8  | 3.67G/4.67G [00:18<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 3.74G/4.67G [00:19<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  80%|#######9  | 3.74G/4.67G [00:19<00:04, 228MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 3.80G/4.67G [00:19<00:03, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  81%|########1 | 3.80G/4.67G [00:19<00:03, 222MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 3.87G/4.67G [00:19<00:03, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  83%|########2 | 3.87G/4.67G [00:19<00:03, 216MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 3.94G/4.67G [00:20<00:03, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  84%|########4 | 3.94G/4.67G [00:20<00:03, 224MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 4.00G/4.67G [00:20<00:03, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  86%|########5 | 4.00G/4.67G [00:20<00:03, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 4.07G/4.67G [00:20<00:02, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  87%|########7 | 4.07G/4.67G [00:20<00:02, 217MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 4.14G/4.67G [00:21<00:02, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  89%|########8 | 4.14G/4.67G [00:21<00:02, 214MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 4.20G/4.67G [00:21<00:02, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  90%|########9 | 4.20G/4.67G [00:21<00:02, 219MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 4.27G/4.67G [00:21<00:01, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  91%|#########1| 4.27G/4.67G [00:21<00:01, 227MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 4.34G/4.67G [00:21<00:01, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  93%|#########2| 4.34G/4.67G [00:21<00:01, 231MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########4| 4.41G/4.67G [00:22<00:01, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  94%|#########4| 4.41G/4.67G [00:22<00:01, 234MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 4.47G/4.67G [00:22<00:00, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  96%|#########5| 4.47G/4.67G [00:22<00:00, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 4.54G/4.67G [00:22<00:00, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  97%|#########7| 4.54G/4.67G [00:22<00:00, 239MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 4.61G/4.67G [00:23<00:00, 240MB/s]
transformer/diffusion_pytorch_model-0000(…):  99%|#########8| 4.61G/4.67G [00:23<00:00, 240MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 242MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 242MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 200MB/s]
transformer/diffusion_pytorch_model-0000(…): 100%|##########| 4.67G/4.67G [00:23<00:00, 200MB/s]


Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:  33%|###3      | 1/3 [00:01<00:02,  1.29s/it]
Loading checkpoint shards:  33%|###3      | 1/3 [00:01<00:02,  1.29s/it]
Loading checkpoint shards:  67%|######6   | 2/3 [00:02<00:01,  1.28s/it]
Loading checkpoint shards:  67%|######6   | 2/3 [00:02<00:01,  1.28s/it]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.03it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.03it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.05s/it]
Loading checkpoint shards: 100%|##########| 3/3 [00:03<00:00,  1.05s/it]

Loading assistant LoRA

zimage_turbo_training_adapter_v2.safeten(…):   0%|          | 0.00/340M [00:00<?, ?B/s]
zimage_turbo_training_adapter_v2.safeten(…):   0%|          | 0.00/340M [00:00<?, ?B/s]
zimage_turbo_training_adapter_v2.safeten(…):  17%|#6        | 56.3M/340M [00:01<00:06, 43.6MB/s]
zimage_turbo_training_adapter_v2.safeten(…):  17%|#6        | 56.3M/340M [00:01<00:06, 43.6MB/s]
zimage_turbo_training_adapter_v2.safeten(…):  54%|#####3    | 182M/340M [00:02<00:01, 94.7MB/s] 
zimage_turbo_training_adapter_v2.safeten(…):  54%|#####3    | 182M/340M [00:02<00:01, 94.7MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 171MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 171MB/s] 
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 136MB/s]
zimage_turbo_training_adapter_v2.safeten(…): 100%|##########| 340M/340M [00:02<00:00, 136MB/s]

create LoRA network. base dim (rank): 64, alpha: 64
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 276 modules.
enable LoRA for U-Net
Merging in assistant LoRA
Missing keys: []
Quantizing Transformer
 - quantizing 30 transformer blocks

  0%|          | 0/30 [00:00<?, ?it/s]
  0%|          | 0/30 [00:00<?, ?it/s]
  3%|3         | 1/30 [00:00<00:05,  5.65it/s]
  3%|3         | 1/30 [00:00<00:05,  5.65it/s]
 10%|#         | 3/30 [00:00<00:02, 10.74it/s]
 10%|#         | 3/30 [00:00<00:02, 10.74it/s]
 17%|#6        | 5/30 [00:00<00:01, 12.82it/s]
 17%|#6        | 5/30 [00:00<00:01, 12.82it/s]
 23%|##3       | 7/30 [00:00<00:01, 13.91it/s]
 23%|##3       | 7/30 [00:00<00:01, 13.91it/s]
 30%|###       | 9/30 [00:00<00:01, 14.54it/s]
 30%|###       | 9/30 [00:00<00:01, 14.54it/s]
 37%|###6      | 11/30 [00:00<00:01, 14.92it/s]
 37%|###6      | 11/30 [00:00<00:01, 14.92it/s]
 43%|####3     | 13/30 [00:01<00:01, 13.08it/s]
 43%|####3     | 13/30 [00:01<00:01, 13.08it/s]
 50%|#####     | 15/30 [00:01<00:01, 11.69it/s]
 50%|#####     | 15/30 [00:01<00:01, 11.69it/s]
 57%|#####6    | 17/30 [00:01<00:01, 10.98it/s]
 57%|#####6    | 17/30 [00:01<00:01, 10.98it/s]
 63%|######3   | 19/30 [00:01<00:01, 10.49it/s]
 63%|######3   | 19/30 [00:01<00:01, 10.49it/s]
 70%|#######   | 21/30 [00:01<00:00,  9.73it/s]
 70%|#######   | 21/30 [00:01<00:00,  9.73it/s]
 77%|#######6  | 23/30 [00:02<00:00,  9.49it/s]
 77%|#######6  | 23/30 [00:02<00:00,  9.49it/s]
 83%|########3 | 25/30 [00:02<00:00,  9.52it/s]
 83%|########3 | 25/30 [00:02<00:00,  9.52it/s]
 87%|########6 | 26/30 [00:02<00:00,  9.54it/s]
 87%|########6 | 26/30 [00:02<00:00,  9.54it/s]
 90%|######### | 27/30 [00:02<00:00,  9.35it/s]
 90%|######### | 27/30 [00:02<00:00,  9.35it/s]
 93%|#########3| 28/30 [00:02<00:00,  9.40it/s]
 93%|#########3| 28/30 [00:02<00:00,  9.40it/s]
 97%|#########6| 29/30 [00:02<00:00,  9.24it/s]
 97%|#########6| 29/30 [00:02<00:00,  9.24it/s]
100%|##########| 30/30 [00:02<00:00, 10.58it/s]
100%|##########| 30/30 [00:02<00:00, 10.58it/s]

 - quantizing extras
Text Encoder

tokenizer_config.json: 0.00B [00:00, ?B/s]
tokenizer_config.json: 0.00B [00:00, ?B/s]
tokenizer_config.json: 9.73kB [00:00, 17.2MB/s]
tokenizer_config.json: 9.73kB [00:00, 17.2MB/s]


vocab.json: 0.00B [00:00, ?B/s]
vocab.json: 0.00B [00:00, ?B/s]
vocab.json: 2.78MB [00:00, 175MB/s]
vocab.json: 2.78MB [00:00, 175MB/s]


merges.txt: 0.00B [00:00, ?B/s]
merges.txt: 0.00B [00:00, ?B/s]
merges.txt: 1.67MB [00:00, 199MB/s]
merges.txt: 1.67MB [00:00, 199MB/s]


tokenizer/tokenizer.json:   0%|          | 0.00/11.4M [00:00<?, ?B/s]
tokenizer/tokenizer.json:   0%|          | 0.00/11.4M [00:00<?, ?B/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 39.1MB/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 39.1MB/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 39.0MB/s]
tokenizer/tokenizer.json: 100%|##########| 11.4M/11.4M [00:00<00:00, 39.0MB/s]

`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

config.json:   0%|          | 0.00/726 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/726 [00:00<?, ?B/s]
config.json: 100%|##########| 726/726 [00:00<00:00, 5.95MB/s]
config.json: 100%|##########| 726/726 [00:00<00:00, 5.95MB/s]


model.safetensors.index.json: 0.00B [00:00, ?B/s]
model.safetensors.index.json: 0.00B [00:00, ?B/s]
model.safetensors.index.json: 32.8kB [00:00, 201MB/s]
model.safetensors.index.json: 32.8kB [00:00, 201MB/s]


text_encoder/model-00001-of-00003.safete(…):   0%|          | 0.00/3.96G [00:00<?, ?B/s]
text_encoder/model-00001-of-00003.safete(…):   0%|          | 0.00/3.96G [00:00<?, ?B/s]
text_encoder/model-00001-of-00003.safete(…):   2%|1         | 67.1M/3.96G [00:00<00:54, 71.4MB/s]
text_encoder/model-00001-of-00003.safete(…):   2%|1         | 67.1M/3.96G [00:00<00:54, 71.4MB/s]
text_encoder/model-00001-of-00003.safete(…):   5%|5         | 201M/3.96G [00:01<00:16, 233MB/s]  
text_encoder/model-00001-of-00003.safete(…):   5%|5         | 201M/3.96G [00:01<00:16, 233MB/s]  
text_encoder/model-00001-of-00003.safete(…):   8%|7         | 308M/3.96G [00:01<00:13, 272MB/s]
text_encoder/model-00001-of-00003.safete(…):   8%|7         | 308M/3.96G [00:01<00:13, 272MB/s]
text_encoder/model-00001-of-00003.safete(…):  15%|#4        | 576M/3.96G [00:01<00:06, 521MB/s]
text_encoder/model-00001-of-00003.safete(…):  15%|#4        | 576M/3.96G [00:01<00:06, 521MB/s]
text_encoder/model-00001-of-00003.safete(…):  18%|#7        | 710M/3.96G [00:01<00:05, 544MB/s]
text_encoder/model-00001-of-00003.safete(…):  18%|#7        | 710M/3.96G [00:01<00:05, 544MB/s]
text_encoder/model-00001-of-00003.safete(…):  21%|##1       | 844M/3.96G [00:02<00:07, 398MB/s]
text_encoder/model-00001-of-00003.safete(…):  21%|##1       | 844M/3.96G [00:02<00:07, 398MB/s]
text_encoder/model-00001-of-00003.safete(…):  25%|##4       | 979M/3.96G [00:02<00:06, 467MB/s]
text_encoder/model-00001-of-00003.safete(…):  25%|##4       | 979M/3.96G [00:02<00:06, 467MB/s]
text_encoder/model-00001-of-00003.safete(…):  27%|##7       | 1.08G/3.96G [00:02<00:06, 421MB/s]
text_encoder/model-00001-of-00003.safete(…):  27%|##7       | 1.08G/3.96G [00:02<00:06, 421MB/s]
text_encoder/model-00001-of-00003.safete(…):  29%|##8       | 1.14G/3.96G [00:02<00:06, 451MB/s]
text_encoder/model-00001-of-00003.safete(…):  29%|##8       | 1.14G/3.96G [00:02<00:06, 451MB/s]
text_encoder/model-00001-of-00003.safete(…):  31%|###       | 1.21G/3.96G [00:03<00:05, 476MB/s]
text_encoder/model-00001-of-00003.safete(…):  31%|###       | 1.21G/3.96G [00:03<00:05, 476MB/s]
text_encoder/model-00001-of-00003.safete(…):  32%|###2      | 1.28G/3.96G [00:03<00:05, 500MB/s]
text_encoder/model-00001-of-00003.safete(…):  32%|###2      | 1.28G/3.96G [00:03<00:05, 500MB/s]
text_encoder/model-00001-of-00003.safete(…):  34%|###3      | 1.34G/3.96G [00:03<00:05, 519MB/s]
text_encoder/model-00001-of-00003.safete(…):  34%|###3      | 1.34G/3.96G [00:03<00:05, 519MB/s]
text_encoder/model-00001-of-00003.safete(…):  36%|###5      | 1.41G/3.96G [00:03<00:04, 545MB/s]
text_encoder/model-00001-of-00003.safete(…):  36%|###5      | 1.41G/3.96G [00:03<00:04, 545MB/s]
text_encoder/model-00001-of-00003.safete(…):  41%|####      | 1.61G/3.96G [00:03<00:02, 881MB/s]
text_encoder/model-00001-of-00003.safete(…):  41%|####      | 1.61G/3.96G [00:03<00:02, 881MB/s]
text_encoder/model-00001-of-00003.safete(…):  46%|####5     | 1.81G/3.96G [00:03<00:01, 1.16GB/s]
text_encoder/model-00001-of-00003.safete(…):  46%|####5     | 1.81G/3.96G [00:03<00:01, 1.16GB/s]
text_encoder/model-00001-of-00003.safete(…):  51%|#####     | 2.01G/3.96G [00:03<00:01, 1.34GB/s]
text_encoder/model-00001-of-00003.safete(…):  51%|#####     | 2.01G/3.96G [00:03<00:01, 1.34GB/s]
text_encoder/model-00001-of-00003.safete(…):  55%|#####5    | 2.18G/3.96G [00:04<00:02, 636MB/s] 
text_encoder/model-00001-of-00003.safete(…):  55%|#####5    | 2.18G/3.96G [00:04<00:02, 636MB/s] 
text_encoder/model-00001-of-00003.safete(…):  60%|######    | 2.38G/3.96G [00:04<00:02, 699MB/s]
text_encoder/model-00001-of-00003.safete(…):  60%|######    | 2.38G/3.96G [00:04<00:02, 699MB/s]
text_encoder/model-00001-of-00003.safete(…):  63%|######3   | 2.51G/3.96G [00:04<00:02, 654MB/s]
text_encoder/model-00001-of-00003.safete(…):  63%|######3   | 2.51G/3.96G [00:04<00:02, 654MB/s]
text_encoder/model-00001-of-00003.safete(…):  67%|######6   | 2.65G/3.96G [00:05<00:02, 494MB/s]
text_encoder/model-00001-of-00003.safete(…):  67%|######6   | 2.65G/3.96G [00:05<00:02, 494MB/s]
text_encoder/model-00001-of-00003.safete(…):  69%|######9   | 2.75G/3.96G [00:05<00:02, 440MB/s]
text_encoder/model-00001-of-00003.safete(…):  69%|######9   | 2.75G/3.96G [00:05<00:02, 440MB/s]
text_encoder/model-00001-of-00003.safete(…):  71%|#######1  | 2.82G/3.96G [00:05<00:02, 407MB/s]
text_encoder/model-00001-of-00003.safete(…):  71%|#######1  | 2.82G/3.96G [00:05<00:02, 407MB/s]
text_encoder/model-00001-of-00003.safete(…):  73%|#######2  | 2.88G/3.96G [00:05<00:02, 380MB/s]
text_encoder/model-00001-of-00003.safete(…):  73%|#######2  | 2.88G/3.96G [00:05<00:02, 380MB/s]
text_encoder/model-00001-of-00003.safete(…):  75%|#######4  | 2.95G/3.96G [00:06<00:02, 356MB/s]
text_encoder/model-00001-of-00003.safete(…):  75%|#######4  | 2.95G/3.96G [00:06<00:02, 356MB/s]
text_encoder/model-00001-of-00003.safete(…):  76%|#######6  | 3.02G/3.96G [00:06<00:02, 339MB/s]
text_encoder/model-00001-of-00003.safete(…):  76%|#######6  | 3.02G/3.96G [00:06<00:02, 339MB/s]
text_encoder/model-00001-of-00003.safete(…):  78%|#######7  | 3.09G/3.96G [00:06<00:02, 329MB/s]
text_encoder/model-00001-of-00003.safete(…):  78%|#######7  | 3.09G/3.96G [00:06<00:02, 329MB/s]
text_encoder/model-00001-of-00003.safete(…):  80%|#######9  | 3.15G/3.96G [00:06<00:02, 321MB/s]
text_encoder/model-00001-of-00003.safete(…):  80%|#######9  | 3.15G/3.96G [00:06<00:02, 321MB/s]
text_encoder/model-00001-of-00003.safete(…):  81%|########1 | 3.22G/3.96G [00:07<00:02, 313MB/s]
text_encoder/model-00001-of-00003.safete(…):  81%|########1 | 3.22G/3.96G [00:07<00:02, 313MB/s]
text_encoder/model-00001-of-00003.safete(…):  83%|########3 | 3.29G/3.96G [00:07<00:02, 306MB/s]
text_encoder/model-00001-of-00003.safete(…):  83%|########3 | 3.29G/3.96G [00:07<00:02, 306MB/s]
text_encoder/model-00001-of-00003.safete(…):  85%|########4 | 3.35G/3.96G [00:07<00:02, 301MB/s]
text_encoder/model-00001-of-00003.safete(…):  85%|########4 | 3.35G/3.96G [00:07<00:02, 301MB/s]
text_encoder/model-00001-of-00003.safete(…):  86%|########6 | 3.42G/3.96G [00:07<00:01, 299MB/s]
text_encoder/model-00001-of-00003.safete(…):  86%|########6 | 3.42G/3.96G [00:07<00:01, 299MB/s]
text_encoder/model-00001-of-00003.safete(…):  88%|########8 | 3.49G/3.96G [00:08<00:01, 300MB/s]
text_encoder/model-00001-of-00003.safete(…):  88%|########8 | 3.49G/3.96G [00:08<00:01, 300MB/s]
text_encoder/model-00001-of-00003.safete(…):  90%|########9 | 3.56G/3.96G [00:08<00:01, 300MB/s]
text_encoder/model-00001-of-00003.safete(…):  90%|########9 | 3.56G/3.96G [00:08<00:01, 300MB/s]
text_encoder/model-00001-of-00003.safete(…):  92%|#########1| 3.62G/3.96G [00:08<00:01, 297MB/s]
text_encoder/model-00001-of-00003.safete(…):  92%|#########1| 3.62G/3.96G [00:08<00:01, 297MB/s]
text_encoder/model-00001-of-00003.safete(…):  93%|#########3| 3.69G/3.96G [00:08<00:00, 296MB/s]
text_encoder/model-00001-of-00003.safete(…):  93%|#########3| 3.69G/3.96G [00:08<00:00, 296MB/s]
text_encoder/model-00001-of-00003.safete(…):  95%|#########4| 3.76G/3.96G [00:08<00:00, 296MB/s]
text_encoder/model-00001-of-00003.safete(…):  95%|#########4| 3.76G/3.96G [00:08<00:00, 296MB/s]
text_encoder/model-00001-of-00003.safete(…):  97%|#########6| 3.82G/3.96G [00:09<00:00, 295MB/s]
text_encoder/model-00001-of-00003.safete(…):  97%|#########6| 3.82G/3.96G [00:09<00:00, 295MB/s]
text_encoder/model-00001-of-00003.safete(…):  98%|#########8| 3.89G/3.96G [00:09<00:00, 295MB/s]
text_encoder/model-00001-of-00003.safete(…):  98%|#########8| 3.89G/3.96G [00:09<00:00, 295MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:09<00:00, 421MB/s]
text_encoder/model-00001-of-00003.safete(…): 100%|##########| 3.96G/3.96G [00:09<00:00, 421MB/s]


text_encoder/model-00002-of-00003.safete(…):   0%|          | 0.00/3.99G [00:00<?, ?B/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 0.00/3.99G [00:00<?, ?B/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 675k/3.99G [00:00<30:18, 2.19MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 675k/3.99G [00:00<30:18, 2.19MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 2.07M/3.99G [00:00<14:49, 4.48MB/s]
text_encoder/model-00002-of-00003.safete(…):   0%|          | 2.07M/3.99G [00:00<14:49, 4.48MB/s]
text_encoder/model-00002-of-00003.safete(…):   3%|3         | 136M/3.99G [00:00<00:16, 232MB/s]  
text_encoder/model-00002-of-00003.safete(…):   3%|3         | 136M/3.99G [00:00<00:16, 232MB/s]  
text_encoder/model-00002-of-00003.safete(…):   5%|5         | 203M/3.99G [00:01<00:15, 248MB/s]
text_encoder/model-00002-of-00003.safete(…):   5%|5         | 203M/3.99G [00:01<00:15, 248MB/s]
text_encoder/model-00002-of-00003.safete(…):   7%|6         | 270M/3.99G [00:01<00:15, 233MB/s]
text_encoder/model-00002-of-00003.safete(…):   7%|6         | 270M/3.99G [00:01<00:15, 233MB/s]
text_encoder/model-00002-of-00003.safete(…):   8%|8         | 337M/3.99G [00:01<00:18, 195MB/s]
text_encoder/model-00002-of-00003.safete(…):   8%|8         | 337M/3.99G [00:01<00:18, 195MB/s]
text_encoder/model-00002-of-00003.safete(…):  10%|#         | 404M/3.99G [00:02<00:20, 178MB/s]
text_encoder/model-00002-of-00003.safete(…):  10%|#         | 404M/3.99G [00:02<00:20, 178MB/s]
text_encoder/model-00002-of-00003.safete(…):  12%|#1        | 473M/3.99G [00:02<00:20, 174MB/s]
text_encoder/model-00002-of-00003.safete(…):  12%|#1        | 473M/3.99G [00:02<00:20, 174MB/s]
text_encoder/model-00002-of-00003.safete(…):  14%|#3        | 540M/3.99G [00:03<00:20, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  14%|#3        | 540M/3.99G [00:03<00:20, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  15%|#5        | 608M/3.99G [00:03<00:20, 164MB/s]
text_encoder/model-00002-of-00003.safete(…):  15%|#5        | 608M/3.99G [00:03<00:20, 164MB/s]
text_encoder/model-00002-of-00003.safete(…):  17%|#6        | 675M/3.99G [00:03<00:20, 165MB/s]
text_encoder/model-00002-of-00003.safete(…):  17%|#6        | 675M/3.99G [00:03<00:20, 165MB/s]
text_encoder/model-00002-of-00003.safete(…):  19%|#8        | 742M/3.99G [00:04<00:19, 168MB/s]
text_encoder/model-00002-of-00003.safete(…):  19%|#8        | 742M/3.99G [00:04<00:19, 168MB/s]
text_encoder/model-00002-of-00003.safete(…):  20%|##        | 809M/3.99G [00:04<00:18, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  20%|##        | 809M/3.99G [00:04<00:18, 169MB/s]
text_encoder/model-00002-of-00003.safete(…):  22%|##1       | 876M/3.99G [00:05<00:18, 168MB/s]
text_encoder/model-00002-of-00003.safete(…):  22%|##1       | 876M/3.99G [00:05<00:18, 168MB/s]
text_encoder/model-00002-of-00003.safete(…):  24%|##3       | 943M/3.99G [00:05<00:17, 171MB/s]
text_encoder/model-00002-of-00003.safete(…):  24%|##3       | 943M/3.99G [00:05<00:17, 171MB/s]
text_encoder/model-00002-of-00003.safete(…):  25%|##5       | 1.01G/3.99G [00:05<00:16, 176MB/s]
text_encoder/model-00002-of-00003.safete(…):  25%|##5       | 1.01G/3.99G [00:05<00:16, 176MB/s]
text_encoder/model-00002-of-00003.safete(…):  27%|##7       | 1.08G/3.99G [00:06<00:15, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  27%|##7       | 1.08G/3.99G [00:06<00:15, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  29%|##8       | 1.14G/3.99G [00:06<00:14, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  29%|##8       | 1.14G/3.99G [00:06<00:14, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  30%|###       | 1.21G/3.99G [00:06<00:14, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  30%|###       | 1.21G/3.99G [00:06<00:14, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  32%|###2      | 1.28G/3.99G [00:07<00:14, 191MB/s]
text_encoder/model-00002-of-00003.safete(…):  32%|###2      | 1.28G/3.99G [00:07<00:14, 191MB/s]
text_encoder/model-00002-of-00003.safete(…):  34%|###3      | 1.35G/3.99G [00:07<00:14, 184MB/s]
text_encoder/model-00002-of-00003.safete(…):  34%|###3      | 1.35G/3.99G [00:07<00:14, 184MB/s]
text_encoder/model-00002-of-00003.safete(…):  35%|###5      | 1.41G/3.99G [00:07<00:14, 180MB/s]
text_encoder/model-00002-of-00003.safete(…):  35%|###5      | 1.41G/3.99G [00:07<00:14, 180MB/s]
text_encoder/model-00002-of-00003.safete(…):  37%|###7      | 1.48G/3.99G [00:08<00:13, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  37%|###7      | 1.48G/3.99G [00:08<00:13, 185MB/s]
text_encoder/model-00002-of-00003.safete(…):  39%|###8      | 1.55G/3.99G [00:08<00:12, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  39%|###8      | 1.55G/3.99G [00:08<00:12, 190MB/s]
text_encoder/model-00002-of-00003.safete(…):  40%|####      | 1.61G/3.99G [00:08<00:12, 197MB/s]
text_encoder/model-00002-of-00003.safete(…):  40%|####      | 1.61G/3.99G [00:08<00:12, 197MB/s]
text_encoder/model-00002-of-00003.safete(…):  42%|####2     | 1.68G/3.99G [00:09<00:11, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  42%|####2     | 1.68G/3.99G [00:09<00:11, 193MB/s]
text_encoder/model-00002-of-00003.safete(…):  44%|####3     | 1.75G/3.99G [00:09<00:11, 192MB/s]
text_encoder/model-00002-of-00003.safete(…):  44%|####3     | 1.75G/3.99G [00:09<00:11, 192MB/s]
text_encoder/model-00002-of-00003.safete(…):  45%|####5     | 1.81G/3.99G [00:09<00:11, 197MB/s]
text_encoder/model-00002-of-00003.safete(…):  45%|####5     | 1.81G/3.99G [00:09<00:11, 197MB/s]
text_encoder/model-00002-of-00003.safete(…):  47%|####7     | 1.88G/3.99G [00:10<00:10, 199MB/s]
text_encoder/model-00002-of-00003.safete(…):  47%|####7     | 1.88G/3.99G [00:10<00:10, 199MB/s]
text_encoder/model-00002-of-00003.safete(…):  49%|####8     | 1.95G/3.99G [00:10<00:10, 198MB/s]
text_encoder/model-00002-of-00003.safete(…):  49%|####8     | 1.95G/3.99G [00:10<00:10, 198MB/s]
text_encoder/model-00002-of-00003.safete(…):  51%|#####     | 2.02G/3.99G [00:11<00:10, 192MB/s]
text_encoder/model-00002-of-00003.safete(…):  51%|#####     | 2.02G/3.99G [00:11<00:10, 192MB/s]
text_encoder/model-00002-of-00003.safete(…):  52%|#####2    | 2.08G/3.99G [00:11<00:09, 191MB/s]
text_encoder/model-00002-of-00003.safete(…):  52%|#####2    | 2.08G/3.99G [00:11<00:09, 191MB/s]
text_encoder/model-00002-of-00003.safete(…):  54%|#####3    | 2.15G/3.99G [00:11<00:09, 198MB/s]
text_encoder/model-00002-of-00003.safete(…):  54%|#####3    | 2.15G/3.99G [00:11<00:09, 198MB/s]
text_encoder/model-00002-of-00003.safete(…):  56%|#####5    | 2.22G/3.99G [00:12<00:08, 202MB/s]
text_encoder/model-00002-of-00003.safete(…):  56%|#####5    | 2.22G/3.99G [00:12<00:08, 202MB/s]
text_encoder/model-00002-of-00003.safete(…):  57%|#####7    | 2.28G/3.99G [00:12<00:09, 175MB/s]
text_encoder/model-00002-of-00003.safete(…):  57%|#####7    | 2.28G/3.99G [00:12<00:09, 175MB/s]
text_encoder/model-00002-of-00003.safete(…):  59%|#####8    | 2.35G/3.99G [00:12<00:09, 166MB/s]
text_encoder/model-00002-of-00003.safete(…):  59%|#####8    | 2.35G/3.99G [00:12<00:09, 166MB/s]
text_encoder/model-00002-of-00003.safete(…):  61%|######    | 2.42G/3.99G [00:13<00:09, 161MB/s]
text_encoder/model-00002-of-00003.safete(…):  61%|######    | 2.42G/3.99G [00:13<00:09, 161MB/s]
text_encoder/model-00002-of-00003.safete(…):  62%|######2   | 2.48G/3.99G [00:13<00:09, 159MB/s]
text_encoder/model-00002-of-00003.safete(…):  62%|######2   | 2.48G/3.99G [00:13<00:09, 159MB/s]
text_encoder/model-00002-of-00003.safete(…):  63%|######3   | 2.51G/3.99G [00:14<00:09, 155MB/s]
text_encoder/model-00002-of-00003.safete(…):  63%|######3   | 2.51G/3.99G [00:14<00:09, 155MB/s]
text_encoder/model-00002-of-00003.safete(…):  65%|######4   | 2.58G/3.99G [00:14<00:09, 153MB/s]
text_encoder/model-00002-of-00003.safete(…):  65%|######4   | 2.58G/3.99G [00:14<00:09, 153MB/s]
text_encoder/model-00002-of-00003.safete(…):  66%|######6   | 2.65G/3.99G [00:14<00:08, 162MB/s]
text_encoder/model-00002-of-00003.safete(…):  66%|######6   | 2.65G/3.99G [00:14<00:08, 162MB/s]
text_encoder/model-00002-of-00003.safete(…):  68%|######8   | 2.72G/3.99G [00:15<00:07, 179MB/s]
text_encoder/model-00002-of-00003.safete(…):  68%|######8   | 2.72G/3.99G [00:15<00:07, 179MB/s]
text_encoder/model-00002-of-00003.safete(…):  70%|######9   | 2.78G/3.99G [00:15<00:06, 194MB/s]
text_encoder/model-00002-of-00003.safete(…):  70%|######9   | 2.78G/3.99G [00:15<00:06, 194MB/s]
text_encoder/model-00002-of-00003.safete(…):  71%|#######1  | 2.85G/3.99G [00:15<00:05, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  71%|#######1  | 2.85G/3.99G [00:15<00:05, 200MB/s]
text_encoder/model-00002-of-00003.safete(…):  73%|#######3  | 2.92G/3.99G [00:16<00:04, 215MB/s]
text_encoder/model-00002-of-00003.safete(…):  73%|#######3  | 2.92G/3.99G [00:16<00:04, 215MB/s]
text_encoder/model-00002-of-00003.safete(…):  75%|#######4  | 2.98G/3.99G [00:16<00:04, 219MB/s]
text_encoder/model-00002-of-00003.safete(…):  75%|#######4  | 2.98G/3.99G [00:16<00:04, 219MB/s]
text_encoder/model-00002-of-00003.safete(…):  77%|#######6  | 3.05G/3.99G [00:16<00:04, 226MB/s]
text_encoder/model-00002-of-00003.safete(…):  77%|#######6  | 3.05G/3.99G [00:16<00:04, 226MB/s]
text_encoder/model-00002-of-00003.safete(…):  78%|#######8  | 3.12G/3.99G [00:16<00:03, 229MB/s]
text_encoder/model-00002-of-00003.safete(…):  78%|#######8  | 3.12G/3.99G [00:16<00:03, 229MB/s]
text_encoder/model-00002-of-00003.safete(…):  80%|#######9  | 3.18G/3.99G [00:17<00:03, 234MB/s]
text_encoder/model-00002-of-00003.safete(…):  80%|#######9  | 3.18G/3.99G [00:17<00:03, 234MB/s]
text_encoder/model-00002-of-00003.safete(…):  82%|########1 | 3.25G/3.99G [00:17<00:03, 235MB/s]
text_encoder/model-00002-of-00003.safete(…):  82%|########1 | 3.25G/3.99G [00:17<00:03, 235MB/s]
text_encoder/model-00002-of-00003.safete(…):  83%|########3 | 3.32G/3.99G [00:17<00:02, 227MB/s]
text_encoder/model-00002-of-00003.safete(…):  83%|########3 | 3.32G/3.99G [00:17<00:02, 227MB/s]
text_encoder/model-00002-of-00003.safete(…):  85%|########4 | 3.39G/3.99G [00:18<00:02, 236MB/s]
text_encoder/model-00002-of-00003.safete(…):  85%|########4 | 3.39G/3.99G [00:18<00:02, 236MB/s]
text_encoder/model-00002-of-00003.safete(…):  90%|########9 | 3.59G/3.99G [00:18<00:00, 403MB/s]
text_encoder/model-00002-of-00003.safete(…):  90%|########9 | 3.59G/3.99G [00:18<00:00, 403MB/s]
text_encoder/model-00002-of-00003.safete(…):  93%|#########3| 3.72G/3.99G [00:18<00:00, 414MB/s]
text_encoder/model-00002-of-00003.safete(…):  93%|#########3| 3.72G/3.99G [00:18<00:00, 414MB/s]
text_encoder/model-00002-of-00003.safete(…):  95%|#########4| 3.79G/3.99G [00:18<00:00, 367MB/s]
text_encoder/model-00002-of-00003.safete(…):  95%|#########4| 3.79G/3.99G [00:18<00:00, 367MB/s]
text_encoder/model-00002-of-00003.safete(…):  97%|#########6| 3.85G/3.99G [00:19<00:00, 325MB/s]
text_encoder/model-00002-of-00003.safete(…):  97%|#########6| 3.85G/3.99G [00:19<00:00, 325MB/s]
text_encoder/model-00002-of-00003.safete(…):  98%|#########8| 3.92G/3.99G [00:19<00:00, 303MB/s]
text_encoder/model-00002-of-00003.safete(…):  98%|#########8| 3.92G/3.99G [00:19<00:00, 303MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:19<00:00, 285MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:19<00:00, 285MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:19<00:00, 203MB/s]
text_encoder/model-00002-of-00003.safete(…): 100%|##########| 3.99G/3.99G [00:19<00:00, 203MB/s]


text_encoder/model-00003-of-00003.safete(…):   0%|          | 0.00/99.6M [00:00<?, ?B/s]
text_encoder/model-00003-of-00003.safete(…):   0%|          | 0.00/99.6M [00:00<?, ?B/s]
text_encoder/model-00003-of-00003.safete(…):  38%|###7      | 37.6M/99.6M [00:00<00:00, 135MB/s]
text_encoder/model-00003-of-00003.safete(…):  38%|###7      | 37.6M/99.6M [00:00<00:00, 135MB/s]
text_encoder/model-00003-of-00003.safete(…):  58%|#####7    | 57.8M/99.6M [00:00<00:00, 106MB/s]
text_encoder/model-00003-of-00003.safete(…):  58%|#####7    | 57.8M/99.6M [00:00<00:00, 106MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 145MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 145MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 135MB/s]
text_encoder/model-00003-of-00003.safete(…): 100%|##########| 99.6M/99.6M [00:00<00:00, 135MB/s]


Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 70.42it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 70.42it/s]


generation_config.json:   0%|          | 0.00/239 [00:00<?, ?B/s]
generation_config.json:   0%|          | 0.00/239 [00:00<?, ?B/s]
generation_config.json: 100%|##########| 239/239 [00:00<00:00, 1.70MB/s]
generation_config.json: 100%|##########| 239/239 [00:00<00:00, 1.70MB/s]

Quantizing Text Encoder
Loading VAE

config.json:   0%|          | 0.00/805 [00:00<?, ?B/s]
config.json:   0%|          | 0.00/805 [00:00<?, ?B/s]
config.json: 100%|##########| 805/805 [00:00<00:00, 7.45MB/s]
config.json: 100%|##########| 805/805 [00:00<00:00, 7.45MB/s]


vae/diffusion_pytorch_model.safetensors:   0%|          | 0.00/168M [00:00<?, ?B/s]
vae/diffusion_pytorch_model.safetensors:   0%|          | 0.00/168M [00:00<?, ?B/s]
vae/diffusion_pytorch_model.safetensors:  20%|#9        | 33.5M/168M [00:00<00:02, 64.7MB/s]
vae/diffusion_pytorch_model.safetensors:  20%|#9        | 33.5M/168M [00:00<00:02, 64.7MB/s]
vae/diffusion_pytorch_model.safetensors:  60%|#####9    | 101M/168M [00:00<00:00, 122MB/s]  
vae/diffusion_pytorch_model.safetensors:  60%|#####9    | 101M/168M [00:00<00:00, 122MB/s]  
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:01<00:00, 179MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:01<00:00, 179MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:01<00:00, 151MB/s]
vae/diffusion_pytorch_model.safetensors: 100%|##########| 168M/168M [00:01<00:00, 151MB/s]

Making pipe
Preparing Model
Model Loaded
create LoRA network. base dim (rank): 32, alpha: 32
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
apply LoRA to Conv2d with kernel size (3,3). dim (rank): 16, alpha: 16
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 240 modules.
enable LoRA for U-Net
Dataset: /data/app/datasets/a_cold_wall
  -  Preprocessing image dimensions

  0%|          | 0/35 [00:00<?, ?it/s]
  0%|          | 0/35 [00:00<?, ?it/s]
  3%|2         | 1/35 [00:00<00:06,  5.31it/s]
  3%|2         | 1/35 [00:00<00:06,  5.31it/s]
  6%|5         | 2/35 [00:00<00:05,  5.77it/s]
  6%|5         | 2/35 [00:00<00:05,  5.77it/s]
  9%|8         | 3/35 [00:00<00:05,  6.25it/s]
  9%|8         | 3/35 [00:00<00:05,  6.25it/s]
 11%|#1        | 4/35 [00:00<00:05,  6.07it/s]
 11%|#1        | 4/35 [00:00<00:05,  6.07it/s]
 14%|#4        | 5/35 [00:00<00:04,  6.29it/s]
 14%|#4        | 5/35 [00:00<00:04,  6.29it/s]
 17%|#7        | 6/35 [00:00<00:04,  6.48it/s]
 17%|#7        | 6/35 [00:00<00:04,  6.48it/s]
 20%|##        | 7/35 [00:01<00:03,  7.02it/s]
 20%|##        | 7/35 [00:01<00:03,  7.02it/s]
 23%|##2       | 8/35 [00:01<00:04,  6.44it/s]
 23%|##2       | 8/35 [00:01<00:04,  6.44it/s]
 26%|##5       | 9/35 [00:01<00:04,  6.04it/s]
 26%|##5       | 9/35 [00:01<00:04,  6.04it/s]
 29%|##8       | 10/35 [00:01<00:04,  5.98it/s]
 29%|##8       | 10/35 [00:01<00:04,  5.98it/s]
 31%|###1      | 11/35 [00:01<00:04,  5.21it/s]
 31%|###1      | 11/35 [00:01<00:04,  5.21it/s]
 34%|###4      | 12/35 [00:02<00:04,  5.72it/s]
 34%|###4      | 12/35 [00:02<00:04,  5.72it/s]
 37%|###7      | 13/35 [00:02<00:03,  6.07it/s]
 37%|###7      | 13/35 [00:02<00:03,  6.07it/s]
 40%|####      | 14/35 [00:02<00:03,  5.95it/s]
 40%|####      | 14/35 [00:02<00:03,  5.95it/s]
 43%|####2     | 15/35 [00:02<00:03,  6.06it/s]
 43%|####2     | 15/35 [00:02<00:03,  6.06it/s]
 46%|####5     | 16/35 [00:02<00:03,  6.28it/s]
 46%|####5     | 16/35 [00:02<00:03,  6.28it/s]
 49%|####8     | 17/35 [00:02<00:02,  6.02it/s]
 49%|####8     | 17/35 [00:02<00:02,  6.02it/s]
 51%|#####1    | 18/35 [00:02<00:02,  6.03it/s]
 51%|#####1    | 18/35 [00:02<00:02,  6.03it/s]
 54%|#####4    | 19/35 [00:03<00:02,  5.75it/s]
 54%|#####4    | 19/35 [00:03<00:02,  5.75it/s]
 57%|#####7    | 20/35 [00:03<00:02,  5.67it/s]
 57%|#####7    | 20/35 [00:03<00:02,  5.67it/s]
 60%|######    | 21/35 [00:03<00:02,  5.34it/s]
 60%|######    | 21/35 [00:03<00:02,  5.34it/s]
 63%|######2   | 22/35 [00:03<00:02,  4.36it/s]
 63%|######2   | 22/35 [00:03<00:02,  4.36it/s]
 66%|######5   | 23/35 [00:04<00:02,  4.86it/s]
 66%|######5   | 23/35 [00:04<00:02,  4.86it/s]
 69%|######8   | 24/35 [00:04<00:02,  5.08it/s]
 69%|######8   | 24/35 [00:04<00:02,  5.08it/s]
 71%|#######1  | 25/35 [00:04<00:01,  5.50it/s]
 71%|#######1  | 25/35 [00:04<00:01,  5.50it/s]
 74%|#######4  | 26/35 [00:04<00:01,  5.66it/s]
 74%|#######4  | 26/35 [00:04<00:01,  5.66it/s]
 77%|#######7  | 27/35 [00:04<00:01,  5.61it/s]
 77%|#######7  | 27/35 [00:04<00:01,  5.61it/s]
 80%|########  | 28/35 [00:04<00:01,  5.86it/s]
 80%|########  | 28/35 [00:04<00:01,  5.86it/s]
 83%|########2 | 29/35 [00:04<00:00,  6.27it/s]
 83%|########2 | 29/35 [00:04<00:00,  6.27it/s]
 86%|########5 | 30/35 [00:05<00:00,  6.05it/s]
 86%|########5 | 30/35 [00:05<00:00,  6.05it/s]
 89%|########8 | 31/35 [00:05<00:00,  5.87it/s]
 89%|########8 | 31/35 [00:05<00:00,  5.87it/s]
 91%|#########1| 32/35 [00:05<00:00,  5.87it/s]
 91%|#########1| 32/35 [00:05<00:00,  5.87it/s]
 94%|#########4| 33/35 [00:05<00:00,  6.29it/s]
 94%|#########4| 33/35 [00:05<00:00,  6.29it/s]
 97%|#########7| 34/35 [00:05<00:00,  5.78it/s]
 97%|#########7| 34/35 [00:05<00:00,  5.78it/s]
100%|##########| 35/35 [00:05<00:00,  6.47it/s]
100%|##########| 35/35 [00:05<00:00,  6.47it/s]
100%|##########| 35/35 [00:05<00:00,  5.86it/s]
100%|##########| 35/35 [00:05<00:00,  5.86it/s]

  -  Found 35 images
Bucket sizes for /data/app/datasets/a_cold_wall:
416x608: 35 files
1 buckets made
Dataset: /data/app/datasets/a_cold_wall
  -  Preprocessing image dimensions

  0%|          | 0/35 [00:00<?, ?it/s]
  0%|          | 0/35 [00:00<?, ?it/s]
100%|##########| 35/35 [00:00<00:00, 11866.51it/s]
100%|##########| 35/35 [00:00<00:00, 11866.51it/s]

  -  Found 35 images
Bucket sizes for /data/app/datasets/a_cold_wall:
608x896: 34 files
480x736: 1 files
2 buckets made
Dataset: /data/app/datasets/a_cold_wall
  -  Preprocessing image dimensions

  0%|          | 0/35 [00:00<?, ?it/s]
  0%|          | 0/35 [00:00<?, ?it/s]
100%|##########| 35/35 [00:00<00:00, 41492.55it/s]
100%|##########| 35/35 [00:00<00:00, 41492.55it/s]

  -  Found 35 images
Bucket sizes for /data/app/datasets/a_cold_wall:
832x1216: 34 files
480x736: 1 files
2 buckets made
Skipping first sample due to config setting

a-cold-wall:   0%|          | 0/3000 [00:00<?, ?it/s]
a-cold-wall:   0%|          | 0/3000 [00:00<?, ?it/s]
a-cold-wall:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 8.519e-02]
a-cold-wall:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 8.519e-02]
a-cold-wall:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 8.519e-02]
a-cold-wall:   0%|          | 0/3000 [00:01<?, ?it/s, lr: 1.0e-04 loss: 8.519e-02]
a-cold-wall:   0%|          | 0/3000 [00:02<?, ?it/s, lr: 1.0e-04 loss: 4.021e-01]
a-cold-wall:   0%|          | 0/3000 [00:02<?, ?it/s, lr: 1.0e-04 loss: 4.021e-01]
a-cold-wall:   0%|          | 1/3000 [00:02<47:53,  1.04it/s, lr: 1.0e-04 loss: 4.021e-01]
a-cold-wall:   0%|          | 1/3000 [00:02<47:53,  1.04it/s, lr: 1.0e-04 loss: 4.021e-01]
a-cold-wall:   0%|          | 1/3000 [00:05<47:53,  1.04it/s, lr: 1.0e-04 loss: 6.013e-01]
a-cold-wall:   0%|          | 1/3000 [00:05<47:53,  1.04it/s, lr: 1.0e-04 loss: 6.013e-01]
a-cold-wall:   0%|          | 2/3000 [00:05<1:48:01,  2.16s/it, lr: 1.0e-04 loss: 6.013e-01]
a-cold-wall:   0%|          | 2/3000 [00:05<1:48:01,  2.16s/it, lr: 1.0e-04 loss: 6.013e-01]
a-cold-wall:   0%|          | 2/3000 [00:08<1:48:01,  2.16s/it, lr: 1.0e-04 loss: 6.943e-02]
a-cold-wall:   0%|          | 2/3000 [00:08<1:48:01,  2.16s/it, lr: 1.0e-04 loss: 6.943e-02]
a-cold-wall:   0%|          | 3/3000 [00:08<2:05:58,  2.52s/it, lr: 1.0e-04 loss: 6.943e-02]
a-cold-wall:   0%|          | 3/3000 [00:08<2:05:58,  2.52s/it, lr: 1.0e-04 loss: 6.943e-02]
a-cold-wall:   0%|          | 3/3000 [00:11<2:05:58,  2.52s/it, lr: 1.0e-04 loss: 2.421e-01]
a-cold-wall:   0%|          | 3/3000 [00:11<2:05:58,  2.52s/it, lr: 1.0e-04 loss: 2.421e-01]
a-cold-wall:   0%|          | 4/3000 [00:11<2:15:30,  2.71s/it, lr: 1.0e-04 loss: 2.421e-01]
a-cold-wall:   0%|          | 4/3000 [00:11<2:15:30,  2.71s/it, lr: 1.0e-04 loss: 2.421e-01]
a-cold-wall:   0%|          | 4/3000 [00:14<2:15:30,  2.71s/it, lr: 1.0e-04 loss: 4.450e-01]
a-cold-wall:   0%|          | 4/3000 [00:14<2:15:30,  2.71s/it, lr: 1.0e-04 loss: 4.450e-01]
a-cold-wall:   0%|          | 5/3000 [00:14<2:20:25,  2.81s/it, lr: 1.0e-04 loss: 4.450e-01]
a-cold-wall:   0%|          | 5/3000 [00:14<2:20:25,  2.81s/it, lr: 1.0e-04 loss: 4.450e-01]
a-cold-wall:   0%|          | 5/3000 [00:17<2:20:25,  2.81s/it, lr: 1.0e-04 loss: 2.033e-01]
a-cold-wall:   0%|          | 5/3000 [00:17<2:20:25,  2.81s/it, lr: 1.0e-04 loss: 2.033e-01]
a-cold-wall:   0%|          | 6/3000 [00:17<2:23:23,  2.87s/it, lr: 1.0e-04 loss: 2.033e-01]
a-cold-wall:   0%|          | 6/3000 [00:17<2:23:23,  2.87s/it, lr: 1.0e-04 loss: 2.033e-01]
a-cold-wall:   0%|          | 6/3000 [00:20<2:23:23,  2.87s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:   0%|          | 6/3000 [00:20<2:23:23,  2.87s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:   0%|          | 7/3000 [00:20<2:26:02,  2.93s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:   0%|          | 7/3000 [00:20<2:26:02,  2.93s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:   0%|          | 7/3000 [00:23<2:26:02,  2.93s/it, lr: 1.0e-04 loss: 9.001e-01]
a-cold-wall:   0%|          | 7/3000 [00:23<2:26:02,  2.93s/it, lr: 1.0e-04 loss: 9.001e-01]
a-cold-wall:   0%|          | 8/3000 [00:23<2:27:09,  2.95s/it, lr: 1.0e-04 loss: 9.001e-01]
a-cold-wall:   0%|          | 8/3000 [00:23<2:27:09,  2.95s/it, lr: 1.0e-04 loss: 9.001e-01]
a-cold-wall:   0%|          | 8/3000 [00:24<2:27:09,  2.95s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:   0%|          | 8/3000 [00:24<2:27:09,  2.95s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:   0%|          | 9/3000 [00:24<1:55:08,  2.31s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:   0%|          | 9/3000 [00:24<1:55:08,  2.31s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:   0%|          | 9/3000 [00:25<1:55:08,  2.31s/it, lr: 1.0e-04 loss: 3.244e-01]
a-cold-wall:   0%|          | 9/3000 [00:25<1:55:08,  2.31s/it, lr: 1.0e-04 loss: 3.244e-01]
a-cold-wall:   0%|          | 10/3000 [00:26<1:55:05,  2.31s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:   0%|          | 10/3000 [00:26<1:55:05,  2.31s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:   0%|          | 11/3000 [00:26<1:11:15,  1.43s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:   0%|          | 11/3000 [00:26<1:11:15,  1.43s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:   0%|          | 11/3000 [00:28<1:11:15,  1.43s/it, lr: 1.0e-04 loss: 4.600e-01]
a-cold-wall:   0%|          | 11/3000 [00:28<1:11:15,  1.43s/it, lr: 1.0e-04 loss: 4.600e-01]
a-cold-wall:   0%|          | 12/3000 [00:28<1:12:53,  1.46s/it, lr: 1.0e-04 loss: 4.600e-01]
a-cold-wall:   0%|          | 12/3000 [00:28<1:12:53,  1.46s/it, lr: 1.0e-04 loss: 4.600e-01]
a-cold-wall:   0%|          | 12/3000 [00:29<1:12:53,  1.46s/it, lr: 1.0e-04 loss: 6.788e-01]
a-cold-wall:   0%|          | 12/3000 [00:29<1:12:53,  1.46s/it, lr: 1.0e-04 loss: 6.788e-01]
a-cold-wall:   0%|          | 13/3000 [00:29<1:17:21,  1.55s/it, lr: 1.0e-04 loss: 6.788e-01]
a-cold-wall:   0%|          | 13/3000 [00:29<1:17:21,  1.55s/it, lr: 1.0e-04 loss: 6.788e-01]
a-cold-wall:   0%|          | 13/3000 [00:33<1:17:21,  1.55s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:   0%|          | 13/3000 [00:33<1:17:21,  1.55s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:   0%|          | 14/3000 [00:33<1:37:57,  1.97s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:   0%|          | 14/3000 [00:33<1:37:57,  1.97s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:   0%|          | 14/3000 [00:34<1:37:57,  1.97s/it, lr: 1.0e-04 loss: 7.845e-01]
a-cold-wall:   0%|          | 14/3000 [00:34<1:37:57,  1.97s/it, lr: 1.0e-04 loss: 7.845e-01]
a-cold-wall:   0%|          | 15/3000 [00:34<1:29:58,  1.81s/it, lr: 1.0e-04 loss: 7.845e-01]
a-cold-wall:   0%|          | 15/3000 [00:34<1:29:58,  1.81s/it, lr: 1.0e-04 loss: 7.845e-01]
a-cold-wall:   0%|          | 15/3000 [00:35<1:29:58,  1.81s/it, lr: 1.0e-04 loss: 4.618e-01]
a-cold-wall:   0%|          | 15/3000 [00:35<1:29:58,  1.81s/it, lr: 1.0e-04 loss: 4.618e-01]
a-cold-wall:   1%|          | 16/3000 [00:35<1:24:00,  1.69s/it, lr: 1.0e-04 loss: 4.618e-01]
a-cold-wall:   1%|          | 16/3000 [00:35<1:24:00,  1.69s/it, lr: 1.0e-04 loss: 4.618e-01]
a-cold-wall:   1%|          | 16/3000 [00:37<1:24:00,  1.69s/it, lr: 1.0e-04 loss: 5.928e-01]
a-cold-wall:   1%|          | 16/3000 [00:37<1:24:00,  1.69s/it, lr: 1.0e-04 loss: 5.928e-01]
a-cold-wall:   1%|          | 17/3000 [00:37<1:20:05,  1.61s/it, lr: 1.0e-04 loss: 5.928e-01]
a-cold-wall:   1%|          | 17/3000 [00:37<1:20:05,  1.61s/it, lr: 1.0e-04 loss: 5.928e-01]
a-cold-wall:   1%|          | 17/3000 [00:38<1:20:05,  1.61s/it, lr: 1.0e-04 loss: 6.224e-01]
a-cold-wall:   1%|          | 17/3000 [00:38<1:20:05,  1.61s/it, lr: 1.0e-04 loss: 6.224e-01]
a-cold-wall:   1%|          | 18/3000 [00:38<1:07:16,  1.35s/it, lr: 1.0e-04 loss: 6.224e-01]
a-cold-wall:   1%|          | 18/3000 [00:38<1:07:16,  1.35s/it, lr: 1.0e-04 loss: 6.224e-01]
a-cold-wall:   1%|          | 18/3000 [00:40<1:07:16,  1.35s/it, lr: 1.0e-04 loss: 7.729e-02]
a-cold-wall:   1%|          | 18/3000 [00:40<1:07:16,  1.35s/it, lr: 1.0e-04 loss: 7.729e-02]
a-cold-wall:   1%|          | 19/3000 [00:40<1:28:30,  1.78s/it, lr: 1.0e-04 loss: 7.729e-02]
a-cold-wall:   1%|          | 19/3000 [00:40<1:28:30,  1.78s/it, lr: 1.0e-04 loss: 7.729e-02]
a-cold-wall:   1%|          | 19/3000 [00:41<1:28:30,  1.78s/it, lr: 1.0e-04 loss: 9.464e-02]
a-cold-wall:   1%|          | 19/3000 [00:41<1:28:30,  1.78s/it, lr: 1.0e-04 loss: 9.464e-02]
a-cold-wall:   1%|          | 20/3000 [00:42<1:28:28,  1.78s/it, lr: 1.0e-04 loss: 5.515e-01]
a-cold-wall:   1%|          | 20/3000 [00:42<1:28:28,  1.78s/it, lr: 1.0e-04 loss: 5.515e-01]
a-cold-wall:   1%|          | 21/3000 [00:42<56:19,  1.13s/it, lr: 1.0e-04 loss: 5.515e-01]  
a-cold-wall:   1%|          | 21/3000 [00:42<56:19,  1.13s/it, lr: 1.0e-04 loss: 5.515e-01]  
a-cold-wall:   1%|          | 21/3000 [00:45<56:19,  1.13s/it, lr: 1.0e-04 loss: 3.887e-02]
a-cold-wall:   1%|          | 21/3000 [00:45<56:19,  1.13s/it, lr: 1.0e-04 loss: 3.887e-02]
a-cold-wall:   1%|          | 22/3000 [00:45<1:17:01,  1.55s/it, lr: 1.0e-04 loss: 3.887e-02]
a-cold-wall:   1%|          | 22/3000 [00:45<1:17:01,  1.55s/it, lr: 1.0e-04 loss: 3.887e-02]
a-cold-wall:   1%|          | 22/3000 [00:46<1:17:01,  1.55s/it, lr: 1.0e-04 loss: 3.273e-01]
a-cold-wall:   1%|          | 22/3000 [00:46<1:17:01,  1.55s/it, lr: 1.0e-04 loss: 3.273e-01]
a-cold-wall:   1%|          | 23/3000 [00:46<1:15:07,  1.51s/it, lr: 1.0e-04 loss: 3.273e-01]
a-cold-wall:   1%|          | 23/3000 [00:46<1:15:07,  1.51s/it, lr: 1.0e-04 loss: 3.273e-01]
a-cold-wall:   1%|          | 23/3000 [00:49<1:15:07,  1.51s/it, lr: 1.0e-04 loss: 5.926e-01]
a-cold-wall:   1%|          | 23/3000 [00:49<1:15:07,  1.51s/it, lr: 1.0e-04 loss: 5.926e-01]
a-cold-wall:   1%|          | 24/3000 [00:49<1:32:35,  1.87s/it, lr: 1.0e-04 loss: 5.926e-01]
a-cold-wall:   1%|          | 24/3000 [00:49<1:32:35,  1.87s/it, lr: 1.0e-04 loss: 5.926e-01]
a-cold-wall:   1%|          | 24/3000 [00:52<1:32:35,  1.87s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:   1%|          | 24/3000 [00:52<1:32:35,  1.87s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:   1%|          | 25/3000 [00:52<1:45:40,  2.13s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:   1%|          | 25/3000 [00:52<1:45:40,  2.13s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:   1%|          | 25/3000 [00:54<1:45:40,  2.13s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:   1%|          | 25/3000 [00:54<1:45:40,  2.13s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:   1%|          | 26/3000 [00:55<1:56:08,  2.34s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:   1%|          | 26/3000 [00:55<1:56:08,  2.34s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:   1%|          | 26/3000 [00:57<1:56:08,  2.34s/it, lr: 1.0e-04 loss: 6.359e-01]
a-cold-wall:   1%|          | 26/3000 [00:57<1:56:08,  2.34s/it, lr: 1.0e-04 loss: 6.359e-01]
a-cold-wall:   1%|          | 27/3000 [00:57<2:04:43,  2.52s/it, lr: 1.0e-04 loss: 6.359e-01]
a-cold-wall:   1%|          | 27/3000 [00:57<2:04:43,  2.52s/it, lr: 1.0e-04 loss: 6.359e-01]
a-cold-wall:   1%|          | 27/3000 [01:00<2:04:43,  2.52s/it, lr: 1.0e-04 loss: 6.457e-01]
a-cold-wall:   1%|          | 27/3000 [01:00<2:04:43,  2.52s/it, lr: 1.0e-04 loss: 6.457e-01]
a-cold-wall:   1%|          | 28/3000 [01:00<2:09:33,  2.62s/it, lr: 1.0e-04 loss: 6.457e-01]
a-cold-wall:   1%|          | 28/3000 [01:00<2:09:33,  2.62s/it, lr: 1.0e-04 loss: 6.457e-01]
a-cold-wall:   1%|          | 28/3000 [01:02<2:09:33,  2.62s/it, lr: 1.0e-04 loss: 6.559e-01]
a-cold-wall:   1%|          | 28/3000 [01:02<2:09:33,  2.62s/it, lr: 1.0e-04 loss: 6.559e-01]
a-cold-wall:   1%|          | 29/3000 [01:02<1:51:43,  2.26s/it, lr: 1.0e-04 loss: 6.559e-01]
a-cold-wall:   1%|          | 29/3000 [01:02<1:51:43,  2.26s/it, lr: 1.0e-04 loss: 6.559e-01]
a-cold-wall:   1%|          | 29/3000 [01:03<1:51:43,  2.26s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   1%|          | 29/3000 [01:03<1:51:43,  2.26s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   1%|1         | 30/3000 [01:06<1:51:41,  2.26s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:   1%|1         | 30/3000 [01:06<1:51:41,  2.26s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:   1%|1         | 31/3000 [01:06<1:32:57,  1.88s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:   1%|1         | 31/3000 [01:06<1:32:57,  1.88s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:   1%|1         | 31/3000 [01:07<1:32:57,  1.88s/it, lr: 1.0e-04 loss: 4.047e-01]
a-cold-wall:   1%|1         | 31/3000 [01:07<1:32:57,  1.88s/it, lr: 1.0e-04 loss: 4.047e-01]
a-cold-wall:   1%|1         | 32/3000 [01:07<1:19:02,  1.60s/it, lr: 1.0e-04 loss: 4.047e-01]
a-cold-wall:   1%|1         | 32/3000 [01:07<1:19:02,  1.60s/it, lr: 1.0e-04 loss: 4.047e-01]
a-cold-wall:   1%|1         | 32/3000 [01:07<1:19:02,  1.60s/it, lr: 1.0e-04 loss: 5.745e-01]
a-cold-wall:   1%|1         | 32/3000 [01:07<1:19:02,  1.60s/it, lr: 1.0e-04 loss: 5.745e-01]
a-cold-wall:   1%|1         | 33/3000 [01:07<1:08:11,  1.38s/it, lr: 1.0e-04 loss: 5.745e-01]
a-cold-wall:   1%|1         | 33/3000 [01:07<1:08:11,  1.38s/it, lr: 1.0e-04 loss: 5.745e-01]
a-cold-wall:   1%|1         | 33/3000 [01:08<1:08:11,  1.38s/it, lr: 1.0e-04 loss: 4.144e-01]
a-cold-wall:   1%|1         | 33/3000 [01:08<1:08:11,  1.38s/it, lr: 1.0e-04 loss: 4.144e-01]
a-cold-wall:   1%|1         | 34/3000 [01:08<59:39,  1.21s/it, lr: 1.0e-04 loss: 4.144e-01]  
a-cold-wall:   1%|1         | 34/3000 [01:08<59:39,  1.21s/it, lr: 1.0e-04 loss: 4.144e-01]  
a-cold-wall:   1%|1         | 34/3000 [01:09<59:39,  1.21s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:   1%|1         | 34/3000 [01:09<59:39,  1.21s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:   1%|1         | 35/3000 [01:09<53:13,  1.08s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:   1%|1         | 35/3000 [01:09<53:13,  1.08s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:   1%|1         | 35/3000 [01:10<53:13,  1.08s/it, lr: 1.0e-04 loss: 3.972e-01]
a-cold-wall:   1%|1         | 35/3000 [01:10<53:13,  1.08s/it, lr: 1.0e-04 loss: 3.972e-01]
a-cold-wall:   1%|1         | 36/3000 [01:10<57:55,  1.17s/it, lr: 1.0e-04 loss: 3.972e-01]
a-cold-wall:   1%|1         | 36/3000 [01:10<57:55,  1.17s/it, lr: 1.0e-04 loss: 3.972e-01]
a-cold-wall:   1%|1         | 36/3000 [01:13<57:55,  1.17s/it, lr: 1.0e-04 loss: 7.337e-01]
a-cold-wall:   1%|1         | 36/3000 [01:13<57:55,  1.17s/it, lr: 1.0e-04 loss: 7.337e-01]
a-cold-wall:   1%|1         | 37/3000 [01:13<1:21:34,  1.65s/it, lr: 1.0e-04 loss: 7.337e-01]
a-cold-wall:   1%|1         | 37/3000 [01:13<1:21:34,  1.65s/it, lr: 1.0e-04 loss: 7.337e-01]
a-cold-wall:   1%|1         | 37/3000 [01:15<1:21:34,  1.65s/it, lr: 1.0e-04 loss: 6.864e-01]
a-cold-wall:   1%|1         | 37/3000 [01:15<1:21:34,  1.65s/it, lr: 1.0e-04 loss: 6.864e-01]
a-cold-wall:   1%|1         | 38/3000 [01:15<1:18:11,  1.58s/it, lr: 1.0e-04 loss: 6.864e-01]
a-cold-wall:   1%|1         | 38/3000 [01:15<1:18:11,  1.58s/it, lr: 1.0e-04 loss: 6.864e-01]
a-cold-wall:   1%|1         | 38/3000 [01:16<1:18:11,  1.58s/it, lr: 1.0e-04 loss: 7.073e-01]
a-cold-wall:   1%|1         | 38/3000 [01:16<1:18:11,  1.58s/it, lr: 1.0e-04 loss: 7.073e-01]
a-cold-wall:   1%|1         | 39/3000 [01:16<1:15:40,  1.53s/it, lr: 1.0e-04 loss: 7.073e-01]
a-cold-wall:   1%|1         | 39/3000 [01:16<1:15:40,  1.53s/it, lr: 1.0e-04 loss: 7.073e-01]
a-cold-wall:   1%|1         | 39/3000 [01:17<1:15:40,  1.53s/it, lr: 1.0e-04 loss: 2.741e-01]
a-cold-wall:   1%|1         | 39/3000 [01:17<1:15:40,  1.53s/it, lr: 1.0e-04 loss: 2.741e-01]
a-cold-wall:   1%|1         | 40/3000 [01:19<1:15:38,  1.53s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:   1%|1         | 40/3000 [01:19<1:15:38,  1.53s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:   1%|1         | 41/3000 [01:19<58:52,  1.19s/it, lr: 1.0e-04 loss: 5.103e-01]  
a-cold-wall:   1%|1         | 41/3000 [01:19<58:52,  1.19s/it, lr: 1.0e-04 loss: 5.103e-01]  
a-cold-wall:   1%|1         | 41/3000 [01:22<58:52,  1.19s/it, lr: 1.0e-04 loss: 3.869e-01]
a-cold-wall:   1%|1         | 41/3000 [01:22<58:52,  1.19s/it, lr: 1.0e-04 loss: 3.869e-01]
a-cold-wall:   1%|1         | 42/3000 [01:22<1:19:09,  1.61s/it, lr: 1.0e-04 loss: 3.869e-01]
a-cold-wall:   1%|1         | 42/3000 [01:22<1:19:09,  1.61s/it, lr: 1.0e-04 loss: 3.869e-01]
a-cold-wall:   1%|1         | 42/3000 [01:23<1:19:09,  1.61s/it, lr: 1.0e-04 loss: 3.137e-01]
a-cold-wall:   1%|1         | 42/3000 [01:23<1:19:09,  1.61s/it, lr: 1.0e-04 loss: 3.137e-01]
a-cold-wall:   1%|1         | 43/3000 [01:23<1:16:42,  1.56s/it, lr: 1.0e-04 loss: 3.137e-01]
a-cold-wall:   1%|1         | 43/3000 [01:23<1:16:42,  1.56s/it, lr: 1.0e-04 loss: 3.137e-01]
a-cold-wall:   1%|1         | 43/3000 [01:25<1:16:42,  1.56s/it, lr: 1.0e-04 loss: 3.656e-01]
a-cold-wall:   1%|1         | 43/3000 [01:25<1:16:42,  1.56s/it, lr: 1.0e-04 loss: 3.656e-01]
a-cold-wall:   1%|1         | 44/3000 [01:25<1:14:37,  1.51s/it, lr: 1.0e-04 loss: 3.656e-01]
a-cold-wall:   1%|1         | 44/3000 [01:25<1:14:37,  1.51s/it, lr: 1.0e-04 loss: 3.656e-01]
a-cold-wall:   1%|1         | 44/3000 [01:26<1:14:37,  1.51s/it, lr: 1.0e-04 loss: 3.221e-01]
a-cold-wall:   1%|1         | 44/3000 [01:26<1:14:37,  1.51s/it, lr: 1.0e-04 loss: 3.221e-01]
a-cold-wall:   2%|1         | 45/3000 [01:26<1:14:39,  1.52s/it, lr: 1.0e-04 loss: 3.221e-01]
a-cold-wall:   2%|1         | 45/3000 [01:26<1:14:39,  1.52s/it, lr: 1.0e-04 loss: 3.221e-01]
a-cold-wall:   2%|1         | 45/3000 [01:28<1:14:39,  1.52s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:   2%|1         | 45/3000 [01:28<1:14:39,  1.52s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:   2%|1         | 46/3000 [01:28<1:13:26,  1.49s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:   2%|1         | 46/3000 [01:28<1:13:26,  1.49s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:   2%|1         | 46/3000 [01:28<1:13:26,  1.49s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:   2%|1         | 46/3000 [01:28<1:13:26,  1.49s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:   2%|1         | 47/3000 [01:28<1:02:57,  1.28s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:   2%|1         | 47/3000 [01:28<1:02:57,  1.28s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:   2%|1         | 47/3000 [01:29<1:02:57,  1.28s/it, lr: 1.0e-04 loss: 5.908e-01]
a-cold-wall:   2%|1         | 47/3000 [01:29<1:02:57,  1.28s/it, lr: 1.0e-04 loss: 5.908e-01]
a-cold-wall:   2%|1         | 48/3000 [01:29<55:25,  1.13s/it, lr: 1.0e-04 loss: 5.908e-01]  
a-cold-wall:   2%|1         | 48/3000 [01:29<55:25,  1.13s/it, lr: 1.0e-04 loss: 5.908e-01]  
a-cold-wall:   2%|1         | 48/3000 [01:31<55:25,  1.13s/it, lr: 1.0e-04 loss: 9.648e-02]
a-cold-wall:   2%|1         | 48/3000 [01:31<55:25,  1.13s/it, lr: 1.0e-04 loss: 9.648e-02]
a-cold-wall:   2%|1         | 49/3000 [01:31<1:00:02,  1.22s/it, lr: 1.0e-04 loss: 9.648e-02]
a-cold-wall:   2%|1         | 49/3000 [01:31<1:00:02,  1.22s/it, lr: 1.0e-04 loss: 9.648e-02]
a-cold-wall:   2%|1         | 49/3000 [01:34<1:00:02,  1.22s/it, lr: 1.0e-04 loss: 6.896e-01]
a-cold-wall:   2%|1         | 49/3000 [01:34<1:00:02,  1.22s/it, lr: 1.0e-04 loss: 6.896e-01]
a-cold-wall:   2%|1         | 50/3000 [01:35<1:00:01,  1.22s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:   2%|1         | 50/3000 [01:35<1:00:01,  1.22s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:   2%|1         | 51/3000 [01:35<48:40,  1.01it/s, lr: 1.0e-04 loss: 5.348e-01]  
a-cold-wall:   2%|1         | 51/3000 [01:35<48:40,  1.01it/s, lr: 1.0e-04 loss: 5.348e-01]  
a-cold-wall:   2%|1         | 51/3000 [01:38<48:40,  1.01it/s, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:   2%|1         | 51/3000 [01:38<48:40,  1.01it/s, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:   2%|1         | 52/3000 [01:38<1:11:15,  1.45s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:   2%|1         | 52/3000 [01:38<1:11:15,  1.45s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:   2%|1         | 52/3000 [01:39<1:11:15,  1.45s/it, lr: 1.0e-04 loss: 1.576e-01]
a-cold-wall:   2%|1         | 52/3000 [01:39<1:11:15,  1.45s/it, lr: 1.0e-04 loss: 1.576e-01]
a-cold-wall:   2%|1         | 53/3000 [01:39<1:02:13,  1.27s/it, lr: 1.0e-04 loss: 1.576e-01]
a-cold-wall:   2%|1         | 53/3000 [01:39<1:02:13,  1.27s/it, lr: 1.0e-04 loss: 1.576e-01]
a-cold-wall:   2%|1         | 53/3000 [01:40<1:02:13,  1.27s/it, lr: 1.0e-04 loss: 6.390e-01]
a-cold-wall:   2%|1         | 53/3000 [01:40<1:02:13,  1.27s/it, lr: 1.0e-04 loss: 6.390e-01]
a-cold-wall:   2%|1         | 54/3000 [01:40<58:23,  1.19s/it, lr: 1.0e-04 loss: 6.390e-01]  
a-cold-wall:   2%|1         | 54/3000 [01:40<58:23,  1.19s/it, lr: 1.0e-04 loss: 6.390e-01]  
a-cold-wall:   2%|1         | 54/3000 [01:41<58:23,  1.19s/it, lr: 1.0e-04 loss: 5.267e-01]
a-cold-wall:   2%|1         | 54/3000 [01:41<58:23,  1.19s/it, lr: 1.0e-04 loss: 5.267e-01]
a-cold-wall:   2%|1         | 55/3000 [01:41<1:01:32,  1.25s/it, lr: 1.0e-04 loss: 5.267e-01]
a-cold-wall:   2%|1         | 55/3000 [01:41<1:01:32,  1.25s/it, lr: 1.0e-04 loss: 5.267e-01]
a-cold-wall:   2%|1         | 55/3000 [01:42<1:01:32,  1.25s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:   2%|1         | 55/3000 [01:42<1:01:32,  1.25s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:   2%|1         | 56/3000 [01:42<54:27,  1.11s/it, lr: 1.0e-04 loss: 6.211e-01]  
a-cold-wall:   2%|1         | 56/3000 [01:42<54:27,  1.11s/it, lr: 1.0e-04 loss: 6.211e-01]  
a-cold-wall:   2%|1         | 56/3000 [01:42<54:27,  1.11s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:   2%|1         | 56/3000 [01:42<54:27,  1.11s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:   2%|1         | 57/3000 [01:42<49:23,  1.01s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:   2%|1         | 57/3000 [01:42<49:23,  1.01s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:   2%|1         | 57/3000 [01:44<49:23,  1.01s/it, lr: 1.0e-04 loss: 1.573e-01]
a-cold-wall:   2%|1         | 57/3000 [01:44<49:23,  1.01s/it, lr: 1.0e-04 loss: 1.573e-01]
a-cold-wall:   2%|1         | 58/3000 [01:44<55:07,  1.12s/it, lr: 1.0e-04 loss: 1.573e-01]
a-cold-wall:   2%|1         | 58/3000 [01:44<55:07,  1.12s/it, lr: 1.0e-04 loss: 1.573e-01]
a-cold-wall:   2%|1         | 58/3000 [01:45<55:07,  1.12s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:   2%|1         | 58/3000 [01:45<55:07,  1.12s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:   2%|1         | 59/3000 [01:45<49:31,  1.01s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:   2%|1         | 59/3000 [01:45<49:31,  1.01s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:   2%|1         | 59/3000 [01:47<49:31,  1.01s/it, lr: 1.0e-04 loss: 7.881e-01]
a-cold-wall:   2%|1         | 59/3000 [01:47<49:31,  1.01s/it, lr: 1.0e-04 loss: 7.881e-01]
a-cold-wall:   2%|2         | 60/3000 [01:50<49:30,  1.01s/it, lr: 1.0e-04 loss: 2.070e-01]
a-cold-wall:   2%|2         | 60/3000 [01:50<49:30,  1.01s/it, lr: 1.0e-04 loss: 2.070e-01]
a-cold-wall:   2%|2         | 61/3000 [01:50<59:24,  1.21s/it, lr: 1.0e-04 loss: 2.070e-01]
a-cold-wall:   2%|2         | 61/3000 [01:50<59:24,  1.21s/it, lr: 1.0e-04 loss: 2.070e-01]
a-cold-wall:   2%|2         | 61/3000 [01:53<59:24,  1.21s/it, lr: 1.0e-04 loss: 7.801e-01]
a-cold-wall:   2%|2         | 61/3000 [01:53<59:24,  1.21s/it, lr: 1.0e-04 loss: 7.801e-01]
a-cold-wall:   2%|2         | 62/3000 [01:53<1:19:22,  1.62s/it, lr: 1.0e-04 loss: 7.801e-01]
a-cold-wall:   2%|2         | 62/3000 [01:53<1:19:22,  1.62s/it, lr: 1.0e-04 loss: 7.801e-01]
a-cold-wall:   2%|2         | 62/3000 [01:54<1:19:22,  1.62s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:   2%|2         | 62/3000 [01:54<1:19:22,  1.62s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:   2%|2         | 63/3000 [01:54<1:08:12,  1.39s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:   2%|2         | 63/3000 [01:54<1:08:12,  1.39s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:   2%|2         | 63/3000 [01:55<1:08:12,  1.39s/it, lr: 1.0e-04 loss: 3.592e-01]
a-cold-wall:   2%|2         | 63/3000 [01:55<1:08:12,  1.39s/it, lr: 1.0e-04 loss: 3.592e-01]
a-cold-wall:   2%|2         | 64/3000 [01:55<1:08:42,  1.40s/it, lr: 1.0e-04 loss: 3.592e-01]
a-cold-wall:   2%|2         | 64/3000 [01:55<1:08:42,  1.40s/it, lr: 1.0e-04 loss: 3.592e-01]
a-cold-wall:   2%|2         | 64/3000 [01:56<1:08:42,  1.40s/it, lr: 1.0e-04 loss: 5.121e-02]
a-cold-wall:   2%|2         | 64/3000 [01:56<1:08:42,  1.40s/it, lr: 1.0e-04 loss: 5.121e-02]
a-cold-wall:   2%|2         | 65/3000 [01:56<59:40,  1.22s/it, lr: 1.0e-04 loss: 5.121e-02]  
a-cold-wall:   2%|2         | 65/3000 [01:56<59:40,  1.22s/it, lr: 1.0e-04 loss: 5.121e-02]  
a-cold-wall:   2%|2         | 65/3000 [01:57<59:40,  1.22s/it, lr: 1.0e-04 loss: 5.467e-02]
a-cold-wall:   2%|2         | 65/3000 [01:57<59:40,  1.22s/it, lr: 1.0e-04 loss: 5.467e-02]
a-cold-wall:   2%|2         | 66/3000 [01:57<53:19,  1.09s/it, lr: 1.0e-04 loss: 5.467e-02]
a-cold-wall:   2%|2         | 66/3000 [01:57<53:19,  1.09s/it, lr: 1.0e-04 loss: 5.467e-02]
a-cold-wall:   2%|2         | 66/3000 [01:58<53:19,  1.09s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:   2%|2         | 66/3000 [01:58<53:19,  1.09s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:   2%|2         | 67/3000 [01:58<51:47,  1.06s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:   2%|2         | 67/3000 [01:58<51:47,  1.06s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:   2%|2         | 67/3000 [02:01<51:47,  1.06s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:   2%|2         | 67/3000 [02:01<51:47,  1.06s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:   2%|2         | 68/3000 [02:01<1:17:40,  1.59s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:   2%|2         | 68/3000 [02:01<1:17:40,  1.59s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:   2%|2         | 68/3000 [02:02<1:17:40,  1.59s/it, lr: 1.0e-04 loss: 4.640e-01]
a-cold-wall:   2%|2         | 68/3000 [02:02<1:17:40,  1.59s/it, lr: 1.0e-04 loss: 4.640e-01]
a-cold-wall:   2%|2         | 69/3000 [02:02<1:15:35,  1.55s/it, lr: 1.0e-04 loss: 4.640e-01]
a-cold-wall:   2%|2         | 69/3000 [02:02<1:15:35,  1.55s/it, lr: 1.0e-04 loss: 4.640e-01]
a-cold-wall:   2%|2         | 69/3000 [02:04<1:15:35,  1.55s/it, lr: 1.0e-04 loss: 3.053e-01]
a-cold-wall:   2%|2         | 69/3000 [02:04<1:15:35,  1.55s/it, lr: 1.0e-04 loss: 3.053e-01]
a-cold-wall:   2%|2         | 70/3000 [02:04<1:15:33,  1.55s/it, lr: 1.0e-04 loss: 7.340e-01]
a-cold-wall:   2%|2         | 70/3000 [02:04<1:15:33,  1.55s/it, lr: 1.0e-04 loss: 7.340e-01]
a-cold-wall:   2%|2         | 71/3000 [02:04<49:23,  1.01s/it, lr: 1.0e-04 loss: 7.340e-01]  
a-cold-wall:   2%|2         | 71/3000 [02:04<49:23,  1.01s/it, lr: 1.0e-04 loss: 7.340e-01]  
a-cold-wall:   2%|2         | 71/3000 [02:05<49:23,  1.01s/it, lr: 1.0e-04 loss: 5.716e-01]
a-cold-wall:   2%|2         | 71/3000 [02:05<49:23,  1.01s/it, lr: 1.0e-04 loss: 5.716e-01]
a-cold-wall:   2%|2         | 72/3000 [02:05<46:35,  1.05it/s, lr: 1.0e-04 loss: 5.716e-01]
a-cold-wall:   2%|2         | 72/3000 [02:05<46:35,  1.05it/s, lr: 1.0e-04 loss: 5.716e-01]
a-cold-wall:   2%|2         | 72/3000 [02:07<46:35,  1.05it/s, lr: 1.0e-04 loss: 3.952e-01]
a-cold-wall:   2%|2         | 72/3000 [02:07<46:35,  1.05it/s, lr: 1.0e-04 loss: 3.952e-01]
a-cold-wall:   2%|2         | 73/3000 [02:07<52:43,  1.08s/it, lr: 1.0e-04 loss: 3.952e-01]
a-cold-wall:   2%|2         | 73/3000 [02:07<52:43,  1.08s/it, lr: 1.0e-04 loss: 3.952e-01]
a-cold-wall:   2%|2         | 73/3000 [02:08<52:43,  1.08s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:   2%|2         | 73/3000 [02:08<52:43,  1.08s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:   2%|2         | 74/3000 [02:08<57:26,  1.18s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:   2%|2         | 74/3000 [02:08<57:26,  1.18s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:   2%|2         | 74/3000 [02:09<57:26,  1.18s/it, lr: 1.0e-04 loss: 7.407e-01]
a-cold-wall:   2%|2         | 74/3000 [02:09<57:26,  1.18s/it, lr: 1.0e-04 loss: 7.407e-01]
a-cold-wall:   2%|2         | 75/3000 [02:09<51:40,  1.06s/it, lr: 1.0e-04 loss: 7.407e-01]
a-cold-wall:   2%|2         | 75/3000 [02:09<51:40,  1.06s/it, lr: 1.0e-04 loss: 7.407e-01]
a-cold-wall:   2%|2         | 75/3000 [02:10<51:40,  1.06s/it, lr: 1.0e-04 loss: 8.974e-02]
a-cold-wall:   2%|2         | 75/3000 [02:10<51:40,  1.06s/it, lr: 1.0e-04 loss: 8.974e-02]
a-cold-wall:   3%|2         | 76/3000 [02:10<56:49,  1.17s/it, lr: 1.0e-04 loss: 8.974e-02]
a-cold-wall:   3%|2         | 76/3000 [02:10<56:49,  1.17s/it, lr: 1.0e-04 loss: 8.974e-02]
a-cold-wall:   3%|2         | 76/3000 [02:12<56:49,  1.17s/it, lr: 1.0e-04 loss: 4.589e-01]
a-cold-wall:   3%|2         | 76/3000 [02:12<56:49,  1.17s/it, lr: 1.0e-04 loss: 4.589e-01]
a-cold-wall:   3%|2         | 77/3000 [02:12<1:01:04,  1.25s/it, lr: 1.0e-04 loss: 4.589e-01]
a-cold-wall:   3%|2         | 77/3000 [02:12<1:01:04,  1.25s/it, lr: 1.0e-04 loss: 4.589e-01]
a-cold-wall:   3%|2         | 77/3000 [02:12<1:01:04,  1.25s/it, lr: 1.0e-04 loss: 4.803e-01]
a-cold-wall:   3%|2         | 77/3000 [02:12<1:01:04,  1.25s/it, lr: 1.0e-04 loss: 4.803e-01]
a-cold-wall:   3%|2         | 78/3000 [02:12<54:00,  1.11s/it, lr: 1.0e-04 loss: 4.803e-01]  
a-cold-wall:   3%|2         | 78/3000 [02:12<54:00,  1.11s/it, lr: 1.0e-04 loss: 4.803e-01]  
a-cold-wall:   3%|2         | 78/3000 [02:14<54:00,  1.11s/it, lr: 1.0e-04 loss: 1.872e-01]
a-cold-wall:   3%|2         | 78/3000 [02:14<54:00,  1.11s/it, lr: 1.0e-04 loss: 1.872e-01]
a-cold-wall:   3%|2         | 79/3000 [02:14<58:28,  1.20s/it, lr: 1.0e-04 loss: 1.872e-01]
a-cold-wall:   3%|2         | 79/3000 [02:14<58:28,  1.20s/it, lr: 1.0e-04 loss: 1.872e-01]
a-cold-wall:   3%|2         | 79/3000 [02:15<58:28,  1.20s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:   3%|2         | 79/3000 [02:15<58:28,  1.20s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:   3%|2         | 80/3000 [02:16<58:27,  1.20s/it, lr: 1.0e-04 loss: 9.873e-02]
a-cold-wall:   3%|2         | 80/3000 [02:16<58:27,  1.20s/it, lr: 1.0e-04 loss: 9.873e-02]
a-cold-wall:   3%|2         | 81/3000 [02:16<42:34,  1.14it/s, lr: 1.0e-04 loss: 9.873e-02]
a-cold-wall:   3%|2         | 81/3000 [02:16<42:34,  1.14it/s, lr: 1.0e-04 loss: 9.873e-02]
a-cold-wall:   3%|2         | 81/3000 [02:19<42:34,  1.14it/s, lr: 1.0e-04 loss: 3.652e-01]
a-cold-wall:   3%|2         | 81/3000 [02:19<42:34,  1.14it/s, lr: 1.0e-04 loss: 3.652e-01]
a-cold-wall:   3%|2         | 82/3000 [02:19<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 3.652e-01]
a-cold-wall:   3%|2         | 82/3000 [02:19<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 3.652e-01]
a-cold-wall:   3%|2         | 82/3000 [02:21<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 1.966e-01]
a-cold-wall:   3%|2         | 82/3000 [02:21<1:06:47,  1.37s/it, lr: 1.0e-04 loss: 1.966e-01]
a-cold-wall:   3%|2         | 83/3000 [02:21<1:07:43,  1.39s/it, lr: 1.0e-04 loss: 1.966e-01]
a-cold-wall:   3%|2         | 83/3000 [02:21<1:07:43,  1.39s/it, lr: 1.0e-04 loss: 1.966e-01]
a-cold-wall:   3%|2         | 83/3000 [02:21<1:07:43,  1.39s/it, lr: 1.0e-04 loss: 6.417e-01]
a-cold-wall:   3%|2         | 83/3000 [02:21<1:07:43,  1.39s/it, lr: 1.0e-04 loss: 6.417e-01]
a-cold-wall:   3%|2         | 84/3000 [02:21<59:21,  1.22s/it, lr: 1.0e-04 loss: 6.417e-01]  
a-cold-wall:   3%|2         | 84/3000 [02:21<59:21,  1.22s/it, lr: 1.0e-04 loss: 6.417e-01]  
a-cold-wall:   3%|2         | 84/3000 [02:24<59:21,  1.22s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:   3%|2         | 84/3000 [02:24<59:21,  1.22s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:   3%|2         | 85/3000 [02:24<1:22:18,  1.69s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:   3%|2         | 85/3000 [02:24<1:22:18,  1.69s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:   3%|2         | 85/3000 [02:25<1:22:18,  1.69s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   3%|2         | 85/3000 [02:25<1:22:18,  1.69s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   3%|2         | 86/3000 [02:25<1:09:39,  1.43s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   3%|2         | 86/3000 [02:25<1:09:39,  1.43s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   3%|2         | 86/3000 [02:26<1:09:39,  1.43s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:   3%|2         | 86/3000 [02:26<1:09:39,  1.43s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:   3%|2         | 87/3000 [02:26<59:55,  1.23s/it, lr: 1.0e-04 loss: 5.792e-01]  
a-cold-wall:   3%|2         | 87/3000 [02:26<59:55,  1.23s/it, lr: 1.0e-04 loss: 5.792e-01]  
a-cold-wall:   3%|2         | 87/3000 [02:29<59:55,  1.23s/it, lr: 1.0e-04 loss: 1.858e-01]
a-cold-wall:   3%|2         | 87/3000 [02:29<59:55,  1.23s/it, lr: 1.0e-04 loss: 1.858e-01]
a-cold-wall:   3%|2         | 88/3000 [02:29<1:22:41,  1.70s/it, lr: 1.0e-04 loss: 1.858e-01]
a-cold-wall:   3%|2         | 88/3000 [02:29<1:22:41,  1.70s/it, lr: 1.0e-04 loss: 1.858e-01]
a-cold-wall:   3%|2         | 88/3000 [02:32<1:22:41,  1.70s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:   3%|2         | 88/3000 [02:32<1:22:41,  1.70s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:   3%|2         | 89/3000 [02:32<1:39:28,  2.05s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:   3%|2         | 89/3000 [02:32<1:39:28,  2.05s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:   3%|2         | 89/3000 [02:33<1:39:28,  2.05s/it, lr: 1.0e-04 loss: 1.217e-01]
a-cold-wall:   3%|2         | 89/3000 [02:33<1:39:28,  2.05s/it, lr: 1.0e-04 loss: 1.217e-01]
a-cold-wall:   3%|3         | 90/3000 [02:34<1:39:26,  2.05s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:   3%|3         | 90/3000 [02:34<1:39:26,  2.05s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:   3%|3         | 91/3000 [02:34<1:02:08,  1.28s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:   3%|3         | 91/3000 [02:34<1:02:08,  1.28s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:   3%|3         | 91/3000 [02:37<1:02:08,  1.28s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:   3%|3         | 91/3000 [02:37<1:02:08,  1.28s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:   3%|3         | 92/3000 [02:37<1:21:04,  1.67s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:   3%|3         | 92/3000 [02:37<1:21:04,  1.67s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:   3%|3         | 92/3000 [02:38<1:21:04,  1.67s/it, lr: 1.0e-04 loss: 5.875e-01]
a-cold-wall:   3%|3         | 92/3000 [02:38<1:21:04,  1.67s/it, lr: 1.0e-04 loss: 5.875e-01]
a-cold-wall:   3%|3         | 93/3000 [02:38<1:12:07,  1.49s/it, lr: 1.0e-04 loss: 5.875e-01]
a-cold-wall:   3%|3         | 93/3000 [02:38<1:12:07,  1.49s/it, lr: 1.0e-04 loss: 5.875e-01]
a-cold-wall:   3%|3         | 93/3000 [02:40<1:12:07,  1.49s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:   3%|3         | 93/3000 [02:40<1:12:07,  1.49s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:   3%|3         | 94/3000 [02:40<1:30:07,  1.86s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:   3%|3         | 94/3000 [02:40<1:30:07,  1.86s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:   3%|3         | 94/3000 [02:42<1:30:07,  1.86s/it, lr: 1.0e-04 loss: 7.008e-02]
a-cold-wall:   3%|3         | 94/3000 [02:42<1:30:07,  1.86s/it, lr: 1.0e-04 loss: 7.008e-02]
a-cold-wall:   3%|3         | 95/3000 [02:42<1:26:15,  1.78s/it, lr: 1.0e-04 loss: 7.008e-02]
a-cold-wall:   3%|3         | 95/3000 [02:42<1:26:15,  1.78s/it, lr: 1.0e-04 loss: 7.008e-02]
a-cold-wall:   3%|3         | 95/3000 [02:43<1:26:15,  1.78s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:   3%|3         | 95/3000 [02:43<1:26:15,  1.78s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:   3%|3         | 96/3000 [02:43<1:11:58,  1.49s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:   3%|3         | 96/3000 [02:43<1:11:58,  1.49s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:   3%|3         | 96/3000 [02:44<1:11:58,  1.49s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:   3%|3         | 96/3000 [02:44<1:11:58,  1.49s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:   3%|3         | 97/3000 [02:44<1:02:37,  1.29s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:   3%|3         | 97/3000 [02:44<1:02:37,  1.29s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:   3%|3         | 97/3000 [02:45<1:02:37,  1.29s/it, lr: 1.0e-04 loss: 4.840e-01]
a-cold-wall:   3%|3         | 97/3000 [02:45<1:02:37,  1.29s/it, lr: 1.0e-04 loss: 4.840e-01]
a-cold-wall:   3%|3         | 98/3000 [02:45<1:04:13,  1.33s/it, lr: 1.0e-04 loss: 4.840e-01]
a-cold-wall:   3%|3         | 98/3000 [02:45<1:04:13,  1.33s/it, lr: 1.0e-04 loss: 4.840e-01]
a-cold-wall:   3%|3         | 98/3000 [02:48<1:04:13,  1.33s/it, lr: 1.0e-04 loss: 5.801e-01]
a-cold-wall:   3%|3         | 98/3000 [02:48<1:04:13,  1.33s/it, lr: 1.0e-04 loss: 5.801e-01]
a-cold-wall:   3%|3         | 99/3000 [02:48<1:25:34,  1.77s/it, lr: 1.0e-04 loss: 5.801e-01]
a-cold-wall:   3%|3         | 99/3000 [02:48<1:25:34,  1.77s/it, lr: 1.0e-04 loss: 5.801e-01]
a-cold-wall:   3%|3         | 99/3000 [02:51<1:25:34,  1.77s/it, lr: 1.0e-04 loss: 3.549e-01]
a-cold-wall:   3%|3         | 99/3000 [02:51<1:25:34,  1.77s/it, lr: 1.0e-04 loss: 3.549e-01]
a-cold-wall:   3%|3         | 100/3000 [02:53<1:25:32,  1.77s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:   3%|3         | 100/3000 [02:53<1:25:32,  1.77s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:   3%|3         | 101/3000 [02:53<1:17:35,  1.61s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:   3%|3         | 101/3000 [02:53<1:17:35,  1.61s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:   3%|3         | 101/3000 [02:54<1:17:35,  1.61s/it, lr: 1.0e-04 loss: 6.407e-01]
a-cold-wall:   3%|3         | 101/3000 [02:54<1:17:35,  1.61s/it, lr: 1.0e-04 loss: 6.407e-01]
a-cold-wall:   3%|3         | 102/3000 [02:54<1:07:15,  1.39s/it, lr: 1.0e-04 loss: 6.407e-01]
a-cold-wall:   3%|3         | 102/3000 [02:54<1:07:15,  1.39s/it, lr: 1.0e-04 loss: 6.407e-01]
a-cold-wall:   3%|3         | 102/3000 [02:55<1:07:15,  1.39s/it, lr: 1.0e-04 loss: 6.007e-01]
a-cold-wall:   3%|3         | 102/3000 [02:55<1:07:15,  1.39s/it, lr: 1.0e-04 loss: 6.007e-01]
a-cold-wall:   3%|3         | 103/3000 [02:55<58:52,  1.22s/it, lr: 1.0e-04 loss: 6.007e-01]  
a-cold-wall:   3%|3         | 103/3000 [02:55<58:52,  1.22s/it, lr: 1.0e-04 loss: 6.007e-01]  
a-cold-wall:   3%|3         | 103/3000 [02:58<58:52,  1.22s/it, lr: 1.0e-04 loss: 5.555e-01]
a-cold-wall:   3%|3         | 103/3000 [02:58<58:52,  1.22s/it, lr: 1.0e-04 loss: 5.555e-01]
a-cold-wall:   3%|3         | 104/3000 [02:58<1:19:48,  1.65s/it, lr: 1.0e-04 loss: 5.555e-01]
a-cold-wall:   3%|3         | 104/3000 [02:58<1:19:48,  1.65s/it, lr: 1.0e-04 loss: 5.555e-01]
a-cold-wall:   3%|3         | 104/3000 [02:59<1:19:48,  1.65s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   3%|3         | 104/3000 [02:59<1:19:48,  1.65s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   4%|3         | 105/3000 [02:59<1:08:30,  1.42s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   4%|3         | 105/3000 [02:59<1:08:30,  1.42s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   4%|3         | 105/3000 [03:02<1:08:30,  1.42s/it, lr: 1.0e-04 loss: 5.210e-02]
a-cold-wall:   4%|3         | 105/3000 [03:02<1:08:30,  1.42s/it, lr: 1.0e-04 loss: 5.210e-02]
a-cold-wall:   4%|3         | 106/3000 [03:02<1:28:22,  1.83s/it, lr: 1.0e-04 loss: 5.210e-02]
a-cold-wall:   4%|3         | 106/3000 [03:02<1:28:22,  1.83s/it, lr: 1.0e-04 loss: 5.210e-02]
a-cold-wall:   4%|3         | 106/3000 [03:03<1:28:22,  1.83s/it, lr: 1.0e-04 loss: 2.453e-01]
a-cold-wall:   4%|3         | 106/3000 [03:03<1:28:22,  1.83s/it, lr: 1.0e-04 loss: 2.453e-01]
a-cold-wall:   4%|3         | 107/3000 [03:03<1:22:41,  1.71s/it, lr: 1.0e-04 loss: 2.453e-01]
a-cold-wall:   4%|3         | 107/3000 [03:03<1:22:41,  1.71s/it, lr: 1.0e-04 loss: 2.453e-01]
a-cold-wall:   4%|3         | 107/3000 [03:06<1:22:41,  1.71s/it, lr: 1.0e-04 loss: 8.576e-02]
a-cold-wall:   4%|3         | 107/3000 [03:06<1:22:41,  1.71s/it, lr: 1.0e-04 loss: 8.576e-02]
a-cold-wall:   4%|3         | 108/3000 [03:06<1:40:44,  2.09s/it, lr: 1.0e-04 loss: 8.576e-02]
a-cold-wall:   4%|3         | 108/3000 [03:06<1:40:44,  2.09s/it, lr: 1.0e-04 loss: 8.576e-02]
a-cold-wall:   4%|3         | 108/3000 [03:08<1:40:44,  2.09s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:   4%|3         | 108/3000 [03:08<1:40:44,  2.09s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:   4%|3         | 109/3000 [03:08<1:30:52,  1.89s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:   4%|3         | 109/3000 [03:08<1:30:52,  1.89s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:   4%|3         | 109/3000 [03:09<1:30:52,  1.89s/it, lr: 1.0e-04 loss: 4.982e-01]
a-cold-wall:   4%|3         | 109/3000 [03:09<1:30:52,  1.89s/it, lr: 1.0e-04 loss: 4.982e-01]
a-cold-wall:   4%|3         | 110/3000 [03:10<1:30:50,  1.89s/it, lr: 1.0e-04 loss: 8.276e-01]
a-cold-wall:   4%|3         | 110/3000 [03:10<1:30:50,  1.89s/it, lr: 1.0e-04 loss: 8.276e-01]
a-cold-wall:   4%|3         | 111/3000 [03:10<57:40,  1.20s/it, lr: 1.0e-04 loss: 8.276e-01]  
a-cold-wall:   4%|3         | 111/3000 [03:10<57:40,  1.20s/it, lr: 1.0e-04 loss: 8.276e-01]  
a-cold-wall:   4%|3         | 111/3000 [03:10<57:40,  1.20s/it, lr: 1.0e-04 loss: 7.301e-01]
a-cold-wall:   4%|3         | 111/3000 [03:10<57:40,  1.20s/it, lr: 1.0e-04 loss: 7.301e-01]
a-cold-wall:   4%|3         | 112/3000 [03:10<52:18,  1.09s/it, lr: 1.0e-04 loss: 7.301e-01]
a-cold-wall:   4%|3         | 112/3000 [03:10<52:18,  1.09s/it, lr: 1.0e-04 loss: 7.301e-01]
a-cold-wall:   4%|3         | 112/3000 [03:13<52:18,  1.09s/it, lr: 1.0e-04 loss: 5.972e-01]
a-cold-wall:   4%|3         | 112/3000 [03:13<52:18,  1.09s/it, lr: 1.0e-04 loss: 5.972e-01]
a-cold-wall:   4%|3         | 113/3000 [03:13<1:14:31,  1.55s/it, lr: 1.0e-04 loss: 5.972e-01]
a-cold-wall:   4%|3         | 113/3000 [03:13<1:14:31,  1.55s/it, lr: 1.0e-04 loss: 5.972e-01]
a-cold-wall:   4%|3         | 113/3000 [03:16<1:14:31,  1.55s/it, lr: 1.0e-04 loss: 3.062e-01]
a-cold-wall:   4%|3         | 113/3000 [03:16<1:14:31,  1.55s/it, lr: 1.0e-04 loss: 3.062e-01]
a-cold-wall:   4%|3         | 114/3000 [03:16<1:31:04,  1.89s/it, lr: 1.0e-04 loss: 3.062e-01]
a-cold-wall:   4%|3         | 114/3000 [03:16<1:31:04,  1.89s/it, lr: 1.0e-04 loss: 3.062e-01]
a-cold-wall:   4%|3         | 114/3000 [03:19<1:31:04,  1.89s/it, lr: 1.0e-04 loss: 1.182e-01]
a-cold-wall:   4%|3         | 114/3000 [03:19<1:31:04,  1.89s/it, lr: 1.0e-04 loss: 1.182e-01]
a-cold-wall:   4%|3         | 115/3000 [03:19<1:44:18,  2.17s/it, lr: 1.0e-04 loss: 1.182e-01]
a-cold-wall:   4%|3         | 115/3000 [03:19<1:44:18,  2.17s/it, lr: 1.0e-04 loss: 1.182e-01]
a-cold-wall:   4%|3         | 115/3000 [03:22<1:44:18,  2.17s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:   4%|3         | 115/3000 [03:22<1:44:18,  2.17s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:   4%|3         | 116/3000 [03:22<1:53:13,  2.36s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:   4%|3         | 116/3000 [03:22<1:53:13,  2.36s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:   4%|3         | 116/3000 [03:23<1:53:13,  2.36s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   4%|3         | 116/3000 [03:23<1:53:13,  2.36s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   4%|3         | 117/3000 [03:23<1:30:46,  1.89s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   4%|3         | 117/3000 [03:23<1:30:46,  1.89s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   4%|3         | 117/3000 [03:23<1:30:46,  1.89s/it, lr: 1.0e-04 loss: 1.629e-01]
a-cold-wall:   4%|3         | 117/3000 [03:23<1:30:46,  1.89s/it, lr: 1.0e-04 loss: 1.629e-01]
a-cold-wall:   4%|3         | 118/3000 [03:23<1:14:40,  1.55s/it, lr: 1.0e-04 loss: 1.629e-01]
a-cold-wall:   4%|3         | 118/3000 [03:23<1:14:40,  1.55s/it, lr: 1.0e-04 loss: 1.629e-01]
a-cold-wall:   4%|3         | 118/3000 [03:24<1:14:40,  1.55s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:   4%|3         | 118/3000 [03:24<1:14:40,  1.55s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:   4%|3         | 119/3000 [03:24<1:03:09,  1.32s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:   4%|3         | 119/3000 [03:24<1:03:09,  1.32s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:   4%|3         | 119/3000 [03:25<1:03:09,  1.32s/it, lr: 1.0e-04 loss: 1.256e-01]
a-cold-wall:   4%|3         | 119/3000 [03:25<1:03:09,  1.32s/it, lr: 1.0e-04 loss: 1.256e-01]
a-cold-wall:   4%|4         | 120/3000 [03:28<1:03:08,  1.32s/it, lr: 1.0e-04 loss: 4.261e-01]
a-cold-wall:   4%|4         | 120/3000 [03:28<1:03:08,  1.32s/it, lr: 1.0e-04 loss: 4.261e-01]
a-cold-wall:   4%|4         | 121/3000 [03:28<1:06:07,  1.38s/it, lr: 1.0e-04 loss: 4.261e-01]
a-cold-wall:   4%|4         | 121/3000 [03:28<1:06:07,  1.38s/it, lr: 1.0e-04 loss: 4.261e-01]
a-cold-wall:   4%|4         | 121/3000 [03:29<1:06:07,  1.38s/it, lr: 1.0e-04 loss: 3.822e-01]
a-cold-wall:   4%|4         | 121/3000 [03:29<1:06:07,  1.38s/it, lr: 1.0e-04 loss: 3.822e-01]
a-cold-wall:   4%|4         | 122/3000 [03:29<58:48,  1.23s/it, lr: 1.0e-04 loss: 3.822e-01]  
a-cold-wall:   4%|4         | 122/3000 [03:29<58:48,  1.23s/it, lr: 1.0e-04 loss: 3.822e-01]  
a-cold-wall:   4%|4         | 122/3000 [03:29<58:48,  1.23s/it, lr: 1.0e-04 loss: 2.108e-01]
a-cold-wall:   4%|4         | 122/3000 [03:29<58:48,  1.23s/it, lr: 1.0e-04 loss: 2.108e-01]
a-cold-wall:   4%|4         | 123/3000 [03:29<52:46,  1.10s/it, lr: 1.0e-04 loss: 2.108e-01]
a-cold-wall:   4%|4         | 123/3000 [03:29<52:46,  1.10s/it, lr: 1.0e-04 loss: 2.108e-01]
a-cold-wall:   4%|4         | 123/3000 [03:31<52:46,  1.10s/it, lr: 1.0e-04 loss: 3.097e-01]
a-cold-wall:   4%|4         | 123/3000 [03:31<52:46,  1.10s/it, lr: 1.0e-04 loss: 3.097e-01]
a-cold-wall:   4%|4         | 124/3000 [03:31<56:50,  1.19s/it, lr: 1.0e-04 loss: 3.097e-01]
a-cold-wall:   4%|4         | 124/3000 [03:31<56:50,  1.19s/it, lr: 1.0e-04 loss: 3.097e-01]
a-cold-wall:   4%|4         | 124/3000 [03:32<56:50,  1.19s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:   4%|4         | 124/3000 [03:32<56:50,  1.19s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:   4%|4         | 125/3000 [03:32<59:43,  1.25s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:   4%|4         | 125/3000 [03:32<59:43,  1.25s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:   4%|4         | 125/3000 [03:33<59:43,  1.25s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   4%|4         | 125/3000 [03:33<59:43,  1.25s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   4%|4         | 126/3000 [03:34<1:01:52,  1.29s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   4%|4         | 126/3000 [03:34<1:01:52,  1.29s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   4%|4         | 126/3000 [03:35<1:01:52,  1.29s/it, lr: 1.0e-04 loss: 3.574e-01]
a-cold-wall:   4%|4         | 126/3000 [03:35<1:01:52,  1.29s/it, lr: 1.0e-04 loss: 3.574e-01]
a-cold-wall:   4%|4         | 127/3000 [03:35<1:03:29,  1.33s/it, lr: 1.0e-04 loss: 3.574e-01]
a-cold-wall:   4%|4         | 127/3000 [03:35<1:03:29,  1.33s/it, lr: 1.0e-04 loss: 3.574e-01]
a-cold-wall:   4%|4         | 127/3000 [03:36<1:03:29,  1.33s/it, lr: 1.0e-04 loss: 3.016e-01]
a-cold-wall:   4%|4         | 127/3000 [03:36<1:03:29,  1.33s/it, lr: 1.0e-04 loss: 3.016e-01]
a-cold-wall:   4%|4         | 128/3000 [03:36<55:13,  1.15s/it, lr: 1.0e-04 loss: 3.016e-01]  
a-cold-wall:   4%|4         | 128/3000 [03:36<55:13,  1.15s/it, lr: 1.0e-04 loss: 3.016e-01]  
a-cold-wall:   4%|4         | 128/3000 [03:36<55:13,  1.15s/it, lr: 1.0e-04 loss: 1.643e-01]
a-cold-wall:   4%|4         | 128/3000 [03:36<55:13,  1.15s/it, lr: 1.0e-04 loss: 1.643e-01]
a-cold-wall:   4%|4         | 129/3000 [03:36<49:34,  1.04s/it, lr: 1.0e-04 loss: 1.643e-01]
a-cold-wall:   4%|4         | 129/3000 [03:36<49:34,  1.04s/it, lr: 1.0e-04 loss: 1.643e-01]
a-cold-wall:   4%|4         | 129/3000 [03:39<49:34,  1.04s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:   4%|4         | 129/3000 [03:39<49:34,  1.04s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:   4%|4         | 130/3000 [03:41<49:33,  1.04s/it, lr: 1.0e-04 loss: 3.686e-01]
a-cold-wall:   4%|4         | 130/3000 [03:41<49:33,  1.04s/it, lr: 1.0e-04 loss: 3.686e-01]
a-cold-wall:   4%|4         | 131/3000 [03:41<42:33,  1.12it/s, lr: 1.0e-04 loss: 3.686e-01]
a-cold-wall:   4%|4         | 131/3000 [03:41<42:33,  1.12it/s, lr: 1.0e-04 loss: 3.686e-01]
a-cold-wall:   4%|4         | 131/3000 [03:43<42:33,  1.12it/s, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:   4%|4         | 131/3000 [03:43<42:33,  1.12it/s, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:   4%|4         | 132/3000 [03:43<1:05:33,  1.37s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:   4%|4         | 132/3000 [03:43<1:05:33,  1.37s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:   4%|4         | 132/3000 [03:45<1:05:33,  1.37s/it, lr: 1.0e-04 loss: 3.441e-02]
a-cold-wall:   4%|4         | 132/3000 [03:45<1:05:33,  1.37s/it, lr: 1.0e-04 loss: 3.441e-02]
a-cold-wall:   4%|4         | 133/3000 [03:45<1:06:06,  1.38s/it, lr: 1.0e-04 loss: 3.441e-02]
a-cold-wall:   4%|4         | 133/3000 [03:45<1:06:06,  1.38s/it, lr: 1.0e-04 loss: 3.441e-02]
a-cold-wall:   4%|4         | 133/3000 [03:46<1:06:06,  1.38s/it, lr: 1.0e-04 loss: 5.052e-01]
a-cold-wall:   4%|4         | 133/3000 [03:46<1:06:06,  1.38s/it, lr: 1.0e-04 loss: 5.052e-01]
a-cold-wall:   4%|4         | 134/3000 [03:46<57:32,  1.20s/it, lr: 1.0e-04 loss: 5.052e-01]  
a-cold-wall:   4%|4         | 134/3000 [03:46<57:32,  1.20s/it, lr: 1.0e-04 loss: 5.052e-01]  
a-cold-wall:   4%|4         | 134/3000 [03:49<57:32,  1.20s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:   4%|4         | 134/3000 [03:49<57:32,  1.20s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:   4%|4         | 135/3000 [03:49<1:20:37,  1.69s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:   4%|4         | 135/3000 [03:49<1:20:37,  1.69s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:   4%|4         | 135/3000 [03:51<1:20:37,  1.69s/it, lr: 1.0e-04 loss: 2.887e-01]
a-cold-wall:   4%|4         | 135/3000 [03:51<1:20:37,  1.69s/it, lr: 1.0e-04 loss: 2.887e-01]
a-cold-wall:   5%|4         | 136/3000 [03:51<1:35:57,  2.01s/it, lr: 1.0e-04 loss: 2.887e-01]
a-cold-wall:   5%|4         | 136/3000 [03:51<1:35:57,  2.01s/it, lr: 1.0e-04 loss: 2.887e-01]
a-cold-wall:   5%|4         | 136/3000 [03:52<1:35:57,  2.01s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   5%|4         | 136/3000 [03:52<1:35:57,  2.01s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   5%|4         | 137/3000 [03:52<1:18:24,  1.64s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   5%|4         | 137/3000 [03:52<1:18:24,  1.64s/it, lr: 1.0e-04 loss: 5.471e-01]
a-cold-wall:   5%|4         | 137/3000 [03:53<1:18:24,  1.64s/it, lr: 1.0e-04 loss: 5.389e-01]
a-cold-wall:   5%|4         | 137/3000 [03:53<1:18:24,  1.64s/it, lr: 1.0e-04 loss: 5.389e-01]
a-cold-wall:   5%|4         | 138/3000 [03:53<1:05:56,  1.38s/it, lr: 1.0e-04 loss: 5.389e-01]
a-cold-wall:   5%|4         | 138/3000 [03:53<1:05:56,  1.38s/it, lr: 1.0e-04 loss: 5.389e-01]
a-cold-wall:   5%|4         | 138/3000 [03:54<1:05:56,  1.38s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:   5%|4         | 138/3000 [03:54<1:05:56,  1.38s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:   5%|4         | 139/3000 [03:54<56:51,  1.19s/it, lr: 1.0e-04 loss: 6.141e-01]  
a-cold-wall:   5%|4         | 139/3000 [03:54<56:51,  1.19s/it, lr: 1.0e-04 loss: 6.141e-01]  
a-cold-wall:   5%|4         | 139/3000 [03:55<56:51,  1.19s/it, lr: 1.0e-04 loss: 3.369e-01]
a-cold-wall:   5%|4         | 139/3000 [03:55<56:51,  1.19s/it, lr: 1.0e-04 loss: 3.369e-01]
a-cold-wall:   5%|4         | 140/3000 [03:56<56:50,  1.19s/it, lr: 1.0e-04 loss: 6.511e-01]
a-cold-wall:   5%|4         | 140/3000 [03:56<56:50,  1.19s/it, lr: 1.0e-04 loss: 6.511e-01]
a-cold-wall:   5%|4         | 141/3000 [03:56<46:28,  1.03it/s, lr: 1.0e-04 loss: 6.511e-01]
a-cold-wall:   5%|4         | 141/3000 [03:56<46:28,  1.03it/s, lr: 1.0e-04 loss: 6.511e-01]
a-cold-wall:   5%|4         | 141/3000 [03:59<46:28,  1.03it/s, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:   5%|4         | 141/3000 [03:59<46:28,  1.03it/s, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:   5%|4         | 142/3000 [03:59<1:08:18,  1.43s/it, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:   5%|4         | 142/3000 [03:59<1:08:18,  1.43s/it, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:   5%|4         | 142/3000 [04:01<1:08:18,  1.43s/it, lr: 1.0e-04 loss: 4.388e-01]
a-cold-wall:   5%|4         | 142/3000 [04:01<1:08:18,  1.43s/it, lr: 1.0e-04 loss: 4.388e-01]
a-cold-wall:   5%|4         | 143/3000 [04:01<1:08:05,  1.43s/it, lr: 1.0e-04 loss: 4.388e-01]
a-cold-wall:   5%|4         | 143/3000 [04:01<1:08:05,  1.43s/it, lr: 1.0e-04 loss: 4.388e-01]
a-cold-wall:   5%|4         | 143/3000 [04:04<1:08:05,  1.43s/it, lr: 1.0e-04 loss: 4.327e-01]
a-cold-wall:   5%|4         | 143/3000 [04:04<1:08:05,  1.43s/it, lr: 1.0e-04 loss: 4.327e-01]
a-cold-wall:   5%|4         | 144/3000 [04:04<1:26:03,  1.81s/it, lr: 1.0e-04 loss: 4.327e-01]
a-cold-wall:   5%|4         | 144/3000 [04:04<1:26:03,  1.81s/it, lr: 1.0e-04 loss: 4.327e-01]
a-cold-wall:   5%|4         | 144/3000 [04:05<1:26:03,  1.81s/it, lr: 1.0e-04 loss: 4.250e-01]
a-cold-wall:   5%|4         | 144/3000 [04:05<1:26:03,  1.81s/it, lr: 1.0e-04 loss: 4.250e-01]
a-cold-wall:   5%|4         | 145/3000 [04:05<1:20:43,  1.70s/it, lr: 1.0e-04 loss: 4.250e-01]
a-cold-wall:   5%|4         | 145/3000 [04:05<1:20:43,  1.70s/it, lr: 1.0e-04 loss: 4.250e-01]
a-cold-wall:   5%|4         | 145/3000 [04:06<1:20:43,  1.70s/it, lr: 1.0e-04 loss: 6.437e-01]
a-cold-wall:   5%|4         | 145/3000 [04:06<1:20:43,  1.70s/it, lr: 1.0e-04 loss: 6.437e-01]
a-cold-wall:   5%|4         | 146/3000 [04:06<1:07:57,  1.43s/it, lr: 1.0e-04 loss: 6.437e-01]
a-cold-wall:   5%|4         | 146/3000 [04:06<1:07:57,  1.43s/it, lr: 1.0e-04 loss: 6.437e-01]
a-cold-wall:   5%|4         | 146/3000 [04:09<1:07:57,  1.43s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:   5%|4         | 146/3000 [04:09<1:07:57,  1.43s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:   5%|4         | 147/3000 [04:09<1:27:31,  1.84s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:   5%|4         | 147/3000 [04:09<1:27:31,  1.84s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:   5%|4         | 147/3000 [04:09<1:27:31,  1.84s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:   5%|4         | 147/3000 [04:09<1:27:31,  1.84s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:   5%|4         | 148/3000 [04:09<1:12:13,  1.52s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:   5%|4         | 148/3000 [04:09<1:12:13,  1.52s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:   5%|4         | 148/3000 [04:11<1:12:13,  1.52s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:   5%|4         | 148/3000 [04:11<1:12:13,  1.52s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:   5%|4         | 149/3000 [04:11<1:12:59,  1.54s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:   5%|4         | 149/3000 [04:11<1:12:59,  1.54s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:   5%|4         | 149/3000 [04:14<1:12:59,  1.54s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:   5%|4         | 149/3000 [04:14<1:12:59,  1.54s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:   5%|5         | 150/3000 [04:14<1:12:57,  1.54s/it, lr: 1.0e-04 loss: 4.191e-01]
a-cold-wall:   5%|5         | 150/3000 [04:14<1:12:57,  1.54s/it, lr: 1.0e-04 loss: 4.191e-01]
a-cold-wall:   5%|5         | 151/3000 [04:14<47:44,  1.01s/it, lr: 1.0e-04 loss: 4.191e-01]  
a-cold-wall:   5%|5         | 151/3000 [04:14<47:44,  1.01s/it, lr: 1.0e-04 loss: 4.191e-01]  
a-cold-wall:   5%|5         | 151/3000 [04:17<47:44,  1.01s/it, lr: 1.0e-04 loss: 4.193e-01]
a-cold-wall:   5%|5         | 151/3000 [04:17<47:44,  1.01s/it, lr: 1.0e-04 loss: 4.193e-01]
a-cold-wall:   5%|5         | 152/3000 [04:17<1:08:57,  1.45s/it, lr: 1.0e-04 loss: 4.193e-01]
a-cold-wall:   5%|5         | 152/3000 [04:17<1:08:57,  1.45s/it, lr: 1.0e-04 loss: 4.193e-01]
a-cold-wall:   5%|5         | 152/3000 [04:18<1:08:57,  1.45s/it, lr: 1.0e-04 loss: 4.517e-01]
a-cold-wall:   5%|5         | 152/3000 [04:18<1:08:57,  1.45s/it, lr: 1.0e-04 loss: 4.517e-01]
a-cold-wall:   5%|5         | 153/3000 [04:18<1:02:48,  1.32s/it, lr: 1.0e-04 loss: 4.517e-01]
a-cold-wall:   5%|5         | 153/3000 [04:18<1:02:48,  1.32s/it, lr: 1.0e-04 loss: 4.517e-01]
a-cold-wall:   5%|5         | 153/3000 [04:20<1:02:48,  1.32s/it, lr: 1.0e-04 loss: 8.801e-02]
a-cold-wall:   5%|5         | 153/3000 [04:20<1:02:48,  1.32s/it, lr: 1.0e-04 loss: 8.801e-02]
a-cold-wall:   5%|5         | 154/3000 [04:20<1:03:53,  1.35s/it, lr: 1.0e-04 loss: 8.801e-02]
a-cold-wall:   5%|5         | 154/3000 [04:20<1:03:53,  1.35s/it, lr: 1.0e-04 loss: 8.801e-02]
a-cold-wall:   5%|5         | 154/3000 [04:20<1:03:53,  1.35s/it, lr: 1.0e-04 loss: 1.732e-01]
a-cold-wall:   5%|5         | 154/3000 [04:20<1:03:53,  1.35s/it, lr: 1.0e-04 loss: 1.732e-01]
a-cold-wall:   5%|5         | 155/3000 [04:20<55:52,  1.18s/it, lr: 1.0e-04 loss: 1.732e-01]  
a-cold-wall:   5%|5         | 155/3000 [04:20<55:52,  1.18s/it, lr: 1.0e-04 loss: 1.732e-01]  
a-cold-wall:   5%|5         | 155/3000 [04:21<55:52,  1.18s/it, lr: 1.0e-04 loss: 3.966e-01]
a-cold-wall:   5%|5         | 155/3000 [04:21<55:52,  1.18s/it, lr: 1.0e-04 loss: 3.966e-01]
a-cold-wall:   5%|5         | 156/3000 [04:21<49:49,  1.05s/it, lr: 1.0e-04 loss: 3.966e-01]
a-cold-wall:   5%|5         | 156/3000 [04:21<49:49,  1.05s/it, lr: 1.0e-04 loss: 3.966e-01]
a-cold-wall:   5%|5         | 156/3000 [04:23<49:49,  1.05s/it, lr: 1.0e-04 loss: 5.081e-01]
a-cold-wall:   5%|5         | 156/3000 [04:23<49:49,  1.05s/it, lr: 1.0e-04 loss: 5.081e-01]
a-cold-wall:   5%|5         | 157/3000 [04:23<54:37,  1.15s/it, lr: 1.0e-04 loss: 5.081e-01]
a-cold-wall:   5%|5         | 157/3000 [04:23<54:37,  1.15s/it, lr: 1.0e-04 loss: 5.081e-01]
a-cold-wall:   5%|5         | 157/3000 [04:25<54:37,  1.15s/it, lr: 1.0e-04 loss: 1.345e-01]
a-cold-wall:   5%|5         | 157/3000 [04:25<54:37,  1.15s/it, lr: 1.0e-04 loss: 1.345e-01]
a-cold-wall:   5%|5         | 158/3000 [04:25<1:18:50,  1.66s/it, lr: 1.0e-04 loss: 1.345e-01]
a-cold-wall:   5%|5         | 158/3000 [04:25<1:18:50,  1.66s/it, lr: 1.0e-04 loss: 1.345e-01]
a-cold-wall:   5%|5         | 158/3000 [04:27<1:18:50,  1.66s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:   5%|5         | 158/3000 [04:27<1:18:50,  1.66s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:   5%|5         | 159/3000 [04:27<1:15:23,  1.59s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:   5%|5         | 159/3000 [04:27<1:15:23,  1.59s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:   5%|5         | 159/3000 [04:28<1:15:23,  1.59s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:   5%|5         | 159/3000 [04:28<1:15:23,  1.59s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:   5%|5         | 160/3000 [04:29<1:15:22,  1.59s/it, lr: 1.0e-04 loss: 8.427e-02]
a-cold-wall:   5%|5         | 160/3000 [04:29<1:15:22,  1.59s/it, lr: 1.0e-04 loss: 8.427e-02]
a-cold-wall:   5%|5         | 161/3000 [04:29<49:04,  1.04s/it, lr: 1.0e-04 loss: 8.427e-02]  
a-cold-wall:   5%|5         | 161/3000 [04:29<49:04,  1.04s/it, lr: 1.0e-04 loss: 8.427e-02]  
a-cold-wall:   5%|5         | 161/3000 [04:31<49:04,  1.04s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   5%|5         | 161/3000 [04:31<49:04,  1.04s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   5%|5         | 162/3000 [04:31<55:57,  1.18s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   5%|5         | 162/3000 [04:31<55:57,  1.18s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:   5%|5         | 162/3000 [04:32<55:57,  1.18s/it, lr: 1.0e-04 loss: 7.278e-01]
a-cold-wall:   5%|5         | 162/3000 [04:32<55:57,  1.18s/it, lr: 1.0e-04 loss: 7.278e-01]
a-cold-wall:   5%|5         | 163/3000 [04:32<58:33,  1.24s/it, lr: 1.0e-04 loss: 7.278e-01]
a-cold-wall:   5%|5         | 163/3000 [04:32<58:33,  1.24s/it, lr: 1.0e-04 loss: 7.278e-01]
a-cold-wall:   5%|5         | 163/3000 [04:35<58:33,  1.24s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:   5%|5         | 163/3000 [04:35<58:33,  1.24s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:   5%|5         | 164/3000 [04:35<1:19:17,  1.68s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:   5%|5         | 164/3000 [04:35<1:19:17,  1.68s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:   5%|5         | 164/3000 [04:38<1:19:17,  1.68s/it, lr: 1.0e-04 loss: 5.682e-01]
a-cold-wall:   5%|5         | 164/3000 [04:38<1:19:17,  1.68s/it, lr: 1.0e-04 loss: 5.682e-01]
a-cold-wall:   6%|5         | 165/3000 [04:38<1:34:48,  2.01s/it, lr: 1.0e-04 loss: 5.682e-01]
a-cold-wall:   6%|5         | 165/3000 [04:38<1:34:48,  2.01s/it, lr: 1.0e-04 loss: 5.682e-01]
a-cold-wall:   6%|5         | 165/3000 [04:39<1:34:48,  2.01s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:   6%|5         | 165/3000 [04:39<1:34:48,  2.01s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:   6%|5         | 166/3000 [04:39<1:17:48,  1.65s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:   6%|5         | 166/3000 [04:39<1:17:48,  1.65s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:   6%|5         | 166/3000 [04:40<1:17:48,  1.65s/it, lr: 1.0e-04 loss: 3.978e-01]
a-cold-wall:   6%|5         | 166/3000 [04:40<1:17:48,  1.65s/it, lr: 1.0e-04 loss: 3.978e-01]
a-cold-wall:   6%|5         | 167/3000 [04:40<1:14:23,  1.58s/it, lr: 1.0e-04 loss: 3.978e-01]
a-cold-wall:   6%|5         | 167/3000 [04:40<1:14:23,  1.58s/it, lr: 1.0e-04 loss: 3.978e-01]
a-cold-wall:   6%|5         | 167/3000 [04:41<1:14:23,  1.58s/it, lr: 1.0e-04 loss: 6.178e-01]
a-cold-wall:   6%|5         | 167/3000 [04:41<1:14:23,  1.58s/it, lr: 1.0e-04 loss: 6.178e-01]
a-cold-wall:   6%|5         | 168/3000 [04:41<1:12:22,  1.53s/it, lr: 1.0e-04 loss: 6.178e-01]
a-cold-wall:   6%|5         | 168/3000 [04:41<1:12:22,  1.53s/it, lr: 1.0e-04 loss: 6.178e-01]
a-cold-wall:   6%|5         | 168/3000 [04:42<1:12:22,  1.53s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:   6%|5         | 168/3000 [04:42<1:12:22,  1.53s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:   6%|5         | 169/3000 [04:42<1:02:26,  1.32s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:   6%|5         | 169/3000 [04:42<1:02:26,  1.32s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:   6%|5         | 169/3000 [04:43<1:02:26,  1.32s/it, lr: 1.0e-04 loss: 4.112e-01]
a-cold-wall:   6%|5         | 169/3000 [04:43<1:02:26,  1.32s/it, lr: 1.0e-04 loss: 4.112e-01]
a-cold-wall:   6%|5         | 170/3000 [04:45<1:02:24,  1.32s/it, lr: 1.0e-04 loss: 4.934e-01]
a-cold-wall:   6%|5         | 170/3000 [04:45<1:02:24,  1.32s/it, lr: 1.0e-04 loss: 4.934e-01]
a-cold-wall:   6%|5         | 171/3000 [04:45<49:12,  1.04s/it, lr: 1.0e-04 loss: 4.934e-01]  
a-cold-wall:   6%|5         | 171/3000 [04:45<49:12,  1.04s/it, lr: 1.0e-04 loss: 4.934e-01]  
a-cold-wall:   6%|5         | 171/3000 [04:47<49:12,  1.04s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:   6%|5         | 171/3000 [04:47<49:12,  1.04s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:   6%|5         | 172/3000 [04:47<1:10:19,  1.49s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:   6%|5         | 172/3000 [04:47<1:10:19,  1.49s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:   6%|5         | 172/3000 [04:50<1:10:19,  1.49s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:   6%|5         | 172/3000 [04:50<1:10:19,  1.49s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:   6%|5         | 173/3000 [04:50<1:27:13,  1.85s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:   6%|5         | 173/3000 [04:50<1:27:13,  1.85s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:   6%|5         | 173/3000 [04:53<1:27:13,  1.85s/it, lr: 1.0e-04 loss: 5.503e-02]
a-cold-wall:   6%|5         | 173/3000 [04:53<1:27:13,  1.85s/it, lr: 1.0e-04 loss: 5.503e-02]
a-cold-wall:   6%|5         | 174/3000 [04:53<1:39:43,  2.12s/it, lr: 1.0e-04 loss: 5.503e-02]
a-cold-wall:   6%|5         | 174/3000 [04:53<1:39:43,  2.12s/it, lr: 1.0e-04 loss: 5.503e-02]
a-cold-wall:   6%|5         | 174/3000 [04:55<1:39:43,  2.12s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:   6%|5         | 174/3000 [04:55<1:39:43,  2.12s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:   6%|5         | 175/3000 [04:55<1:32:45,  1.97s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:   6%|5         | 175/3000 [04:55<1:32:45,  1.97s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:   6%|5         | 175/3000 [04:55<1:32:45,  1.97s/it, lr: 1.0e-04 loss: 6.827e-01]
a-cold-wall:   6%|5         | 175/3000 [04:55<1:32:45,  1.97s/it, lr: 1.0e-04 loss: 6.827e-01]
a-cold-wall:   6%|5         | 176/3000 [04:55<1:16:11,  1.62s/it, lr: 1.0e-04 loss: 6.827e-01]
a-cold-wall:   6%|5         | 176/3000 [04:55<1:16:11,  1.62s/it, lr: 1.0e-04 loss: 6.827e-01]
a-cold-wall:   6%|5         | 176/3000 [04:56<1:16:11,  1.62s/it, lr: 1.0e-04 loss: 6.038e-02]
a-cold-wall:   6%|5         | 176/3000 [04:56<1:16:11,  1.62s/it, lr: 1.0e-04 loss: 6.038e-02]
a-cold-wall:   6%|5         | 177/3000 [04:56<1:04:27,  1.37s/it, lr: 1.0e-04 loss: 6.038e-02]
a-cold-wall:   6%|5         | 177/3000 [04:56<1:04:27,  1.37s/it, lr: 1.0e-04 loss: 6.038e-02]
a-cold-wall:   6%|5         | 177/3000 [04:59<1:04:27,  1.37s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:   6%|5         | 177/3000 [04:59<1:04:27,  1.37s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:   6%|5         | 178/3000 [04:59<1:24:53,  1.81s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:   6%|5         | 178/3000 [04:59<1:24:53,  1.81s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:   6%|5         | 178/3000 [05:02<1:24:53,  1.81s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:   6%|5         | 178/3000 [05:02<1:24:53,  1.81s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:   6%|5         | 179/3000 [05:02<1:39:11,  2.11s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:   6%|5         | 179/3000 [05:02<1:39:11,  2.11s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:   6%|5         | 179/3000 [05:03<1:39:11,  2.11s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:   6%|5         | 179/3000 [05:03<1:39:11,  2.11s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:   6%|6         | 180/3000 [05:06<1:39:09,  2.11s/it, lr: 1.0e-04 loss: 4.119e-01]
a-cold-wall:   6%|6         | 180/3000 [05:06<1:39:09,  2.11s/it, lr: 1.0e-04 loss: 4.119e-01]
a-cold-wall:   6%|6         | 181/3000 [05:06<1:24:47,  1.80s/it, lr: 1.0e-04 loss: 4.119e-01]
a-cold-wall:   6%|6         | 181/3000 [05:06<1:24:47,  1.80s/it, lr: 1.0e-04 loss: 4.119e-01]
a-cold-wall:   6%|6         | 181/3000 [05:09<1:24:47,  1.80s/it, lr: 1.0e-04 loss: 8.297e-01]
a-cold-wall:   6%|6         | 181/3000 [05:09<1:24:47,  1.80s/it, lr: 1.0e-04 loss: 8.297e-01]
a-cold-wall:   6%|6         | 182/3000 [05:09<1:37:00,  2.07s/it, lr: 1.0e-04 loss: 8.297e-01]
a-cold-wall:   6%|6         | 182/3000 [05:09<1:37:00,  2.07s/it, lr: 1.0e-04 loss: 8.297e-01]
a-cold-wall:   6%|6         | 182/3000 [05:11<1:37:00,  2.07s/it, lr: 1.0e-04 loss: 3.780e-01]
a-cold-wall:   6%|6         | 182/3000 [05:11<1:37:00,  2.07s/it, lr: 1.0e-04 loss: 3.780e-01]
a-cold-wall:   6%|6         | 183/3000 [05:11<1:29:13,  1.90s/it, lr: 1.0e-04 loss: 3.780e-01]
a-cold-wall:   6%|6         | 183/3000 [05:11<1:29:13,  1.90s/it, lr: 1.0e-04 loss: 3.780e-01]
a-cold-wall:   6%|6         | 183/3000 [05:13<1:29:13,  1.90s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:   6%|6         | 183/3000 [05:13<1:29:13,  1.90s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:   6%|6         | 184/3000 [05:13<1:41:37,  2.17s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:   6%|6         | 184/3000 [05:13<1:41:37,  2.17s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:   6%|6         | 184/3000 [05:16<1:41:37,  2.17s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:   6%|6         | 184/3000 [05:16<1:41:37,  2.17s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:   6%|6         | 185/3000 [05:16<1:50:28,  2.35s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:   6%|6         | 185/3000 [05:16<1:50:28,  2.35s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:   6%|6         | 185/3000 [05:19<1:50:28,  2.35s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:   6%|6         | 185/3000 [05:19<1:50:28,  2.35s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:   6%|6         | 186/3000 [05:19<1:57:17,  2.50s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:   6%|6         | 186/3000 [05:19<1:57:17,  2.50s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:   6%|6         | 186/3000 [05:22<1:57:17,  2.50s/it, lr: 1.0e-04 loss: 3.494e-01]
a-cold-wall:   6%|6         | 186/3000 [05:22<1:57:17,  2.50s/it, lr: 1.0e-04 loss: 3.494e-01]
a-cold-wall:   6%|6         | 187/3000 [05:22<2:02:22,  2.61s/it, lr: 1.0e-04 loss: 3.494e-01]
a-cold-wall:   6%|6         | 187/3000 [05:22<2:02:22,  2.61s/it, lr: 1.0e-04 loss: 3.494e-01]
a-cold-wall:   6%|6         | 187/3000 [05:23<2:02:22,  2.61s/it, lr: 1.0e-04 loss: 5.554e-01]
a-cold-wall:   6%|6         | 187/3000 [05:23<2:02:22,  2.61s/it, lr: 1.0e-04 loss: 5.554e-01]
a-cold-wall:   6%|6         | 188/3000 [05:23<1:36:44,  2.06s/it, lr: 1.0e-04 loss: 5.554e-01]
a-cold-wall:   6%|6         | 188/3000 [05:23<1:36:44,  2.06s/it, lr: 1.0e-04 loss: 5.554e-01]
a-cold-wall:   6%|6         | 188/3000 [05:23<1:36:44,  2.06s/it, lr: 1.0e-04 loss: 5.646e-01]
a-cold-wall:   6%|6         | 188/3000 [05:23<1:36:44,  2.06s/it, lr: 1.0e-04 loss: 5.646e-01]
a-cold-wall:   6%|6         | 189/3000 [05:23<1:18:27,  1.67s/it, lr: 1.0e-04 loss: 5.646e-01]
a-cold-wall:   6%|6         | 189/3000 [05:23<1:18:27,  1.67s/it, lr: 1.0e-04 loss: 5.646e-01]
a-cold-wall:   6%|6         | 189/3000 [05:25<1:18:27,  1.67s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:   6%|6         | 189/3000 [05:25<1:18:27,  1.67s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:   6%|6         | 190/3000 [05:28<1:18:25,  1.67s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   6%|6         | 190/3000 [05:28<1:18:25,  1.67s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   6%|6         | 191/3000 [05:28<1:13:23,  1.57s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   6%|6         | 191/3000 [05:28<1:13:23,  1.57s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:   6%|6         | 191/3000 [05:31<1:13:23,  1.57s/it, lr: 1.0e-04 loss: 2.597e-01]
a-cold-wall:   6%|6         | 191/3000 [05:31<1:13:23,  1.57s/it, lr: 1.0e-04 loss: 2.597e-01]
a-cold-wall:   6%|6         | 192/3000 [05:31<1:28:13,  1.89s/it, lr: 1.0e-04 loss: 2.597e-01]
a-cold-wall:   6%|6         | 192/3000 [05:31<1:28:13,  1.89s/it, lr: 1.0e-04 loss: 2.597e-01]
a-cold-wall:   6%|6         | 192/3000 [05:32<1:28:13,  1.89s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:   6%|6         | 192/3000 [05:32<1:28:13,  1.89s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:   6%|6         | 193/3000 [05:32<1:22:43,  1.77s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:   6%|6         | 193/3000 [05:32<1:22:43,  1.77s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:   6%|6         | 193/3000 [05:33<1:22:43,  1.77s/it, lr: 1.0e-04 loss: 2.985e-01]
a-cold-wall:   6%|6         | 193/3000 [05:33<1:22:43,  1.77s/it, lr: 1.0e-04 loss: 2.985e-01]
a-cold-wall:   6%|6         | 194/3000 [05:33<1:09:42,  1.49s/it, lr: 1.0e-04 loss: 2.985e-01]
a-cold-wall:   6%|6         | 194/3000 [05:33<1:09:42,  1.49s/it, lr: 1.0e-04 loss: 2.985e-01]
a-cold-wall:   6%|6         | 194/3000 [05:34<1:09:42,  1.49s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:   6%|6         | 194/3000 [05:34<1:09:42,  1.49s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:   6%|6         | 195/3000 [05:34<59:47,  1.28s/it, lr: 1.0e-04 loss: 3.846e-01]  
a-cold-wall:   6%|6         | 195/3000 [05:34<59:47,  1.28s/it, lr: 1.0e-04 loss: 3.846e-01]  
a-cold-wall:   6%|6         | 195/3000 [05:35<59:47,  1.28s/it, lr: 1.0e-04 loss: 7.022e-01]
a-cold-wall:   6%|6         | 195/3000 [05:35<59:47,  1.28s/it, lr: 1.0e-04 loss: 7.022e-01]
a-cold-wall:   7%|6         | 196/3000 [05:35<1:01:34,  1.32s/it, lr: 1.0e-04 loss: 7.022e-01]
a-cold-wall:   7%|6         | 196/3000 [05:35<1:01:34,  1.32s/it, lr: 1.0e-04 loss: 7.022e-01]
a-cold-wall:   7%|6         | 196/3000 [05:38<1:01:34,  1.32s/it, lr: 1.0e-04 loss: 4.434e-01]
a-cold-wall:   7%|6         | 196/3000 [05:38<1:01:34,  1.32s/it, lr: 1.0e-04 loss: 4.434e-01]
a-cold-wall:   7%|6         | 197/3000 [05:38<1:22:57,  1.78s/it, lr: 1.0e-04 loss: 4.434e-01]
a-cold-wall:   7%|6         | 197/3000 [05:38<1:22:57,  1.78s/it, lr: 1.0e-04 loss: 4.434e-01]
a-cold-wall:   7%|6         | 197/3000 [05:39<1:22:57,  1.78s/it, lr: 1.0e-04 loss: 6.008e-01]
a-cold-wall:   7%|6         | 197/3000 [05:39<1:22:57,  1.78s/it, lr: 1.0e-04 loss: 6.008e-01]
a-cold-wall:   7%|6         | 198/3000 [05:39<1:18:01,  1.67s/it, lr: 1.0e-04 loss: 6.008e-01]
a-cold-wall:   7%|6         | 198/3000 [05:39<1:18:01,  1.67s/it, lr: 1.0e-04 loss: 6.008e-01]
a-cold-wall:   7%|6         | 198/3000 [05:40<1:18:01,  1.67s/it, lr: 1.0e-04 loss: 1.009e-01]
a-cold-wall:   7%|6         | 198/3000 [05:40<1:18:01,  1.67s/it, lr: 1.0e-04 loss: 1.009e-01]
a-cold-wall:   7%|6         | 199/3000 [05:40<1:05:21,  1.40s/it, lr: 1.0e-04 loss: 1.009e-01]
a-cold-wall:   7%|6         | 199/3000 [05:40<1:05:21,  1.40s/it, lr: 1.0e-04 loss: 1.009e-01]
a-cold-wall:   7%|6         | 199/3000 [05:41<1:05:21,  1.40s/it, lr: 1.0e-04 loss: 2.192e-01]
a-cold-wall:   7%|6         | 199/3000 [05:41<1:05:21,  1.40s/it, lr: 1.0e-04 loss: 2.192e-01]
a-cold-wall:   7%|6         | 200/3000 [05:42<1:05:19,  1.40s/it, lr: 1.0e-04 loss: 6.090e-01]
a-cold-wall:   7%|6         | 200/3000 [05:42<1:05:19,  1.40s/it, lr: 1.0e-04 loss: 6.090e-01]
a-cold-wall:   7%|6         | 201/3000 [05:42<50:43,  1.09s/it, lr: 1.0e-04 loss: 6.090e-01]  
a-cold-wall:   7%|6         | 201/3000 [05:42<50:43,  1.09s/it, lr: 1.0e-04 loss: 6.090e-01]  
a-cold-wall:   7%|6         | 201/3000 [05:44<50:43,  1.09s/it, lr: 1.0e-04 loss: 4.477e-01]
a-cold-wall:   7%|6         | 201/3000 [05:44<50:43,  1.09s/it, lr: 1.0e-04 loss: 4.477e-01]
a-cold-wall:   7%|6         | 202/3000 [05:44<54:05,  1.16s/it, lr: 1.0e-04 loss: 4.477e-01]
a-cold-wall:   7%|6         | 202/3000 [05:44<54:05,  1.16s/it, lr: 1.0e-04 loss: 4.477e-01]
a-cold-wall:   7%|6         | 202/3000 [05:45<54:05,  1.16s/it, lr: 1.0e-04 loss: 2.484e-01]
a-cold-wall:   7%|6         | 202/3000 [05:45<54:05,  1.16s/it, lr: 1.0e-04 loss: 2.484e-01]
a-cold-wall:   7%|6         | 203/3000 [05:45<51:49,  1.11s/it, lr: 1.0e-04 loss: 2.484e-01]
a-cold-wall:   7%|6         | 203/3000 [05:45<51:49,  1.11s/it, lr: 1.0e-04 loss: 2.484e-01]
a-cold-wall:   7%|6         | 203/3000 [05:48<51:49,  1.11s/it, lr: 1.0e-04 loss: 5.324e-01]
a-cold-wall:   7%|6         | 203/3000 [05:48<51:49,  1.11s/it, lr: 1.0e-04 loss: 5.324e-01]
a-cold-wall:   7%|6         | 204/3000 [05:48<1:14:06,  1.59s/it, lr: 1.0e-04 loss: 5.324e-01]
a-cold-wall:   7%|6         | 204/3000 [05:48<1:14:06,  1.59s/it, lr: 1.0e-04 loss: 5.324e-01]
a-cold-wall:   7%|6         | 204/3000 [05:49<1:14:06,  1.59s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:   7%|6         | 204/3000 [05:49<1:14:06,  1.59s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:   7%|6         | 205/3000 [05:49<1:11:55,  1.54s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:   7%|6         | 205/3000 [05:49<1:11:55,  1.54s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:   7%|6         | 205/3000 [05:51<1:11:55,  1.54s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:   7%|6         | 205/3000 [05:51<1:11:55,  1.54s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:   7%|6         | 206/3000 [05:51<1:10:38,  1.52s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:   7%|6         | 206/3000 [05:51<1:10:38,  1.52s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:   7%|6         | 206/3000 [05:51<1:10:38,  1.52s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   7%|6         | 206/3000 [05:51<1:10:38,  1.52s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   7%|6         | 207/3000 [05:51<1:00:21,  1.30s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   7%|6         | 207/3000 [05:51<1:00:21,  1.30s/it, lr: 1.0e-04 loss: 5.524e-01]
a-cold-wall:   7%|6         | 207/3000 [05:52<1:00:21,  1.30s/it, lr: 1.0e-04 loss: 5.236e-01]
a-cold-wall:   7%|6         | 207/3000 [05:52<1:00:21,  1.30s/it, lr: 1.0e-04 loss: 5.236e-01]
a-cold-wall:   7%|6         | 208/3000 [05:52<52:55,  1.14s/it, lr: 1.0e-04 loss: 5.236e-01]  
a-cold-wall:   7%|6         | 208/3000 [05:52<52:55,  1.14s/it, lr: 1.0e-04 loss: 5.236e-01]  
a-cold-wall:   7%|6         | 208/3000 [05:53<52:55,  1.14s/it, lr: 1.0e-04 loss: 3.692e-02]
a-cold-wall:   7%|6         | 208/3000 [05:53<52:55,  1.14s/it, lr: 1.0e-04 loss: 3.692e-02]
a-cold-wall:   7%|6         | 209/3000 [05:53<47:48,  1.03s/it, lr: 1.0e-04 loss: 3.692e-02]
a-cold-wall:   7%|6         | 209/3000 [05:53<47:48,  1.03s/it, lr: 1.0e-04 loss: 3.692e-02]
a-cold-wall:   7%|6         | 209/3000 [05:56<47:48,  1.03s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   7%|6         | 209/3000 [05:56<47:48,  1.03s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   7%|7         | 210/3000 [05:57<47:47,  1.03s/it, lr: 1.0e-04 loss: 6.793e-01]
a-cold-wall:   7%|7         | 210/3000 [05:57<47:47,  1.03s/it, lr: 1.0e-04 loss: 6.793e-01]
a-cold-wall:   7%|7         | 211/3000 [05:57<34:02,  1.37it/s, lr: 1.0e-04 loss: 6.793e-01]
a-cold-wall:   7%|7         | 211/3000 [05:57<34:02,  1.37it/s, lr: 1.0e-04 loss: 6.793e-01]
a-cold-wall:   7%|7         | 211/3000 [05:58<34:02,  1.37it/s, lr: 1.0e-04 loss: 6.119e-01]
a-cold-wall:   7%|7         | 211/3000 [05:58<34:02,  1.37it/s, lr: 1.0e-04 loss: 6.119e-01]
a-cold-wall:   7%|7         | 212/3000 [05:58<34:10,  1.36it/s, lr: 1.0e-04 loss: 6.119e-01]
a-cold-wall:   7%|7         | 212/3000 [05:58<34:10,  1.36it/s, lr: 1.0e-04 loss: 6.119e-01]
a-cold-wall:   7%|7         | 212/3000 [06:01<34:10,  1.36it/s, lr: 1.0e-04 loss: 7.390e-01]
a-cold-wall:   7%|7         | 212/3000 [06:01<34:10,  1.36it/s, lr: 1.0e-04 loss: 7.390e-01]
a-cold-wall:   7%|7         | 213/3000 [06:01<1:00:08,  1.29s/it, lr: 1.0e-04 loss: 7.390e-01]
a-cold-wall:   7%|7         | 213/3000 [06:01<1:00:08,  1.29s/it, lr: 1.0e-04 loss: 7.390e-01]
a-cold-wall:   7%|7         | 213/3000 [06:01<1:00:08,  1.29s/it, lr: 1.0e-04 loss: 4.407e-01]
a-cold-wall:   7%|7         | 213/3000 [06:01<1:00:08,  1.29s/it, lr: 1.0e-04 loss: 4.407e-01]
a-cold-wall:   7%|7         | 214/3000 [06:01<53:32,  1.15s/it, lr: 1.0e-04 loss: 4.407e-01]  
a-cold-wall:   7%|7         | 214/3000 [06:01<53:32,  1.15s/it, lr: 1.0e-04 loss: 4.407e-01]  
a-cold-wall:   7%|7         | 214/3000 [06:03<53:32,  1.15s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:   7%|7         | 214/3000 [06:03<53:32,  1.15s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:   7%|7         | 215/3000 [06:03<56:24,  1.22s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:   7%|7         | 215/3000 [06:03<56:24,  1.22s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:   7%|7         | 215/3000 [06:04<56:24,  1.22s/it, lr: 1.0e-04 loss: 3.206e-01]
a-cold-wall:   7%|7         | 215/3000 [06:04<56:24,  1.22s/it, lr: 1.0e-04 loss: 3.206e-01]
a-cold-wall:   7%|7         | 216/3000 [06:04<59:17,  1.28s/it, lr: 1.0e-04 loss: 3.206e-01]
a-cold-wall:   7%|7         | 216/3000 [06:04<59:17,  1.28s/it, lr: 1.0e-04 loss: 3.206e-01]
a-cold-wall:   7%|7         | 216/3000 [06:06<59:17,  1.28s/it, lr: 1.0e-04 loss: 6.052e-01]
a-cold-wall:   7%|7         | 216/3000 [06:06<59:17,  1.28s/it, lr: 1.0e-04 loss: 6.052e-01]
a-cold-wall:   7%|7         | 217/3000 [06:06<1:04:19,  1.39s/it, lr: 1.0e-04 loss: 6.052e-01]
a-cold-wall:   7%|7         | 217/3000 [06:06<1:04:19,  1.39s/it, lr: 1.0e-04 loss: 6.052e-01]
a-cold-wall:   7%|7         | 217/3000 [06:09<1:04:19,  1.39s/it, lr: 1.0e-04 loss: 1.381e-01]
a-cold-wall:   7%|7         | 217/3000 [06:09<1:04:19,  1.39s/it, lr: 1.0e-04 loss: 1.381e-01]
a-cold-wall:   7%|7         | 218/3000 [06:09<1:25:25,  1.84s/it, lr: 1.0e-04 loss: 1.381e-01]
a-cold-wall:   7%|7         | 218/3000 [06:09<1:25:25,  1.84s/it, lr: 1.0e-04 loss: 1.381e-01]
a-cold-wall:   7%|7         | 218/3000 [06:12<1:25:25,  1.84s/it, lr: 1.0e-04 loss: 3.707e-01]
a-cold-wall:   7%|7         | 218/3000 [06:12<1:25:25,  1.84s/it, lr: 1.0e-04 loss: 3.707e-01]
a-cold-wall:   7%|7         | 219/3000 [06:12<1:39:22,  2.14s/it, lr: 1.0e-04 loss: 3.707e-01]
a-cold-wall:   7%|7         | 219/3000 [06:12<1:39:22,  2.14s/it, lr: 1.0e-04 loss: 3.707e-01]
a-cold-wall:   7%|7         | 219/3000 [06:14<1:39:22,  2.14s/it, lr: 1.0e-04 loss: 6.295e-01]
a-cold-wall:   7%|7         | 219/3000 [06:14<1:39:22,  2.14s/it, lr: 1.0e-04 loss: 6.295e-01]
a-cold-wall:   7%|7         | 220/3000 [06:16<1:39:20,  2.14s/it, lr: 1.0e-04 loss: 6.017e-01]
a-cold-wall:   7%|7         | 220/3000 [06:16<1:39:20,  2.14s/it, lr: 1.0e-04 loss: 6.017e-01]
a-cold-wall:   7%|7         | 221/3000 [06:16<1:09:05,  1.49s/it, lr: 1.0e-04 loss: 6.017e-01]
a-cold-wall:   7%|7         | 221/3000 [06:16<1:09:05,  1.49s/it, lr: 1.0e-04 loss: 6.017e-01]
a-cold-wall:   7%|7         | 221/3000 [06:17<1:09:05,  1.49s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:   7%|7         | 221/3000 [06:17<1:09:05,  1.49s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:   7%|7         | 222/3000 [06:17<1:08:05,  1.47s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:   7%|7         | 222/3000 [06:17<1:08:05,  1.47s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:   7%|7         | 222/3000 [06:19<1:08:05,  1.47s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:   7%|7         | 222/3000 [06:19<1:08:05,  1.47s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:   7%|7         | 223/3000 [06:19<1:07:29,  1.46s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:   7%|7         | 223/3000 [06:19<1:07:29,  1.46s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:   7%|7         | 223/3000 [06:22<1:07:29,  1.46s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:   7%|7         | 223/3000 [06:22<1:07:29,  1.46s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:   7%|7         | 224/3000 [06:22<1:25:27,  1.85s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:   7%|7         | 224/3000 [06:22<1:25:27,  1.85s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:   7%|7         | 224/3000 [06:25<1:25:27,  1.85s/it, lr: 1.0e-04 loss: 7.453e-01]
a-cold-wall:   7%|7         | 224/3000 [06:25<1:25:27,  1.85s/it, lr: 1.0e-04 loss: 7.453e-01]
a-cold-wall:   8%|7         | 225/3000 [06:25<1:38:45,  2.14s/it, lr: 1.0e-04 loss: 7.453e-01]
a-cold-wall:   8%|7         | 225/3000 [06:25<1:38:45,  2.14s/it, lr: 1.0e-04 loss: 7.453e-01]
a-cold-wall:   8%|7         | 225/3000 [06:26<1:38:45,  2.14s/it, lr: 1.0e-04 loss: 1.361e-01]
a-cold-wall:   8%|7         | 225/3000 [06:26<1:38:45,  2.14s/it, lr: 1.0e-04 loss: 1.361e-01]
a-cold-wall:   8%|7         | 226/3000 [06:26<1:30:21,  1.95s/it, lr: 1.0e-04 loss: 1.361e-01]
a-cold-wall:   8%|7         | 226/3000 [06:26<1:30:21,  1.95s/it, lr: 1.0e-04 loss: 1.361e-01]
a-cold-wall:   8%|7         | 226/3000 [06:27<1:30:21,  1.95s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:   8%|7         | 226/3000 [06:27<1:30:21,  1.95s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:   8%|7         | 227/3000 [06:27<1:14:17,  1.61s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:   8%|7         | 227/3000 [06:27<1:14:17,  1.61s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:   8%|7         | 227/3000 [06:30<1:14:17,  1.61s/it, lr: 1.0e-04 loss: 6.584e-01]
a-cold-wall:   8%|7         | 227/3000 [06:30<1:14:17,  1.61s/it, lr: 1.0e-04 loss: 6.584e-01]
a-cold-wall:   8%|7         | 228/3000 [06:30<1:31:32,  1.98s/it, lr: 1.0e-04 loss: 6.584e-01]
a-cold-wall:   8%|7         | 228/3000 [06:30<1:31:32,  1.98s/it, lr: 1.0e-04 loss: 6.584e-01]
a-cold-wall:   8%|7         | 228/3000 [06:30<1:31:32,  1.98s/it, lr: 1.0e-04 loss: 5.957e-01]
a-cold-wall:   8%|7         | 228/3000 [06:30<1:31:32,  1.98s/it, lr: 1.0e-04 loss: 5.957e-01]
a-cold-wall:   8%|7         | 229/3000 [06:30<1:14:40,  1.62s/it, lr: 1.0e-04 loss: 5.957e-01]
a-cold-wall:   8%|7         | 229/3000 [06:30<1:14:40,  1.62s/it, lr: 1.0e-04 loss: 5.957e-01]
a-cold-wall:   8%|7         | 229/3000 [06:32<1:14:40,  1.62s/it, lr: 1.0e-04 loss: 7.221e-01]
a-cold-wall:   8%|7         | 229/3000 [06:32<1:14:40,  1.62s/it, lr: 1.0e-04 loss: 7.221e-01]
a-cold-wall:   8%|7         | 230/3000 [06:33<1:14:39,  1.62s/it, lr: 1.0e-04 loss: 5.368e-01]
a-cold-wall:   8%|7         | 230/3000 [06:33<1:14:39,  1.62s/it, lr: 1.0e-04 loss: 5.368e-01]
a-cold-wall:   8%|7         | 231/3000 [06:33<54:59,  1.19s/it, lr: 1.0e-04 loss: 5.368e-01]  
a-cold-wall:   8%|7         | 231/3000 [06:33<54:59,  1.19s/it, lr: 1.0e-04 loss: 5.368e-01]  
a-cold-wall:   8%|7         | 231/3000 [06:35<54:59,  1.19s/it, lr: 1.0e-04 loss: 6.867e-01]
a-cold-wall:   8%|7         | 231/3000 [06:35<54:59,  1.19s/it, lr: 1.0e-04 loss: 6.867e-01]
a-cold-wall:   8%|7         | 232/3000 [06:35<57:44,  1.25s/it, lr: 1.0e-04 loss: 6.867e-01]
a-cold-wall:   8%|7         | 232/3000 [06:35<57:44,  1.25s/it, lr: 1.0e-04 loss: 6.867e-01]
a-cold-wall:   8%|7         | 232/3000 [06:36<57:44,  1.25s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   8%|7         | 232/3000 [06:36<57:44,  1.25s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   8%|7         | 233/3000 [06:36<59:54,  1.30s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   8%|7         | 233/3000 [06:36<59:54,  1.30s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:   8%|7         | 233/3000 [06:37<59:54,  1.30s/it, lr: 1.0e-04 loss: 1.876e-01]
a-cold-wall:   8%|7         | 233/3000 [06:37<59:54,  1.30s/it, lr: 1.0e-04 loss: 1.876e-01]
a-cold-wall:   8%|7         | 234/3000 [06:37<53:00,  1.15s/it, lr: 1.0e-04 loss: 1.876e-01]
a-cold-wall:   8%|7         | 234/3000 [06:37<53:00,  1.15s/it, lr: 1.0e-04 loss: 1.876e-01]
a-cold-wall:   8%|7         | 234/3000 [06:40<53:00,  1.15s/it, lr: 1.0e-04 loss: 2.978e-01]
a-cold-wall:   8%|7         | 234/3000 [06:40<53:00,  1.15s/it, lr: 1.0e-04 loss: 2.978e-01]
a-cold-wall:   8%|7         | 235/3000 [06:40<1:15:11,  1.63s/it, lr: 1.0e-04 loss: 2.978e-01]
a-cold-wall:   8%|7         | 235/3000 [06:40<1:15:11,  1.63s/it, lr: 1.0e-04 loss: 2.978e-01]
a-cold-wall:   8%|7         | 235/3000 [06:41<1:15:11,  1.63s/it, lr: 1.0e-04 loss: 5.483e-01]
a-cold-wall:   8%|7         | 235/3000 [06:41<1:15:11,  1.63s/it, lr: 1.0e-04 loss: 5.483e-01]
a-cold-wall:   8%|7         | 236/3000 [06:41<1:03:35,  1.38s/it, lr: 1.0e-04 loss: 5.483e-01]
a-cold-wall:   8%|7         | 236/3000 [06:41<1:03:35,  1.38s/it, lr: 1.0e-04 loss: 5.483e-01]
a-cold-wall:   8%|7         | 236/3000 [06:42<1:03:35,  1.38s/it, lr: 1.0e-04 loss: 1.433e-01]
a-cold-wall:   8%|7         | 236/3000 [06:42<1:03:35,  1.38s/it, lr: 1.0e-04 loss: 1.433e-01]
a-cold-wall:   8%|7         | 237/3000 [06:42<1:04:03,  1.39s/it, lr: 1.0e-04 loss: 1.433e-01]
a-cold-wall:   8%|7         | 237/3000 [06:42<1:04:03,  1.39s/it, lr: 1.0e-04 loss: 1.433e-01]
a-cold-wall:   8%|7         | 237/3000 [06:45<1:04:03,  1.39s/it, lr: 1.0e-04 loss: 4.799e-01]
a-cold-wall:   8%|7         | 237/3000 [06:45<1:04:03,  1.39s/it, lr: 1.0e-04 loss: 4.799e-01]
a-cold-wall:   8%|7         | 238/3000 [06:45<1:23:51,  1.82s/it, lr: 1.0e-04 loss: 4.799e-01]
a-cold-wall:   8%|7         | 238/3000 [06:45<1:23:51,  1.82s/it, lr: 1.0e-04 loss: 4.799e-01]
a-cold-wall:   8%|7         | 238/3000 [06:46<1:23:51,  1.82s/it, lr: 1.0e-04 loss: 7.600e-01]
a-cold-wall:   8%|7         | 238/3000 [06:46<1:23:51,  1.82s/it, lr: 1.0e-04 loss: 7.600e-01]
a-cold-wall:   8%|7         | 239/3000 [06:46<1:09:17,  1.51s/it, lr: 1.0e-04 loss: 7.600e-01]
a-cold-wall:   8%|7         | 239/3000 [06:46<1:09:17,  1.51s/it, lr: 1.0e-04 loss: 7.600e-01]
a-cold-wall:   8%|7         | 239/3000 [06:49<1:09:17,  1.51s/it, lr: 1.0e-04 loss: 1.907e-01]
a-cold-wall:   8%|7         | 239/3000 [06:49<1:09:17,  1.51s/it, lr: 1.0e-04 loss: 1.907e-01]
a-cold-wall:   8%|8         | 240/3000 [06:51<1:09:15,  1.51s/it, lr: 1.0e-04 loss: 6.544e-01]
a-cold-wall:   8%|8         | 240/3000 [06:51<1:09:15,  1.51s/it, lr: 1.0e-04 loss: 6.544e-01]
a-cold-wall:   8%|8         | 241/3000 [06:51<1:07:50,  1.48s/it, lr: 1.0e-04 loss: 6.544e-01]
a-cold-wall:   8%|8         | 241/3000 [06:51<1:07:50,  1.48s/it, lr: 1.0e-04 loss: 6.544e-01]
a-cold-wall:   8%|8         | 241/3000 [06:54<1:07:50,  1.48s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:   8%|8         | 241/3000 [06:54<1:07:50,  1.48s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:   8%|8         | 242/3000 [06:54<1:23:10,  1.81s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:   8%|8         | 242/3000 [06:54<1:23:10,  1.81s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:   8%|8         | 242/3000 [06:56<1:23:10,  1.81s/it, lr: 1.0e-04 loss: 3.561e-01]
a-cold-wall:   8%|8         | 242/3000 [06:56<1:23:10,  1.81s/it, lr: 1.0e-04 loss: 3.561e-01]
a-cold-wall:   8%|8         | 243/3000 [06:56<1:18:29,  1.71s/it, lr: 1.0e-04 loss: 3.561e-01]
a-cold-wall:   8%|8         | 243/3000 [06:56<1:18:29,  1.71s/it, lr: 1.0e-04 loss: 3.561e-01]
a-cold-wall:   8%|8         | 243/3000 [06:57<1:18:29,  1.71s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:   8%|8         | 243/3000 [06:57<1:18:29,  1.71s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:   8%|8         | 244/3000 [06:57<1:09:26,  1.51s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:   8%|8         | 244/3000 [06:57<1:09:26,  1.51s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:   8%|8         | 244/3000 [06:59<1:09:26,  1.51s/it, lr: 1.0e-04 loss: 4.163e-01]
a-cold-wall:   8%|8         | 244/3000 [06:59<1:09:26,  1.51s/it, lr: 1.0e-04 loss: 4.163e-01]
a-cold-wall:   8%|8         | 245/3000 [06:59<1:26:27,  1.88s/it, lr: 1.0e-04 loss: 4.163e-01]
a-cold-wall:   8%|8         | 245/3000 [06:59<1:26:27,  1.88s/it, lr: 1.0e-04 loss: 4.163e-01]
a-cold-wall:   8%|8         | 245/3000 [07:01<1:26:27,  1.88s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   8%|8         | 245/3000 [07:01<1:26:27,  1.88s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   8%|8         | 246/3000 [07:01<1:20:19,  1.75s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   8%|8         | 246/3000 [07:01<1:20:19,  1.75s/it, lr: 1.0e-04 loss: 6.413e-01]
a-cold-wall:   8%|8         | 246/3000 [07:04<1:20:19,  1.75s/it, lr: 1.0e-04 loss: 5.367e-01]
a-cold-wall:   8%|8         | 246/3000 [07:04<1:20:19,  1.75s/it, lr: 1.0e-04 loss: 5.367e-01]
a-cold-wall:   8%|8         | 247/3000 [07:04<1:34:49,  2.07s/it, lr: 1.0e-04 loss: 5.367e-01]
a-cold-wall:   8%|8         | 247/3000 [07:04<1:34:49,  2.07s/it, lr: 1.0e-04 loss: 5.367e-01]
a-cold-wall:   8%|8         | 247/3000 [07:05<1:34:49,  2.07s/it, lr: 1.0e-04 loss: 5.200e-02]
a-cold-wall:   8%|8         | 247/3000 [07:05<1:34:49,  2.07s/it, lr: 1.0e-04 loss: 5.200e-02]
a-cold-wall:   8%|8         | 248/3000 [07:05<1:26:06,  1.88s/it, lr: 1.0e-04 loss: 5.200e-02]
a-cold-wall:   8%|8         | 248/3000 [07:05<1:26:06,  1.88s/it, lr: 1.0e-04 loss: 5.200e-02]
a-cold-wall:   8%|8         | 248/3000 [07:06<1:26:06,  1.88s/it, lr: 1.0e-04 loss: 6.566e-01]
a-cold-wall:   8%|8         | 248/3000 [07:06<1:26:06,  1.88s/it, lr: 1.0e-04 loss: 6.566e-01]
a-cold-wall:   8%|8         | 249/3000 [07:06<1:10:46,  1.54s/it, lr: 1.0e-04 loss: 6.566e-01]
a-cold-wall:   8%|8         | 249/3000 [07:06<1:10:46,  1.54s/it, lr: 1.0e-04 loss: 6.566e-01]
a-cold-wall:   8%|8         | 249/3000 [07:07<1:10:46,  1.54s/it, lr: 1.0e-04 loss: 3.419e-01]
a-cold-wall:   8%|8         | 249/3000 [07:07<1:10:46,  1.54s/it, lr: 1.0e-04 loss: 3.419e-01]
Saving at step 250
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000000250.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt

a-cold-wall:   8%|8         | 250/3000 [07:09<1:10:44,  1.54s/it, lr: 1.0e-04 loss: 4.953e-01]
a-cold-wall:   8%|8         | 250/3000 [07:09<1:10:44,  1.54s/it, lr: 1.0e-04 loss: 4.953e-01]
a-cold-wall:   8%|8         | 251/3000 [07:09<56:48,  1.24s/it, lr: 1.0e-04 loss: 4.953e-01]  
a-cold-wall:   8%|8         | 251/3000 [07:09<56:48,  1.24s/it, lr: 1.0e-04 loss: 4.953e-01]  
a-cold-wall:   8%|8         | 251/3000 [07:12<56:48,  1.24s/it, lr: 1.0e-04 loss: 3.814e-01]
a-cold-wall:   8%|8         | 251/3000 [07:12<56:48,  1.24s/it, lr: 1.0e-04 loss: 3.814e-01]
a-cold-wall:   8%|8         | 252/3000 [07:12<1:15:08,  1.64s/it, lr: 1.0e-04 loss: 3.814e-01]
a-cold-wall:   8%|8         | 252/3000 [07:12<1:15:08,  1.64s/it, lr: 1.0e-04 loss: 3.814e-01]
a-cold-wall:   8%|8         | 252/3000 [07:13<1:15:08,  1.64s/it, lr: 1.0e-04 loss: 8.460e-01]
a-cold-wall:   8%|8         | 252/3000 [07:13<1:15:08,  1.64s/it, lr: 1.0e-04 loss: 8.460e-01]
a-cold-wall:   8%|8         | 253/3000 [07:13<1:12:32,  1.58s/it, lr: 1.0e-04 loss: 8.460e-01]
a-cold-wall:   8%|8         | 253/3000 [07:13<1:12:32,  1.58s/it, lr: 1.0e-04 loss: 8.460e-01]
a-cold-wall:   8%|8         | 253/3000 [07:15<1:12:32,  1.58s/it, lr: 1.0e-04 loss: 5.252e-02]
a-cold-wall:   8%|8         | 253/3000 [07:15<1:12:32,  1.58s/it, lr: 1.0e-04 loss: 5.252e-02]
a-cold-wall:   8%|8         | 254/3000 [07:15<1:10:15,  1.54s/it, lr: 1.0e-04 loss: 5.252e-02]
a-cold-wall:   8%|8         | 254/3000 [07:15<1:10:15,  1.54s/it, lr: 1.0e-04 loss: 5.252e-02]
a-cold-wall:   8%|8         | 254/3000 [07:16<1:10:15,  1.54s/it, lr: 1.0e-04 loss: 3.800e-01]
a-cold-wall:   8%|8         | 254/3000 [07:16<1:10:15,  1.54s/it, lr: 1.0e-04 loss: 3.800e-01]
a-cold-wall:   8%|8         | 255/3000 [07:16<1:00:16,  1.32s/it, lr: 1.0e-04 loss: 3.800e-01]
a-cold-wall:   8%|8         | 255/3000 [07:16<1:00:16,  1.32s/it, lr: 1.0e-04 loss: 3.800e-01]
a-cold-wall:   8%|8         | 255/3000 [07:18<1:00:16,  1.32s/it, lr: 1.0e-04 loss: 2.479e-01]
a-cold-wall:   8%|8         | 255/3000 [07:18<1:00:16,  1.32s/it, lr: 1.0e-04 loss: 2.479e-01]
a-cold-wall:   9%|8         | 256/3000 [07:18<1:20:08,  1.75s/it, lr: 1.0e-04 loss: 2.479e-01]
a-cold-wall:   9%|8         | 256/3000 [07:18<1:20:08,  1.75s/it, lr: 1.0e-04 loss: 2.479e-01]
a-cold-wall:   9%|8         | 256/3000 [07:20<1:20:08,  1.75s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:   9%|8         | 256/3000 [07:20<1:20:08,  1.75s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:   9%|8         | 257/3000 [07:20<1:15:35,  1.65s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:   9%|8         | 257/3000 [07:20<1:15:35,  1.65s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:   9%|8         | 257/3000 [07:21<1:15:35,  1.65s/it, lr: 1.0e-04 loss: 3.741e-01]
a-cold-wall:   9%|8         | 257/3000 [07:21<1:15:35,  1.65s/it, lr: 1.0e-04 loss: 3.741e-01]
a-cold-wall:   9%|8         | 258/3000 [07:21<1:12:33,  1.59s/it, lr: 1.0e-04 loss: 3.741e-01]
a-cold-wall:   9%|8         | 258/3000 [07:21<1:12:33,  1.59s/it, lr: 1.0e-04 loss: 3.741e-01]
a-cold-wall:   9%|8         | 258/3000 [07:22<1:12:33,  1.59s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:   9%|8         | 258/3000 [07:22<1:12:33,  1.59s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:   9%|8         | 259/3000 [07:22<1:01:02,  1.34s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:   9%|8         | 259/3000 [07:22<1:01:02,  1.34s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:   9%|8         | 259/3000 [07:23<1:01:02,  1.34s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:   9%|8         | 259/3000 [07:23<1:01:02,  1.34s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:   9%|8         | 260/3000 [07:25<1:01:01,  1.34s/it, lr: 1.0e-04 loss: 4.521e-01]
a-cold-wall:   9%|8         | 260/3000 [07:25<1:01:01,  1.34s/it, lr: 1.0e-04 loss: 4.521e-01]
a-cold-wall:   9%|8         | 261/3000 [07:25<47:42,  1.05s/it, lr: 1.0e-04 loss: 4.521e-01]  
a-cold-wall:   9%|8         | 261/3000 [07:25<47:42,  1.05s/it, lr: 1.0e-04 loss: 4.521e-01]  
a-cold-wall:   9%|8         | 261/3000 [07:25<47:42,  1.05s/it, lr: 1.0e-04 loss: 5.881e-01]
a-cold-wall:   9%|8         | 261/3000 [07:25<47:42,  1.05s/it, lr: 1.0e-04 loss: 5.881e-01]
a-cold-wall:   9%|8         | 262/3000 [07:26<44:24,  1.03it/s, lr: 1.0e-04 loss: 5.881e-01]
a-cold-wall:   9%|8         | 262/3000 [07:26<44:24,  1.03it/s, lr: 1.0e-04 loss: 5.881e-01]
a-cold-wall:   9%|8         | 262/3000 [07:27<44:24,  1.03it/s, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:   9%|8         | 262/3000 [07:27<44:24,  1.03it/s, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:   9%|8         | 263/3000 [07:27<51:35,  1.13s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:   9%|8         | 263/3000 [07:27<51:35,  1.13s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:   9%|8         | 263/3000 [07:28<51:35,  1.13s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:   9%|8         | 263/3000 [07:28<51:35,  1.13s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:   9%|8         | 264/3000 [07:28<55:03,  1.21s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:   9%|8         | 264/3000 [07:28<55:03,  1.21s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:   9%|8         | 264/3000 [07:31<55:03,  1.21s/it, lr: 1.0e-04 loss: 6.244e-01]
a-cold-wall:   9%|8         | 264/3000 [07:31<55:03,  1.21s/it, lr: 1.0e-04 loss: 6.244e-01]
a-cold-wall:   9%|8         | 265/3000 [07:31<1:16:28,  1.68s/it, lr: 1.0e-04 loss: 6.244e-01]
a-cold-wall:   9%|8         | 265/3000 [07:31<1:16:28,  1.68s/it, lr: 1.0e-04 loss: 6.244e-01]
a-cold-wall:   9%|8         | 265/3000 [07:33<1:16:28,  1.68s/it, lr: 1.0e-04 loss: 4.521e-02]
a-cold-wall:   9%|8         | 265/3000 [07:33<1:16:28,  1.68s/it, lr: 1.0e-04 loss: 4.521e-02]
a-cold-wall:   9%|8         | 266/3000 [07:33<1:12:55,  1.60s/it, lr: 1.0e-04 loss: 4.521e-02]
a-cold-wall:   9%|8         | 266/3000 [07:33<1:12:55,  1.60s/it, lr: 1.0e-04 loss: 4.521e-02]
a-cold-wall:   9%|8         | 266/3000 [07:36<1:12:55,  1.60s/it, lr: 1.0e-04 loss: 7.176e-01]
a-cold-wall:   9%|8         | 266/3000 [07:36<1:12:55,  1.60s/it, lr: 1.0e-04 loss: 7.176e-01]
a-cold-wall:   9%|8         | 267/3000 [07:36<1:29:06,  1.96s/it, lr: 1.0e-04 loss: 7.176e-01]
a-cold-wall:   9%|8         | 267/3000 [07:36<1:29:06,  1.96s/it, lr: 1.0e-04 loss: 7.176e-01]
a-cold-wall:   9%|8         | 267/3000 [07:36<1:29:06,  1.96s/it, lr: 1.0e-04 loss: 3.355e-01]
a-cold-wall:   9%|8         | 267/3000 [07:36<1:29:06,  1.96s/it, lr: 1.0e-04 loss: 3.355e-01]
a-cold-wall:   9%|8         | 268/3000 [07:36<1:12:53,  1.60s/it, lr: 1.0e-04 loss: 3.355e-01]
a-cold-wall:   9%|8         | 268/3000 [07:36<1:12:53,  1.60s/it, lr: 1.0e-04 loss: 3.355e-01]
a-cold-wall:   9%|8         | 268/3000 [07:39<1:12:53,  1.60s/it, lr: 1.0e-04 loss: 5.234e-01]
a-cold-wall:   9%|8         | 268/3000 [07:39<1:12:53,  1.60s/it, lr: 1.0e-04 loss: 5.234e-01]
a-cold-wall:   9%|8         | 269/3000 [07:39<1:29:50,  1.97s/it, lr: 1.0e-04 loss: 5.234e-01]
a-cold-wall:   9%|8         | 269/3000 [07:39<1:29:50,  1.97s/it, lr: 1.0e-04 loss: 5.234e-01]
a-cold-wall:   9%|8         | 269/3000 [07:42<1:29:50,  1.97s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:   9%|8         | 269/3000 [07:42<1:29:50,  1.97s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:   9%|9         | 270/3000 [07:45<1:29:48,  1.97s/it, lr: 1.0e-04 loss: 5.378e-01]
a-cold-wall:   9%|9         | 270/3000 [07:45<1:29:48,  1.97s/it, lr: 1.0e-04 loss: 5.378e-01]
a-cold-wall:   9%|9         | 271/3000 [07:45<1:18:16,  1.72s/it, lr: 1.0e-04 loss: 5.378e-01]
a-cold-wall:   9%|9         | 271/3000 [07:45<1:18:16,  1.72s/it, lr: 1.0e-04 loss: 5.378e-01]
a-cold-wall:   9%|9         | 271/3000 [07:46<1:18:16,  1.72s/it, lr: 1.0e-04 loss: 2.542e-01]
a-cold-wall:   9%|9         | 271/3000 [07:46<1:18:16,  1.72s/it, lr: 1.0e-04 loss: 2.542e-01]
a-cold-wall:   9%|9         | 272/3000 [07:46<1:07:15,  1.48s/it, lr: 1.0e-04 loss: 2.542e-01]
a-cold-wall:   9%|9         | 272/3000 [07:46<1:07:15,  1.48s/it, lr: 1.0e-04 loss: 2.542e-01]
a-cold-wall:   9%|9         | 272/3000 [07:47<1:07:15,  1.48s/it, lr: 1.0e-04 loss: 7.862e-01]
a-cold-wall:   9%|9         | 272/3000 [07:47<1:07:15,  1.48s/it, lr: 1.0e-04 loss: 7.862e-01]
a-cold-wall:   9%|9         | 273/3000 [07:47<1:06:45,  1.47s/it, lr: 1.0e-04 loss: 7.862e-01]
a-cold-wall:   9%|9         | 273/3000 [07:47<1:06:45,  1.47s/it, lr: 1.0e-04 loss: 7.862e-01]
a-cold-wall:   9%|9         | 273/3000 [07:48<1:06:45,  1.47s/it, lr: 1.0e-04 loss: 1.025e-02]
a-cold-wall:   9%|9         | 273/3000 [07:48<1:06:45,  1.47s/it, lr: 1.0e-04 loss: 1.025e-02]
a-cold-wall:   9%|9         | 274/3000 [07:48<57:49,  1.27s/it, lr: 1.0e-04 loss: 1.025e-02]  
a-cold-wall:   9%|9         | 274/3000 [07:48<57:49,  1.27s/it, lr: 1.0e-04 loss: 1.025e-02]  
a-cold-wall:   9%|9         | 274/3000 [07:49<57:49,  1.27s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 274/3000 [07:49<57:49,  1.27s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 275/3000 [07:49<59:31,  1.31s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 275/3000 [07:49<59:31,  1.31s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 275/3000 [07:52<59:31,  1.31s/it, lr: 1.0e-04 loss: 6.786e-01]
a-cold-wall:   9%|9         | 275/3000 [07:52<59:31,  1.31s/it, lr: 1.0e-04 loss: 6.786e-01]
a-cold-wall:   9%|9         | 276/3000 [07:52<1:19:16,  1.75s/it, lr: 1.0e-04 loss: 6.786e-01]
a-cold-wall:   9%|9         | 276/3000 [07:52<1:19:16,  1.75s/it, lr: 1.0e-04 loss: 6.786e-01]
a-cold-wall:   9%|9         | 276/3000 [07:53<1:19:16,  1.75s/it, lr: 1.0e-04 loss: 4.437e-01]
a-cold-wall:   9%|9         | 276/3000 [07:53<1:19:16,  1.75s/it, lr: 1.0e-04 loss: 4.437e-01]
a-cold-wall:   9%|9         | 277/3000 [07:53<1:09:01,  1.52s/it, lr: 1.0e-04 loss: 4.437e-01]
a-cold-wall:   9%|9         | 277/3000 [07:53<1:09:01,  1.52s/it, lr: 1.0e-04 loss: 4.437e-01]
a-cold-wall:   9%|9         | 277/3000 [07:56<1:09:01,  1.52s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:   9%|9         | 277/3000 [07:56<1:09:01,  1.52s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:   9%|9         | 278/3000 [07:56<1:26:59,  1.92s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:   9%|9         | 278/3000 [07:56<1:26:59,  1.92s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:   9%|9         | 278/3000 [07:57<1:26:59,  1.92s/it, lr: 1.0e-04 loss: 2.169e-01]
a-cold-wall:   9%|9         | 278/3000 [07:57<1:26:59,  1.92s/it, lr: 1.0e-04 loss: 2.169e-01]
a-cold-wall:   9%|9         | 279/3000 [07:57<1:20:21,  1.77s/it, lr: 1.0e-04 loss: 2.169e-01]
a-cold-wall:   9%|9         | 279/3000 [07:57<1:20:21,  1.77s/it, lr: 1.0e-04 loss: 2.169e-01]
a-cold-wall:   9%|9         | 279/3000 [07:58<1:20:21,  1.77s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 279/3000 [07:58<1:20:21,  1.77s/it, lr: 1.0e-04 loss: 7.549e-01]
a-cold-wall:   9%|9         | 280/3000 [08:01<1:20:19,  1.77s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:   9%|9         | 280/3000 [08:01<1:20:19,  1.77s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:   9%|9         | 281/3000 [08:01<1:13:31,  1.62s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:   9%|9         | 281/3000 [08:01<1:13:31,  1.62s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:   9%|9         | 281/3000 [08:02<1:13:31,  1.62s/it, lr: 1.0e-04 loss: 6.142e-01]
a-cold-wall:   9%|9         | 281/3000 [08:02<1:13:31,  1.62s/it, lr: 1.0e-04 loss: 6.142e-01]
a-cold-wall:   9%|9         | 282/3000 [08:02<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 6.142e-01]
a-cold-wall:   9%|9         | 282/3000 [08:02<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 6.142e-01]
a-cold-wall:   9%|9         | 282/3000 [08:03<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 2.704e-01]
a-cold-wall:   9%|9         | 282/3000 [08:03<1:03:39,  1.41s/it, lr: 1.0e-04 loss: 2.704e-01]
a-cold-wall:   9%|9         | 283/3000 [08:03<55:52,  1.23s/it, lr: 1.0e-04 loss: 2.704e-01]  
a-cold-wall:   9%|9         | 283/3000 [08:03<55:52,  1.23s/it, lr: 1.0e-04 loss: 2.704e-01]  
a-cold-wall:   9%|9         | 283/3000 [08:05<55:52,  1.23s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:   9%|9         | 283/3000 [08:05<55:52,  1.23s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:   9%|9         | 284/3000 [08:05<1:15:44,  1.67s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:   9%|9         | 284/3000 [08:05<1:15:44,  1.67s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:   9%|9         | 284/3000 [08:06<1:15:44,  1.67s/it, lr: 1.0e-04 loss: 6.218e-01]
a-cold-wall:   9%|9         | 284/3000 [08:06<1:15:44,  1.67s/it, lr: 1.0e-04 loss: 6.218e-01]
a-cold-wall:  10%|9         | 285/3000 [08:06<1:04:16,  1.42s/it, lr: 1.0e-04 loss: 6.218e-01]
a-cold-wall:  10%|9         | 285/3000 [08:06<1:04:16,  1.42s/it, lr: 1.0e-04 loss: 6.218e-01]
a-cold-wall:  10%|9         | 285/3000 [08:07<1:04:16,  1.42s/it, lr: 1.0e-04 loss: 1.054e-01]
a-cold-wall:  10%|9         | 285/3000 [08:07<1:04:16,  1.42s/it, lr: 1.0e-04 loss: 1.054e-01]
a-cold-wall:  10%|9         | 286/3000 [08:07<55:29,  1.23s/it, lr: 1.0e-04 loss: 1.054e-01]  
a-cold-wall:  10%|9         | 286/3000 [08:07<55:29,  1.23s/it, lr: 1.0e-04 loss: 1.054e-01]  
a-cold-wall:  10%|9         | 286/3000 [08:08<55:29,  1.23s/it, lr: 1.0e-04 loss: 1.340e-01]
a-cold-wall:  10%|9         | 286/3000 [08:08<55:29,  1.23s/it, lr: 1.0e-04 loss: 1.340e-01]
a-cold-wall:  10%|9         | 287/3000 [08:08<49:09,  1.09s/it, lr: 1.0e-04 loss: 1.340e-01]
a-cold-wall:  10%|9         | 287/3000 [08:08<49:09,  1.09s/it, lr: 1.0e-04 loss: 1.340e-01]
a-cold-wall:  10%|9         | 287/3000 [08:09<49:09,  1.09s/it, lr: 1.0e-04 loss: 1.352e-01]
a-cold-wall:  10%|9         | 287/3000 [08:09<49:09,  1.09s/it, lr: 1.0e-04 loss: 1.352e-01]
a-cold-wall:  10%|9         | 288/3000 [08:09<53:27,  1.18s/it, lr: 1.0e-04 loss: 1.352e-01]
a-cold-wall:  10%|9         | 288/3000 [08:09<53:27,  1.18s/it, lr: 1.0e-04 loss: 1.352e-01]
a-cold-wall:  10%|9         | 288/3000 [08:10<53:27,  1.18s/it, lr: 1.0e-04 loss: 9.086e-02]
a-cold-wall:  10%|9         | 288/3000 [08:10<53:27,  1.18s/it, lr: 1.0e-04 loss: 9.086e-02]
a-cold-wall:  10%|9         | 289/3000 [08:10<50:38,  1.12s/it, lr: 1.0e-04 loss: 9.086e-02]
a-cold-wall:  10%|9         | 289/3000 [08:10<50:38,  1.12s/it, lr: 1.0e-04 loss: 9.086e-02]
a-cold-wall:  10%|9         | 289/3000 [08:11<50:38,  1.12s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  10%|9         | 289/3000 [08:11<50:38,  1.12s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  10%|9         | 290/3000 [08:12<50:37,  1.12s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  10%|9         | 290/3000 [08:12<50:37,  1.12s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  10%|9         | 291/3000 [08:12<37:41,  1.20it/s, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  10%|9         | 291/3000 [08:12<37:41,  1.20it/s, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  10%|9         | 291/3000 [08:15<37:41,  1.20it/s, lr: 1.0e-04 loss: 1.931e-01]
a-cold-wall:  10%|9         | 291/3000 [08:15<37:41,  1.20it/s, lr: 1.0e-04 loss: 1.931e-01]
a-cold-wall:  10%|9         | 292/3000 [08:15<1:00:04,  1.33s/it, lr: 1.0e-04 loss: 1.931e-01]
a-cold-wall:  10%|9         | 292/3000 [08:15<1:00:04,  1.33s/it, lr: 1.0e-04 loss: 1.931e-01]
a-cold-wall:  10%|9         | 292/3000 [08:18<1:00:04,  1.33s/it, lr: 1.0e-04 loss: 2.370e-01]
a-cold-wall:  10%|9         | 292/3000 [08:18<1:00:04,  1.33s/it, lr: 1.0e-04 loss: 2.370e-01]
a-cold-wall:  10%|9         | 293/3000 [08:18<1:18:15,  1.73s/it, lr: 1.0e-04 loss: 2.370e-01]
a-cold-wall:  10%|9         | 293/3000 [08:18<1:18:15,  1.73s/it, lr: 1.0e-04 loss: 2.370e-01]
a-cold-wall:  10%|9         | 293/3000 [08:19<1:18:15,  1.73s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:  10%|9         | 293/3000 [08:19<1:18:15,  1.73s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:  10%|9         | 294/3000 [08:19<1:06:15,  1.47s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:  10%|9         | 294/3000 [08:19<1:06:15,  1.47s/it, lr: 1.0e-04 loss: 6.730e-01]
a-cold-wall:  10%|9         | 294/3000 [08:20<1:06:15,  1.47s/it, lr: 1.0e-04 loss: 2.888e-01]
a-cold-wall:  10%|9         | 294/3000 [08:20<1:06:15,  1.47s/it, lr: 1.0e-04 loss: 2.888e-01]
a-cold-wall:  10%|9         | 295/3000 [08:20<57:12,  1.27s/it, lr: 1.0e-04 loss: 2.888e-01]  
a-cold-wall:  10%|9         | 295/3000 [08:20<57:12,  1.27s/it, lr: 1.0e-04 loss: 2.888e-01]  
a-cold-wall:  10%|9         | 295/3000 [08:20<57:12,  1.27s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  10%|9         | 295/3000 [08:20<57:12,  1.27s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  10%|9         | 296/3000 [08:20<50:32,  1.12s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  10%|9         | 296/3000 [08:20<50:32,  1.12s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  10%|9         | 296/3000 [08:21<50:32,  1.12s/it, lr: 1.0e-04 loss: 7.664e-01]
a-cold-wall:  10%|9         | 296/3000 [08:21<50:32,  1.12s/it, lr: 1.0e-04 loss: 7.664e-01]
a-cold-wall:  10%|9         | 297/3000 [08:21<45:40,  1.01s/it, lr: 1.0e-04 loss: 7.664e-01]
a-cold-wall:  10%|9         | 297/3000 [08:21<45:40,  1.01s/it, lr: 1.0e-04 loss: 7.664e-01]
a-cold-wall:  10%|9         | 297/3000 [08:24<45:40,  1.01s/it, lr: 1.0e-04 loss: 3.019e-01]
a-cold-wall:  10%|9         | 297/3000 [08:24<45:40,  1.01s/it, lr: 1.0e-04 loss: 3.019e-01]
a-cold-wall:  10%|9         | 298/3000 [08:24<1:10:14,  1.56s/it, lr: 1.0e-04 loss: 3.019e-01]
a-cold-wall:  10%|9         | 298/3000 [08:24<1:10:14,  1.56s/it, lr: 1.0e-04 loss: 3.019e-01]
a-cold-wall:  10%|9         | 298/3000 [08:25<1:10:14,  1.56s/it, lr: 1.0e-04 loss: 4.322e-01]
a-cold-wall:  10%|9         | 298/3000 [08:25<1:10:14,  1.56s/it, lr: 1.0e-04 loss: 4.322e-01]
a-cold-wall:  10%|9         | 299/3000 [08:25<1:00:30,  1.34s/it, lr: 1.0e-04 loss: 4.322e-01]
a-cold-wall:  10%|9         | 299/3000 [08:25<1:00:30,  1.34s/it, lr: 1.0e-04 loss: 4.322e-01]
a-cold-wall:  10%|9         | 299/3000 [08:26<1:00:30,  1.34s/it, lr: 1.0e-04 loss: 4.404e-02]
a-cold-wall:  10%|9         | 299/3000 [08:26<1:00:30,  1.34s/it, lr: 1.0e-04 loss: 4.404e-02]
a-cold-wall:  10%|#         | 300/3000 [08:26<1:00:28,  1.34s/it, lr: 1.0e-04 loss: 1.252e-01]
a-cold-wall:  10%|#         | 300/3000 [08:26<1:00:28,  1.34s/it, lr: 1.0e-04 loss: 1.252e-01]
a-cold-wall:  10%|#         | 301/3000 [08:26<40:21,  1.11it/s, lr: 1.0e-04 loss: 1.252e-01]  
a-cold-wall:  10%|#         | 301/3000 [08:26<40:21,  1.11it/s, lr: 1.0e-04 loss: 1.252e-01]  
a-cold-wall:  10%|#         | 301/3000 [08:27<40:21,  1.11it/s, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  10%|#         | 301/3000 [08:27<40:21,  1.11it/s, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  10%|#         | 302/3000 [08:27<41:07,  1.09it/s, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  10%|#         | 302/3000 [08:27<41:07,  1.09it/s, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  10%|#         | 302/3000 [08:29<41:07,  1.09it/s, lr: 1.0e-04 loss: 4.280e-01]
a-cold-wall:  10%|#         | 302/3000 [08:29<41:07,  1.09it/s, lr: 1.0e-04 loss: 4.280e-01]
a-cold-wall:  10%|#         | 303/3000 [08:29<47:19,  1.05s/it, lr: 1.0e-04 loss: 4.280e-01]
a-cold-wall:  10%|#         | 303/3000 [08:29<47:19,  1.05s/it, lr: 1.0e-04 loss: 4.280e-01]
a-cold-wall:  10%|#         | 303/3000 [08:30<47:19,  1.05s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  10%|#         | 303/3000 [08:30<47:19,  1.05s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  10%|#         | 304/3000 [08:30<46:15,  1.03s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  10%|#         | 304/3000 [08:30<46:15,  1.03s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  10%|#         | 304/3000 [08:31<46:15,  1.03s/it, lr: 1.0e-04 loss: 6.429e-01]
a-cold-wall:  10%|#         | 304/3000 [08:31<46:15,  1.03s/it, lr: 1.0e-04 loss: 6.429e-01]
a-cold-wall:  10%|#         | 305/3000 [08:31<51:28,  1.15s/it, lr: 1.0e-04 loss: 6.429e-01]
a-cold-wall:  10%|#         | 305/3000 [08:31<51:28,  1.15s/it, lr: 1.0e-04 loss: 6.429e-01]
a-cold-wall:  10%|#         | 305/3000 [08:34<51:28,  1.15s/it, lr: 1.0e-04 loss: 1.941e-01]
a-cold-wall:  10%|#         | 305/3000 [08:34<51:28,  1.15s/it, lr: 1.0e-04 loss: 1.941e-01]
a-cold-wall:  10%|#         | 306/3000 [08:34<1:13:44,  1.64s/it, lr: 1.0e-04 loss: 1.941e-01]
a-cold-wall:  10%|#         | 306/3000 [08:34<1:13:44,  1.64s/it, lr: 1.0e-04 loss: 1.941e-01]
a-cold-wall:  10%|#         | 306/3000 [08:35<1:13:44,  1.64s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  10%|#         | 306/3000 [08:35<1:13:44,  1.64s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  10%|#         | 307/3000 [08:35<1:02:02,  1.38s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  10%|#         | 307/3000 [08:35<1:02:02,  1.38s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  10%|#         | 307/3000 [08:38<1:02:02,  1.38s/it, lr: 1.0e-04 loss: 1.478e-01]
a-cold-wall:  10%|#         | 307/3000 [08:38<1:02:02,  1.38s/it, lr: 1.0e-04 loss: 1.478e-01]
a-cold-wall:  10%|#         | 308/3000 [08:38<1:21:22,  1.81s/it, lr: 1.0e-04 loss: 1.478e-01]
a-cold-wall:  10%|#         | 308/3000 [08:38<1:21:22,  1.81s/it, lr: 1.0e-04 loss: 1.478e-01]
a-cold-wall:  10%|#         | 308/3000 [08:38<1:21:22,  1.81s/it, lr: 1.0e-04 loss: 5.332e-01]
a-cold-wall:  10%|#         | 308/3000 [08:38<1:21:22,  1.81s/it, lr: 1.0e-04 loss: 5.332e-01]
a-cold-wall:  10%|#         | 309/3000 [08:38<1:07:15,  1.50s/it, lr: 1.0e-04 loss: 5.332e-01]
a-cold-wall:  10%|#         | 309/3000 [08:38<1:07:15,  1.50s/it, lr: 1.0e-04 loss: 5.332e-01]
a-cold-wall:  10%|#         | 309/3000 [08:41<1:07:15,  1.50s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  10%|#         | 309/3000 [08:41<1:07:15,  1.50s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  10%|#         | 310/3000 [08:44<1:07:13,  1.50s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  10%|#         | 310/3000 [08:44<1:07:13,  1.50s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  10%|#         | 311/3000 [08:44<1:06:08,  1.48s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  10%|#         | 311/3000 [08:44<1:06:08,  1.48s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  10%|#         | 311/3000 [08:45<1:06:08,  1.48s/it, lr: 1.0e-04 loss: 4.767e-01]
a-cold-wall:  10%|#         | 311/3000 [08:45<1:06:08,  1.48s/it, lr: 1.0e-04 loss: 4.767e-01]
a-cold-wall:  10%|#         | 312/3000 [08:45<57:59,  1.29s/it, lr: 1.0e-04 loss: 4.767e-01]  
a-cold-wall:  10%|#         | 312/3000 [08:45<57:59,  1.29s/it, lr: 1.0e-04 loss: 4.767e-01]  
a-cold-wall:  10%|#         | 312/3000 [08:48<57:59,  1.29s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  10%|#         | 312/3000 [08:48<57:59,  1.29s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  10%|#         | 313/3000 [08:48<1:16:36,  1.71s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  10%|#         | 313/3000 [08:48<1:16:36,  1.71s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  10%|#         | 313/3000 [08:49<1:16:36,  1.71s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  10%|#         | 313/3000 [08:49<1:16:36,  1.71s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  10%|#         | 314/3000 [08:49<1:12:58,  1.63s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  10%|#         | 314/3000 [08:49<1:12:58,  1.63s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  10%|#         | 314/3000 [08:51<1:12:58,  1.63s/it, lr: 1.0e-04 loss: 6.219e-01]
a-cold-wall:  10%|#         | 314/3000 [08:51<1:12:58,  1.63s/it, lr: 1.0e-04 loss: 6.219e-01]
a-cold-wall:  10%|#         | 315/3000 [08:51<1:11:01,  1.59s/it, lr: 1.0e-04 loss: 6.219e-01]
a-cold-wall:  10%|#         | 315/3000 [08:51<1:11:01,  1.59s/it, lr: 1.0e-04 loss: 6.219e-01]
a-cold-wall:  10%|#         | 315/3000 [08:54<1:11:01,  1.59s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  10%|#         | 315/3000 [08:54<1:11:01,  1.59s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  11%|#         | 316/3000 [08:54<1:27:20,  1.95s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  11%|#         | 316/3000 [08:54<1:27:20,  1.95s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  11%|#         | 316/3000 [08:57<1:27:20,  1.95s/it, lr: 1.0e-04 loss: 4.168e-01]
a-cold-wall:  11%|#         | 316/3000 [08:57<1:27:20,  1.95s/it, lr: 1.0e-04 loss: 4.168e-01]
a-cold-wall:  11%|#         | 317/3000 [08:57<1:41:34,  2.27s/it, lr: 1.0e-04 loss: 4.168e-01]
a-cold-wall:  11%|#         | 317/3000 [08:57<1:41:34,  2.27s/it, lr: 1.0e-04 loss: 4.168e-01]
a-cold-wall:  11%|#         | 317/3000 [08:59<1:41:34,  2.27s/it, lr: 1.0e-04 loss: 2.384e-01]
a-cold-wall:  11%|#         | 317/3000 [08:59<1:41:34,  2.27s/it, lr: 1.0e-04 loss: 2.384e-01]
a-cold-wall:  11%|#         | 318/3000 [08:59<1:30:23,  2.02s/it, lr: 1.0e-04 loss: 2.384e-01]
a-cold-wall:  11%|#         | 318/3000 [08:59<1:30:23,  2.02s/it, lr: 1.0e-04 loss: 2.384e-01]
a-cold-wall:  11%|#         | 318/3000 [09:00<1:30:23,  2.02s/it, lr: 1.0e-04 loss: 6.528e-01]
a-cold-wall:  11%|#         | 318/3000 [09:00<1:30:23,  2.02s/it, lr: 1.0e-04 loss: 6.528e-01]
a-cold-wall:  11%|#         | 319/3000 [09:00<1:22:41,  1.85s/it, lr: 1.0e-04 loss: 6.528e-01]
a-cold-wall:  11%|#         | 319/3000 [09:00<1:22:41,  1.85s/it, lr: 1.0e-04 loss: 6.528e-01]
a-cold-wall:  11%|#         | 319/3000 [09:01<1:22:41,  1.85s/it, lr: 1.0e-04 loss: 2.614e-01]
a-cold-wall:  11%|#         | 319/3000 [09:01<1:22:41,  1.85s/it, lr: 1.0e-04 loss: 2.614e-01]
a-cold-wall:  11%|#         | 320/3000 [09:03<1:22:39,  1.85s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  11%|#         | 320/3000 [09:03<1:22:39,  1.85s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  11%|#         | 321/3000 [09:03<59:32,  1.33s/it, lr: 1.0e-04 loss: 4.960e-01]  
a-cold-wall:  11%|#         | 321/3000 [09:03<59:32,  1.33s/it, lr: 1.0e-04 loss: 4.960e-01]  
a-cold-wall:  11%|#         | 321/3000 [09:04<59:32,  1.33s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  11%|#         | 321/3000 [09:04<59:32,  1.33s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  11%|#         | 322/3000 [09:04<53:10,  1.19s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  11%|#         | 322/3000 [09:04<53:10,  1.19s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  11%|#         | 322/3000 [09:06<53:10,  1.19s/it, lr: 1.0e-04 loss: 1.980e-01]
a-cold-wall:  11%|#         | 322/3000 [09:06<53:10,  1.19s/it, lr: 1.0e-04 loss: 1.980e-01]
a-cold-wall:  11%|#         | 323/3000 [09:06<1:12:56,  1.63s/it, lr: 1.0e-04 loss: 1.980e-01]
a-cold-wall:  11%|#         | 323/3000 [09:06<1:12:56,  1.63s/it, lr: 1.0e-04 loss: 1.980e-01]
a-cold-wall:  11%|#         | 323/3000 [09:07<1:12:56,  1.63s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  11%|#         | 323/3000 [09:07<1:12:56,  1.63s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  11%|#         | 324/3000 [09:07<1:02:12,  1.39s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  11%|#         | 324/3000 [09:07<1:02:12,  1.39s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  11%|#         | 324/3000 [09:08<1:02:12,  1.39s/it, lr: 1.0e-04 loss: 3.139e-01]
a-cold-wall:  11%|#         | 324/3000 [09:08<1:02:12,  1.39s/it, lr: 1.0e-04 loss: 3.139e-01]
a-cold-wall:  11%|#         | 325/3000 [09:08<54:08,  1.21s/it, lr: 1.0e-04 loss: 3.139e-01]  
a-cold-wall:  11%|#         | 325/3000 [09:08<54:08,  1.21s/it, lr: 1.0e-04 loss: 3.139e-01]  
a-cold-wall:  11%|#         | 325/3000 [09:09<54:08,  1.21s/it, lr: 1.0e-04 loss: 3.318e-01]
a-cold-wall:  11%|#         | 325/3000 [09:09<54:08,  1.21s/it, lr: 1.0e-04 loss: 3.318e-01]
a-cold-wall:  11%|#         | 326/3000 [09:09<48:13,  1.08s/it, lr: 1.0e-04 loss: 3.318e-01]
a-cold-wall:  11%|#         | 326/3000 [09:09<48:13,  1.08s/it, lr: 1.0e-04 loss: 3.318e-01]
a-cold-wall:  11%|#         | 326/3000 [09:10<48:13,  1.08s/it, lr: 1.0e-04 loss: 2.711e-01]
a-cold-wall:  11%|#         | 326/3000 [09:10<48:13,  1.08s/it, lr: 1.0e-04 loss: 2.711e-01]
a-cold-wall:  11%|#         | 327/3000 [09:10<52:08,  1.17s/it, lr: 1.0e-04 loss: 2.711e-01]
a-cold-wall:  11%|#         | 327/3000 [09:10<52:08,  1.17s/it, lr: 1.0e-04 loss: 2.711e-01]
a-cold-wall:  11%|#         | 327/3000 [09:12<52:08,  1.17s/it, lr: 1.0e-04 loss: 3.202e-02]
a-cold-wall:  11%|#         | 327/3000 [09:12<52:08,  1.17s/it, lr: 1.0e-04 loss: 3.202e-02]
a-cold-wall:  11%|#         | 328/3000 [09:12<55:26,  1.25s/it, lr: 1.0e-04 loss: 3.202e-02]
a-cold-wall:  11%|#         | 328/3000 [09:12<55:26,  1.25s/it, lr: 1.0e-04 loss: 3.202e-02]
a-cold-wall:  11%|#         | 328/3000 [09:12<55:26,  1.25s/it, lr: 1.0e-04 loss: 5.592e-01]
a-cold-wall:  11%|#         | 328/3000 [09:12<55:26,  1.25s/it, lr: 1.0e-04 loss: 5.592e-01]
a-cold-wall:  11%|#         | 329/3000 [09:12<48:54,  1.10s/it, lr: 1.0e-04 loss: 5.592e-01]
a-cold-wall:  11%|#         | 329/3000 [09:12<48:54,  1.10s/it, lr: 1.0e-04 loss: 5.592e-01]
a-cold-wall:  11%|#         | 329/3000 [09:13<48:54,  1.10s/it, lr: 1.0e-04 loss: 9.144e-02]
a-cold-wall:  11%|#         | 329/3000 [09:13<48:54,  1.10s/it, lr: 1.0e-04 loss: 9.144e-02]
a-cold-wall:  11%|#1        | 330/3000 [09:14<48:53,  1.10s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  11%|#1        | 330/3000 [09:14<48:53,  1.10s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  11%|#1        | 331/3000 [09:14<36:21,  1.22it/s, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  11%|#1        | 331/3000 [09:14<36:21,  1.22it/s, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  11%|#1        | 331/3000 [09:15<36:21,  1.22it/s, lr: 1.0e-04 loss: 5.300e-01]
a-cold-wall:  11%|#1        | 331/3000 [09:15<36:21,  1.22it/s, lr: 1.0e-04 loss: 5.300e-01]
a-cold-wall:  11%|#1        | 332/3000 [09:15<38:05,  1.17it/s, lr: 1.0e-04 loss: 5.300e-01]
a-cold-wall:  11%|#1        | 332/3000 [09:15<38:05,  1.17it/s, lr: 1.0e-04 loss: 5.300e-01]
a-cold-wall:  11%|#1        | 332/3000 [09:16<38:05,  1.17it/s, lr: 1.0e-04 loss: 5.660e-01]
a-cold-wall:  11%|#1        | 332/3000 [09:16<38:05,  1.17it/s, lr: 1.0e-04 loss: 5.660e-01]
a-cold-wall:  11%|#1        | 333/3000 [09:16<44:48,  1.01s/it, lr: 1.0e-04 loss: 5.660e-01]
a-cold-wall:  11%|#1        | 333/3000 [09:16<44:48,  1.01s/it, lr: 1.0e-04 loss: 5.660e-01]
a-cold-wall:  11%|#1        | 333/3000 [09:18<44:48,  1.01s/it, lr: 1.0e-04 loss: 6.872e-01]
a-cold-wall:  11%|#1        | 333/3000 [09:18<44:48,  1.01s/it, lr: 1.0e-04 loss: 6.872e-01]
a-cold-wall:  11%|#1        | 334/3000 [09:18<49:45,  1.12s/it, lr: 1.0e-04 loss: 6.872e-01]
a-cold-wall:  11%|#1        | 334/3000 [09:18<49:45,  1.12s/it, lr: 1.0e-04 loss: 6.872e-01]
a-cold-wall:  11%|#1        | 334/3000 [09:19<49:45,  1.12s/it, lr: 1.0e-04 loss: 7.004e-01]
a-cold-wall:  11%|#1        | 334/3000 [09:19<49:45,  1.12s/it, lr: 1.0e-04 loss: 7.004e-01]
a-cold-wall:  11%|#1        | 335/3000 [09:19<45:12,  1.02s/it, lr: 1.0e-04 loss: 7.004e-01]
a-cold-wall:  11%|#1        | 335/3000 [09:19<45:12,  1.02s/it, lr: 1.0e-04 loss: 7.004e-01]
a-cold-wall:  11%|#1        | 335/3000 [09:21<45:12,  1.02s/it, lr: 1.0e-04 loss: 1.373e-01]
a-cold-wall:  11%|#1        | 335/3000 [09:21<45:12,  1.02s/it, lr: 1.0e-04 loss: 1.373e-01]
a-cold-wall:  11%|#1        | 336/3000 [09:22<1:08:37,  1.55s/it, lr: 1.0e-04 loss: 1.373e-01]
a-cold-wall:  11%|#1        | 336/3000 [09:22<1:08:37,  1.55s/it, lr: 1.0e-04 loss: 1.373e-01]
a-cold-wall:  11%|#1        | 336/3000 [09:22<1:08:37,  1.55s/it, lr: 1.0e-04 loss: 1.907e-01]
a-cold-wall:  11%|#1        | 336/3000 [09:22<1:08:37,  1.55s/it, lr: 1.0e-04 loss: 1.907e-01]
a-cold-wall:  11%|#1        | 337/3000 [09:22<58:19,  1.31s/it, lr: 1.0e-04 loss: 1.907e-01]  
a-cold-wall:  11%|#1        | 337/3000 [09:22<58:19,  1.31s/it, lr: 1.0e-04 loss: 1.907e-01]  
a-cold-wall:  11%|#1        | 337/3000 [09:23<58:19,  1.31s/it, lr: 1.0e-04 loss: 9.684e-02]
a-cold-wall:  11%|#1        | 337/3000 [09:23<58:19,  1.31s/it, lr: 1.0e-04 loss: 9.684e-02]
a-cold-wall:  11%|#1        | 338/3000 [09:23<51:01,  1.15s/it, lr: 1.0e-04 loss: 9.684e-02]
a-cold-wall:  11%|#1        | 338/3000 [09:23<51:01,  1.15s/it, lr: 1.0e-04 loss: 9.684e-02]
a-cold-wall:  11%|#1        | 338/3000 [09:24<51:01,  1.15s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  11%|#1        | 338/3000 [09:24<51:01,  1.15s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  11%|#1        | 339/3000 [09:24<45:48,  1.03s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  11%|#1        | 339/3000 [09:24<45:48,  1.03s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  11%|#1        | 339/3000 [09:25<45:48,  1.03s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  11%|#1        | 339/3000 [09:25<45:48,  1.03s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  11%|#1        | 340/3000 [09:26<45:47,  1.03s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  11%|#1        | 340/3000 [09:26<45:47,  1.03s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  11%|#1        | 341/3000 [09:26<32:22,  1.37it/s, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  11%|#1        | 341/3000 [09:26<32:22,  1.37it/s, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  11%|#1        | 341/3000 [09:27<32:22,  1.37it/s, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  11%|#1        | 341/3000 [09:27<32:22,  1.37it/s, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  11%|#1        | 342/3000 [09:27<32:31,  1.36it/s, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  11%|#1        | 342/3000 [09:27<32:31,  1.36it/s, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  11%|#1        | 342/3000 [09:30<32:31,  1.36it/s, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  11%|#1        | 342/3000 [09:30<32:31,  1.36it/s, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  11%|#1        | 343/3000 [09:30<56:59,  1.29s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  11%|#1        | 343/3000 [09:30<56:59,  1.29s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  11%|#1        | 343/3000 [09:31<56:59,  1.29s/it, lr: 1.0e-04 loss: 5.898e-01]
a-cold-wall:  11%|#1        | 343/3000 [09:31<56:59,  1.29s/it, lr: 1.0e-04 loss: 5.898e-01]
a-cold-wall:  11%|#1        | 344/3000 [09:31<58:28,  1.32s/it, lr: 1.0e-04 loss: 5.898e-01]
a-cold-wall:  11%|#1        | 344/3000 [09:31<58:28,  1.32s/it, lr: 1.0e-04 loss: 5.898e-01]
a-cold-wall:  11%|#1        | 344/3000 [09:32<58:28,  1.32s/it, lr: 1.0e-04 loss: 4.100e-01]
a-cold-wall:  11%|#1        | 344/3000 [09:32<58:28,  1.32s/it, lr: 1.0e-04 loss: 4.100e-01]
a-cold-wall:  12%|#1        | 345/3000 [09:32<54:15,  1.23s/it, lr: 1.0e-04 loss: 4.100e-01]
a-cold-wall:  12%|#1        | 345/3000 [09:32<54:15,  1.23s/it, lr: 1.0e-04 loss: 4.100e-01]
a-cold-wall:  12%|#1        | 345/3000 [09:33<54:15,  1.23s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  12%|#1        | 345/3000 [09:33<54:15,  1.23s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  12%|#1        | 346/3000 [09:33<56:37,  1.28s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  12%|#1        | 346/3000 [09:33<56:37,  1.28s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  12%|#1        | 346/3000 [09:36<56:37,  1.28s/it, lr: 1.0e-04 loss: 1.768e-01]
a-cold-wall:  12%|#1        | 346/3000 [09:36<56:37,  1.28s/it, lr: 1.0e-04 loss: 1.768e-01]
a-cold-wall:  12%|#1        | 347/3000 [09:36<1:17:07,  1.74s/it, lr: 1.0e-04 loss: 1.768e-01]
a-cold-wall:  12%|#1        | 347/3000 [09:36<1:17:07,  1.74s/it, lr: 1.0e-04 loss: 1.768e-01]
a-cold-wall:  12%|#1        | 347/3000 [09:37<1:17:07,  1.74s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  12%|#1        | 347/3000 [09:37<1:17:07,  1.74s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  12%|#1        | 348/3000 [09:37<1:04:19,  1.46s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  12%|#1        | 348/3000 [09:37<1:04:19,  1.46s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  12%|#1        | 348/3000 [09:38<1:04:19,  1.46s/it, lr: 1.0e-04 loss: 8.565e-02]
a-cold-wall:  12%|#1        | 348/3000 [09:38<1:04:19,  1.46s/it, lr: 1.0e-04 loss: 8.565e-02]
a-cold-wall:  12%|#1        | 349/3000 [09:38<1:03:53,  1.45s/it, lr: 1.0e-04 loss: 8.565e-02]
a-cold-wall:  12%|#1        | 349/3000 [09:38<1:03:53,  1.45s/it, lr: 1.0e-04 loss: 8.565e-02]
a-cold-wall:  12%|#1        | 349/3000 [09:39<1:03:53,  1.45s/it, lr: 1.0e-04 loss: 4.865e-01]
a-cold-wall:  12%|#1        | 349/3000 [09:39<1:03:53,  1.45s/it, lr: 1.0e-04 loss: 4.865e-01]
a-cold-wall:  12%|#1        | 350/3000 [09:41<1:03:52,  1.45s/it, lr: 1.0e-04 loss: 4.861e-01]
a-cold-wall:  12%|#1        | 350/3000 [09:41<1:03:52,  1.45s/it, lr: 1.0e-04 loss: 4.861e-01]
a-cold-wall:  12%|#1        | 351/3000 [09:41<48:54,  1.11s/it, lr: 1.0e-04 loss: 4.861e-01]  
a-cold-wall:  12%|#1        | 351/3000 [09:41<48:54,  1.11s/it, lr: 1.0e-04 loss: 4.861e-01]  
a-cold-wall:  12%|#1        | 351/3000 [09:43<48:54,  1.11s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  12%|#1        | 351/3000 [09:43<48:54,  1.11s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  12%|#1        | 352/3000 [09:43<1:07:50,  1.54s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  12%|#1        | 352/3000 [09:43<1:07:50,  1.54s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  12%|#1        | 352/3000 [09:44<1:07:50,  1.54s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  12%|#1        | 352/3000 [09:44<1:07:50,  1.54s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  12%|#1        | 353/3000 [09:44<58:45,  1.33s/it, lr: 1.0e-04 loss: 4.638e-01]  
a-cold-wall:  12%|#1        | 353/3000 [09:44<58:45,  1.33s/it, lr: 1.0e-04 loss: 4.638e-01]  
a-cold-wall:  12%|#1        | 353/3000 [09:47<58:45,  1.33s/it, lr: 1.0e-04 loss: 2.103e-01]
a-cold-wall:  12%|#1        | 353/3000 [09:47<58:45,  1.33s/it, lr: 1.0e-04 loss: 2.103e-01]
a-cold-wall:  12%|#1        | 354/3000 [09:47<1:17:14,  1.75s/it, lr: 1.0e-04 loss: 2.103e-01]
a-cold-wall:  12%|#1        | 354/3000 [09:47<1:17:14,  1.75s/it, lr: 1.0e-04 loss: 2.103e-01]
a-cold-wall:  12%|#1        | 354/3000 [09:48<1:17:14,  1.75s/it, lr: 1.0e-04 loss: 1.924e-01]
a-cold-wall:  12%|#1        | 354/3000 [09:48<1:17:14,  1.75s/it, lr: 1.0e-04 loss: 1.924e-01]
a-cold-wall:  12%|#1        | 355/3000 [09:48<1:13:24,  1.67s/it, lr: 1.0e-04 loss: 1.924e-01]
a-cold-wall:  12%|#1        | 355/3000 [09:48<1:13:24,  1.67s/it, lr: 1.0e-04 loss: 1.924e-01]
a-cold-wall:  12%|#1        | 355/3000 [09:49<1:13:24,  1.67s/it, lr: 1.0e-04 loss: 9.303e-02]
a-cold-wall:  12%|#1        | 355/3000 [09:49<1:13:24,  1.67s/it, lr: 1.0e-04 loss: 9.303e-02]
a-cold-wall:  12%|#1        | 356/3000 [09:49<1:01:48,  1.40s/it, lr: 1.0e-04 loss: 9.303e-02]
a-cold-wall:  12%|#1        | 356/3000 [09:49<1:01:48,  1.40s/it, lr: 1.0e-04 loss: 9.303e-02]
a-cold-wall:  12%|#1        | 356/3000 [09:50<1:01:48,  1.40s/it, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:  12%|#1        | 356/3000 [09:50<1:01:48,  1.40s/it, lr: 1.0e-04 loss: 7.501e-01]
a-cold-wall:  12%|#1        | 357/3000 [09:50<53:25,  1.21s/it, lr: 1.0e-04 loss: 7.501e-01]  
a-cold-wall:  12%|#1        | 357/3000 [09:50<53:25,  1.21s/it, lr: 1.0e-04 loss: 7.501e-01]  
a-cold-wall:  12%|#1        | 357/3000 [09:51<53:25,  1.21s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  12%|#1        | 357/3000 [09:51<53:25,  1.21s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  12%|#1        | 358/3000 [09:51<50:19,  1.14s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  12%|#1        | 358/3000 [09:51<50:19,  1.14s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  12%|#1        | 358/3000 [09:54<50:19,  1.14s/it, lr: 1.0e-04 loss: 2.926e-01]
a-cold-wall:  12%|#1        | 358/3000 [09:54<50:19,  1.14s/it, lr: 1.0e-04 loss: 2.926e-01]
a-cold-wall:  12%|#1        | 359/3000 [09:54<1:13:28,  1.67s/it, lr: 1.0e-04 loss: 2.926e-01]
a-cold-wall:  12%|#1        | 359/3000 [09:54<1:13:28,  1.67s/it, lr: 1.0e-04 loss: 2.926e-01]
a-cold-wall:  12%|#1        | 359/3000 [09:55<1:13:28,  1.67s/it, lr: 1.0e-04 loss: 2.387e-01]
a-cold-wall:  12%|#1        | 359/3000 [09:55<1:13:28,  1.67s/it, lr: 1.0e-04 loss: 2.387e-01]
a-cold-wall:  12%|#2        | 360/3000 [09:57<1:13:26,  1.67s/it, lr: 1.0e-04 loss: 1.536e-01]
a-cold-wall:  12%|#2        | 360/3000 [09:57<1:13:26,  1.67s/it, lr: 1.0e-04 loss: 1.536e-01]
a-cold-wall:  12%|#2        | 361/3000 [09:57<1:08:46,  1.56s/it, lr: 1.0e-04 loss: 1.536e-01]
a-cold-wall:  12%|#2        | 361/3000 [09:57<1:08:46,  1.56s/it, lr: 1.0e-04 loss: 1.536e-01]
a-cold-wall:  12%|#2        | 361/3000 [09:59<1:08:46,  1.56s/it, lr: 1.0e-04 loss: 8.620e-01]
a-cold-wall:  12%|#2        | 361/3000 [09:59<1:08:46,  1.56s/it, lr: 1.0e-04 loss: 8.620e-01]
a-cold-wall:  12%|#2        | 362/3000 [09:59<1:07:13,  1.53s/it, lr: 1.0e-04 loss: 8.620e-01]
a-cold-wall:  12%|#2        | 362/3000 [09:59<1:07:13,  1.53s/it, lr: 1.0e-04 loss: 8.620e-01]
a-cold-wall:  12%|#2        | 362/3000 [10:02<1:07:13,  1.53s/it, lr: 1.0e-04 loss: 6.624e-02]
a-cold-wall:  12%|#2        | 362/3000 [10:02<1:07:13,  1.53s/it, lr: 1.0e-04 loss: 6.624e-02]
a-cold-wall:  12%|#2        | 363/3000 [10:02<1:22:15,  1.87s/it, lr: 1.0e-04 loss: 6.624e-02]
a-cold-wall:  12%|#2        | 363/3000 [10:02<1:22:15,  1.87s/it, lr: 1.0e-04 loss: 6.624e-02]
a-cold-wall:  12%|#2        | 363/3000 [10:03<1:22:15,  1.87s/it, lr: 1.0e-04 loss: 5.720e-01]
a-cold-wall:  12%|#2        | 363/3000 [10:03<1:22:15,  1.87s/it, lr: 1.0e-04 loss: 5.720e-01]
a-cold-wall:  12%|#2        | 364/3000 [10:03<1:08:52,  1.57s/it, lr: 1.0e-04 loss: 5.720e-01]
a-cold-wall:  12%|#2        | 364/3000 [10:03<1:08:52,  1.57s/it, lr: 1.0e-04 loss: 5.720e-01]
a-cold-wall:  12%|#2        | 364/3000 [10:05<1:08:52,  1.57s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  12%|#2        | 364/3000 [10:05<1:08:52,  1.57s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  12%|#2        | 365/3000 [10:05<1:24:34,  1.93s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  12%|#2        | 365/3000 [10:05<1:24:34,  1.93s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  12%|#2        | 365/3000 [10:08<1:24:34,  1.93s/it, lr: 1.0e-04 loss: 4.874e-01]
a-cold-wall:  12%|#2        | 365/3000 [10:08<1:24:34,  1.93s/it, lr: 1.0e-04 loss: 4.874e-01]
a-cold-wall:  12%|#2        | 366/3000 [10:08<1:36:30,  2.20s/it, lr: 1.0e-04 loss: 4.874e-01]
a-cold-wall:  12%|#2        | 366/3000 [10:08<1:36:30,  2.20s/it, lr: 1.0e-04 loss: 4.874e-01]
a-cold-wall:  12%|#2        | 366/3000 [10:10<1:36:30,  2.20s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  12%|#2        | 366/3000 [10:10<1:36:30,  2.20s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  12%|#2        | 367/3000 [10:10<1:26:38,  1.97s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  12%|#2        | 367/3000 [10:10<1:26:38,  1.97s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  12%|#2        | 367/3000 [10:13<1:26:38,  1.97s/it, lr: 1.0e-04 loss: 7.545e-01]
a-cold-wall:  12%|#2        | 367/3000 [10:13<1:26:38,  1.97s/it, lr: 1.0e-04 loss: 7.545e-01]
a-cold-wall:  12%|#2        | 368/3000 [10:13<1:38:24,  2.24s/it, lr: 1.0e-04 loss: 7.545e-01]
a-cold-wall:  12%|#2        | 368/3000 [10:13<1:38:24,  2.24s/it, lr: 1.0e-04 loss: 7.545e-01]
a-cold-wall:  12%|#2        | 368/3000 [10:15<1:38:24,  2.24s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  12%|#2        | 368/3000 [10:15<1:38:24,  2.24s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  12%|#2        | 369/3000 [10:15<1:46:40,  2.43s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  12%|#2        | 369/3000 [10:15<1:46:40,  2.43s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  12%|#2        | 369/3000 [10:18<1:46:40,  2.43s/it, lr: 1.0e-04 loss: 8.143e-02]
a-cold-wall:  12%|#2        | 369/3000 [10:18<1:46:40,  2.43s/it, lr: 1.0e-04 loss: 8.143e-02]
a-cold-wall:  12%|#2        | 370/3000 [10:21<1:46:38,  2.43s/it, lr: 1.0e-04 loss: 3.693e-01]
a-cold-wall:  12%|#2        | 370/3000 [10:21<1:46:38,  2.43s/it, lr: 1.0e-04 loss: 3.693e-01]
a-cold-wall:  12%|#2        | 371/3000 [10:21<1:27:14,  1.99s/it, lr: 1.0e-04 loss: 3.693e-01]
a-cold-wall:  12%|#2        | 371/3000 [10:21<1:27:14,  1.99s/it, lr: 1.0e-04 loss: 3.693e-01]
a-cold-wall:  12%|#2        | 371/3000 [10:24<1:27:14,  1.99s/it, lr: 1.0e-04 loss: 1.991e-01]
a-cold-wall:  12%|#2        | 371/3000 [10:24<1:27:14,  1.99s/it, lr: 1.0e-04 loss: 1.991e-01]
a-cold-wall:  12%|#2        | 372/3000 [10:24<1:36:26,  2.20s/it, lr: 1.0e-04 loss: 1.991e-01]
a-cold-wall:  12%|#2        | 372/3000 [10:24<1:36:26,  2.20s/it, lr: 1.0e-04 loss: 1.991e-01]
a-cold-wall:  12%|#2        | 372/3000 [10:25<1:36:26,  2.20s/it, lr: 1.0e-04 loss: 3.939e-01]
a-cold-wall:  12%|#2        | 372/3000 [10:25<1:36:26,  2.20s/it, lr: 1.0e-04 loss: 3.939e-01]
a-cold-wall:  12%|#2        | 373/3000 [10:25<1:19:44,  1.82s/it, lr: 1.0e-04 loss: 3.939e-01]
a-cold-wall:  12%|#2        | 373/3000 [10:25<1:19:44,  1.82s/it, lr: 1.0e-04 loss: 3.939e-01]
a-cold-wall:  12%|#2        | 373/3000 [10:28<1:19:44,  1.82s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  12%|#2        | 373/3000 [10:28<1:19:44,  1.82s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  12%|#2        | 374/3000 [10:28<1:31:52,  2.10s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  12%|#2        | 374/3000 [10:28<1:31:52,  2.10s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  12%|#2        | 374/3000 [10:31<1:31:52,  2.10s/it, lr: 1.0e-04 loss: 6.473e-01]
a-cold-wall:  12%|#2        | 374/3000 [10:31<1:31:52,  2.10s/it, lr: 1.0e-04 loss: 6.473e-01]
a-cold-wall:  12%|#2        | 375/3000 [10:31<1:41:00,  2.31s/it, lr: 1.0e-04 loss: 6.473e-01]
a-cold-wall:  12%|#2        | 375/3000 [10:31<1:41:00,  2.31s/it, lr: 1.0e-04 loss: 6.473e-01]
a-cold-wall:  12%|#2        | 375/3000 [10:32<1:41:00,  2.31s/it, lr: 1.0e-04 loss: 6.284e-01]
a-cold-wall:  12%|#2        | 375/3000 [10:32<1:41:00,  2.31s/it, lr: 1.0e-04 loss: 6.284e-01]
a-cold-wall:  13%|#2        | 376/3000 [10:32<1:29:47,  2.05s/it, lr: 1.0e-04 loss: 6.284e-01]
a-cold-wall:  13%|#2        | 376/3000 [10:32<1:29:47,  2.05s/it, lr: 1.0e-04 loss: 6.284e-01]
a-cold-wall:  13%|#2        | 376/3000 [10:33<1:29:47,  2.05s/it, lr: 1.0e-04 loss: 2.859e-01]
a-cold-wall:  13%|#2        | 376/3000 [10:33<1:29:47,  2.05s/it, lr: 1.0e-04 loss: 2.859e-01]
a-cold-wall:  13%|#2        | 377/3000 [10:33<1:21:48,  1.87s/it, lr: 1.0e-04 loss: 2.859e-01]
a-cold-wall:  13%|#2        | 377/3000 [10:33<1:21:48,  1.87s/it, lr: 1.0e-04 loss: 2.859e-01]
a-cold-wall:  13%|#2        | 377/3000 [10:34<1:21:48,  1.87s/it, lr: 1.0e-04 loss: 3.897e-01]
a-cold-wall:  13%|#2        | 377/3000 [10:34<1:21:48,  1.87s/it, lr: 1.0e-04 loss: 3.897e-01]
a-cold-wall:  13%|#2        | 378/3000 [10:34<1:08:27,  1.57s/it, lr: 1.0e-04 loss: 3.897e-01]
a-cold-wall:  13%|#2        | 378/3000 [10:34<1:08:27,  1.57s/it, lr: 1.0e-04 loss: 3.897e-01]
a-cold-wall:  13%|#2        | 378/3000 [10:36<1:08:27,  1.57s/it, lr: 1.0e-04 loss: 1.484e-01]
a-cold-wall:  13%|#2        | 378/3000 [10:36<1:08:27,  1.57s/it, lr: 1.0e-04 loss: 1.484e-01]
a-cold-wall:  13%|#2        | 379/3000 [10:36<1:06:37,  1.53s/it, lr: 1.0e-04 loss: 1.484e-01]
a-cold-wall:  13%|#2        | 379/3000 [10:36<1:06:37,  1.53s/it, lr: 1.0e-04 loss: 1.484e-01]
a-cold-wall:  13%|#2        | 379/3000 [10:36<1:06:37,  1.53s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  13%|#2        | 379/3000 [10:36<1:06:37,  1.53s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  13%|#2        | 380/3000 [10:37<1:06:36,  1.53s/it, lr: 1.0e-04 loss: 1.369e-01]
a-cold-wall:  13%|#2        | 380/3000 [10:37<1:06:36,  1.53s/it, lr: 1.0e-04 loss: 1.369e-01]
a-cold-wall:  13%|#2        | 381/3000 [10:37<45:48,  1.05s/it, lr: 1.0e-04 loss: 1.369e-01]  
a-cold-wall:  13%|#2        | 381/3000 [10:37<45:48,  1.05s/it, lr: 1.0e-04 loss: 1.369e-01]  
a-cold-wall:  13%|#2        | 381/3000 [10:38<45:48,  1.05s/it, lr: 1.0e-04 loss: 3.904e-01]
a-cold-wall:  13%|#2        | 381/3000 [10:38<45:48,  1.05s/it, lr: 1.0e-04 loss: 3.904e-01]
a-cold-wall:  13%|#2        | 382/3000 [10:38<42:33,  1.03it/s, lr: 1.0e-04 loss: 3.904e-01]
a-cold-wall:  13%|#2        | 382/3000 [10:38<42:33,  1.03it/s, lr: 1.0e-04 loss: 3.904e-01]
a-cold-wall:  13%|#2        | 382/3000 [10:41<42:33,  1.03it/s, lr: 1.0e-04 loss: 1.207e-01]
a-cold-wall:  13%|#2        | 382/3000 [10:41<42:33,  1.03it/s, lr: 1.0e-04 loss: 1.207e-01]
a-cold-wall:  13%|#2        | 383/3000 [10:41<1:04:11,  1.47s/it, lr: 1.0e-04 loss: 1.207e-01]
a-cold-wall:  13%|#2        | 383/3000 [10:41<1:04:11,  1.47s/it, lr: 1.0e-04 loss: 1.207e-01]
a-cold-wall:  13%|#2        | 383/3000 [10:44<1:04:11,  1.47s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  13%|#2        | 383/3000 [10:44<1:04:11,  1.47s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  13%|#2        | 384/3000 [10:44<1:20:26,  1.85s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  13%|#2        | 384/3000 [10:44<1:20:26,  1.85s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  13%|#2        | 384/3000 [10:45<1:20:26,  1.85s/it, lr: 1.0e-04 loss: 5.552e-01]
a-cold-wall:  13%|#2        | 384/3000 [10:45<1:20:26,  1.85s/it, lr: 1.0e-04 loss: 5.552e-01]
a-cold-wall:  13%|#2        | 385/3000 [10:45<1:09:52,  1.60s/it, lr: 1.0e-04 loss: 5.552e-01]
a-cold-wall:  13%|#2        | 385/3000 [10:45<1:09:52,  1.60s/it, lr: 1.0e-04 loss: 5.552e-01]
a-cold-wall:  13%|#2        | 385/3000 [10:46<1:09:52,  1.60s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  13%|#2        | 385/3000 [10:46<1:09:52,  1.60s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  13%|#2        | 386/3000 [10:46<1:07:37,  1.55s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  13%|#2        | 386/3000 [10:46<1:07:37,  1.55s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  13%|#2        | 386/3000 [10:47<1:07:37,  1.55s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:  13%|#2        | 386/3000 [10:47<1:07:37,  1.55s/it, lr: 1.0e-04 loss: 7.500e-01]
a-cold-wall:  13%|#2        | 387/3000 [10:47<57:25,  1.32s/it, lr: 1.0e-04 loss: 7.500e-01]  
a-cold-wall:  13%|#2        | 387/3000 [10:47<57:25,  1.32s/it, lr: 1.0e-04 loss: 7.500e-01]  
a-cold-wall:  13%|#2        | 387/3000 [10:48<57:25,  1.32s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  13%|#2        | 387/3000 [10:48<57:25,  1.32s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  13%|#2        | 388/3000 [10:48<58:44,  1.35s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  13%|#2        | 388/3000 [10:48<58:44,  1.35s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  13%|#2        | 388/3000 [10:50<58:44,  1.35s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  13%|#2        | 388/3000 [10:50<58:44,  1.35s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  13%|#2        | 389/3000 [10:50<59:32,  1.37s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  13%|#2        | 389/3000 [10:50<59:32,  1.37s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  13%|#2        | 389/3000 [10:51<59:32,  1.37s/it, lr: 1.0e-04 loss: 4.275e-01]
a-cold-wall:  13%|#2        | 389/3000 [10:51<59:32,  1.37s/it, lr: 1.0e-04 loss: 4.275e-01]
a-cold-wall:  13%|#3        | 390/3000 [10:53<59:30,  1.37s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  13%|#3        | 390/3000 [10:53<59:30,  1.37s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  13%|#3        | 391/3000 [10:53<1:00:58,  1.40s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  13%|#3        | 391/3000 [10:53<1:00:58,  1.40s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  13%|#3        | 391/3000 [10:56<1:00:58,  1.40s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  13%|#3        | 391/3000 [10:56<1:00:58,  1.40s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  13%|#3        | 392/3000 [10:56<1:16:51,  1.77s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  13%|#3        | 392/3000 [10:56<1:16:51,  1.77s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  13%|#3        | 392/3000 [10:58<1:16:51,  1.77s/it, lr: 1.0e-04 loss: 6.159e-01]
a-cold-wall:  13%|#3        | 392/3000 [10:58<1:16:51,  1.77s/it, lr: 1.0e-04 loss: 6.159e-01]
a-cold-wall:  13%|#3        | 393/3000 [10:58<1:13:11,  1.68s/it, lr: 1.0e-04 loss: 6.159e-01]
a-cold-wall:  13%|#3        | 393/3000 [10:58<1:13:11,  1.68s/it, lr: 1.0e-04 loss: 6.159e-01]
a-cold-wall:  13%|#3        | 393/3000 [11:01<1:13:11,  1.68s/it, lr: 1.0e-04 loss: 2.207e-01]
a-cold-wall:  13%|#3        | 393/3000 [11:01<1:13:11,  1.68s/it, lr: 1.0e-04 loss: 2.207e-01]
a-cold-wall:  13%|#3        | 394/3000 [11:01<1:27:22,  2.01s/it, lr: 1.0e-04 loss: 2.207e-01]
a-cold-wall:  13%|#3        | 394/3000 [11:01<1:27:22,  2.01s/it, lr: 1.0e-04 loss: 2.207e-01]
a-cold-wall:  13%|#3        | 394/3000 [11:02<1:27:22,  2.01s/it, lr: 1.0e-04 loss: 6.000e-02]
a-cold-wall:  13%|#3        | 394/3000 [11:02<1:27:22,  2.01s/it, lr: 1.0e-04 loss: 6.000e-02]
a-cold-wall:  13%|#3        | 395/3000 [11:02<1:20:15,  1.85s/it, lr: 1.0e-04 loss: 6.000e-02]
a-cold-wall:  13%|#3        | 395/3000 [11:02<1:20:15,  1.85s/it, lr: 1.0e-04 loss: 6.000e-02]
a-cold-wall:  13%|#3        | 395/3000 [11:04<1:20:15,  1.85s/it, lr: 1.0e-04 loss: 5.636e-01]
a-cold-wall:  13%|#3        | 395/3000 [11:04<1:20:15,  1.85s/it, lr: 1.0e-04 loss: 5.636e-01]
a-cold-wall:  13%|#3        | 396/3000 [11:04<1:15:17,  1.73s/it, lr: 1.0e-04 loss: 5.636e-01]
a-cold-wall:  13%|#3        | 396/3000 [11:04<1:15:17,  1.73s/it, lr: 1.0e-04 loss: 5.636e-01]
a-cold-wall:  13%|#3        | 396/3000 [11:05<1:15:17,  1.73s/it, lr: 1.0e-04 loss: 3.580e-01]
a-cold-wall:  13%|#3        | 396/3000 [11:05<1:15:17,  1.73s/it, lr: 1.0e-04 loss: 3.580e-01]
a-cold-wall:  13%|#3        | 397/3000 [11:05<1:10:47,  1.63s/it, lr: 1.0e-04 loss: 3.580e-01]
a-cold-wall:  13%|#3        | 397/3000 [11:05<1:10:47,  1.63s/it, lr: 1.0e-04 loss: 3.580e-01]
a-cold-wall:  13%|#3        | 397/3000 [11:08<1:10:47,  1.63s/it, lr: 1.0e-04 loss: 1.044e-01]
a-cold-wall:  13%|#3        | 397/3000 [11:08<1:10:47,  1.63s/it, lr: 1.0e-04 loss: 1.044e-01]
a-cold-wall:  13%|#3        | 398/3000 [11:08<1:26:49,  2.00s/it, lr: 1.0e-04 loss: 1.044e-01]
a-cold-wall:  13%|#3        | 398/3000 [11:08<1:26:49,  2.00s/it, lr: 1.0e-04 loss: 1.044e-01]
a-cold-wall:  13%|#3        | 398/3000 [11:11<1:26:49,  2.00s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  13%|#3        | 398/3000 [11:11<1:26:49,  2.00s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  13%|#3        | 399/3000 [11:11<1:39:04,  2.29s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  13%|#3        | 399/3000 [11:11<1:39:04,  2.29s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  13%|#3        | 399/3000 [11:12<1:39:04,  2.29s/it, lr: 1.0e-04 loss: 5.277e-01]
a-cold-wall:  13%|#3        | 399/3000 [11:12<1:39:04,  2.29s/it, lr: 1.0e-04 loss: 5.277e-01]
a-cold-wall:  13%|#3        | 400/3000 [11:13<1:39:02,  2.29s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:  13%|#3        | 400/3000 [11:13<1:39:02,  2.29s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:  13%|#3        | 401/3000 [11:13<1:01:10,  1.41s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:  13%|#3        | 401/3000 [11:13<1:01:10,  1.41s/it, lr: 1.0e-04 loss: 1.264e-01]
a-cold-wall:  13%|#3        | 401/3000 [11:16<1:01:10,  1.41s/it, lr: 1.0e-04 loss: 4.439e-01]
a-cold-wall:  13%|#3        | 401/3000 [11:16<1:01:10,  1.41s/it, lr: 1.0e-04 loss: 4.439e-01]
a-cold-wall:  13%|#3        | 402/3000 [11:16<1:16:56,  1.78s/it, lr: 1.0e-04 loss: 4.439e-01]
a-cold-wall:  13%|#3        | 402/3000 [11:16<1:16:56,  1.78s/it, lr: 1.0e-04 loss: 4.439e-01]
a-cold-wall:  13%|#3        | 402/3000 [11:19<1:16:56,  1.78s/it, lr: 1.0e-04 loss: 6.769e-01]
a-cold-wall:  13%|#3        | 402/3000 [11:19<1:16:56,  1.78s/it, lr: 1.0e-04 loss: 6.769e-01]
a-cold-wall:  13%|#3        | 403/3000 [11:19<1:29:29,  2.07s/it, lr: 1.0e-04 loss: 6.769e-01]
a-cold-wall:  13%|#3        | 403/3000 [11:19<1:29:29,  2.07s/it, lr: 1.0e-04 loss: 6.769e-01]
a-cold-wall:  13%|#3        | 403/3000 [11:20<1:29:29,  2.07s/it, lr: 1.0e-04 loss: 1.822e-01]
a-cold-wall:  13%|#3        | 403/3000 [11:20<1:29:29,  2.07s/it, lr: 1.0e-04 loss: 1.822e-01]
a-cold-wall:  13%|#3        | 404/3000 [11:20<1:22:02,  1.90s/it, lr: 1.0e-04 loss: 1.822e-01]
a-cold-wall:  13%|#3        | 404/3000 [11:20<1:22:02,  1.90s/it, lr: 1.0e-04 loss: 1.822e-01]
a-cold-wall:  13%|#3        | 404/3000 [11:23<1:22:02,  1.90s/it, lr: 1.0e-04 loss: 7.157e-01]
a-cold-wall:  13%|#3        | 404/3000 [11:23<1:22:02,  1.90s/it, lr: 1.0e-04 loss: 7.157e-01]
a-cold-wall:  14%|#3        | 405/3000 [11:23<1:34:10,  2.18s/it, lr: 1.0e-04 loss: 7.157e-01]
a-cold-wall:  14%|#3        | 405/3000 [11:23<1:34:10,  2.18s/it, lr: 1.0e-04 loss: 7.157e-01]
a-cold-wall:  14%|#3        | 405/3000 [11:26<1:34:10,  2.18s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  14%|#3        | 405/3000 [11:26<1:34:10,  2.18s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  14%|#3        | 406/3000 [11:26<1:42:47,  2.38s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  14%|#3        | 406/3000 [11:26<1:42:47,  2.38s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  14%|#3        | 406/3000 [11:27<1:42:47,  2.38s/it, lr: 1.0e-04 loss: 4.866e-01]
a-cold-wall:  14%|#3        | 406/3000 [11:27<1:42:47,  2.38s/it, lr: 1.0e-04 loss: 4.866e-01]
a-cold-wall:  14%|#3        | 407/3000 [11:27<1:30:21,  2.09s/it, lr: 1.0e-04 loss: 4.866e-01]
a-cold-wall:  14%|#3        | 407/3000 [11:27<1:30:21,  2.09s/it, lr: 1.0e-04 loss: 4.866e-01]
a-cold-wall:  14%|#3        | 407/3000 [11:28<1:30:21,  2.09s/it, lr: 1.0e-04 loss: 4.367e-01]
a-cold-wall:  14%|#3        | 407/3000 [11:28<1:30:21,  2.09s/it, lr: 1.0e-04 loss: 4.367e-01]
a-cold-wall:  14%|#3        | 408/3000 [11:28<1:13:35,  1.70s/it, lr: 1.0e-04 loss: 4.367e-01]
a-cold-wall:  14%|#3        | 408/3000 [11:28<1:13:35,  1.70s/it, lr: 1.0e-04 loss: 4.367e-01]
a-cold-wall:  14%|#3        | 408/3000 [11:29<1:13:35,  1.70s/it, lr: 1.0e-04 loss: 4.099e-01]
a-cold-wall:  14%|#3        | 408/3000 [11:29<1:13:35,  1.70s/it, lr: 1.0e-04 loss: 4.099e-01]
a-cold-wall:  14%|#3        | 409/3000 [11:29<1:01:23,  1.42s/it, lr: 1.0e-04 loss: 4.099e-01]
a-cold-wall:  14%|#3        | 409/3000 [11:29<1:01:23,  1.42s/it, lr: 1.0e-04 loss: 4.099e-01]
a-cold-wall:  14%|#3        | 409/3000 [11:30<1:01:23,  1.42s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  14%|#3        | 409/3000 [11:30<1:01:23,  1.42s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  14%|#3        | 410/3000 [11:32<1:01:22,  1.42s/it, lr: 1.0e-04 loss: 4.017e-01]
a-cold-wall:  14%|#3        | 410/3000 [11:32<1:01:22,  1.42s/it, lr: 1.0e-04 loss: 4.017e-01]
a-cold-wall:  14%|#3        | 411/3000 [11:32<47:23,  1.10s/it, lr: 1.0e-04 loss: 4.017e-01]  
a-cold-wall:  14%|#3        | 411/3000 [11:32<47:23,  1.10s/it, lr: 1.0e-04 loss: 4.017e-01]  
a-cold-wall:  14%|#3        | 411/3000 [11:33<47:23,  1.10s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  14%|#3        | 411/3000 [11:33<47:23,  1.10s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  14%|#3        | 412/3000 [11:33<46:22,  1.07s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  14%|#3        | 412/3000 [11:33<46:22,  1.07s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  14%|#3        | 412/3000 [11:34<46:22,  1.07s/it, lr: 1.0e-04 loss: 4.407e-02]
a-cold-wall:  14%|#3        | 412/3000 [11:34<46:22,  1.07s/it, lr: 1.0e-04 loss: 4.407e-02]
a-cold-wall:  14%|#3        | 413/3000 [11:34<42:55,  1.00it/s, lr: 1.0e-04 loss: 4.407e-02]
a-cold-wall:  14%|#3        | 413/3000 [11:34<42:55,  1.00it/s, lr: 1.0e-04 loss: 4.407e-02]
a-cold-wall:  14%|#3        | 413/3000 [11:36<42:55,  1.00it/s, lr: 1.0e-04 loss: 6.861e-01]
a-cold-wall:  14%|#3        | 413/3000 [11:36<42:55,  1.00it/s, lr: 1.0e-04 loss: 6.861e-01]
a-cold-wall:  14%|#3        | 414/3000 [11:36<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 6.861e-01]
a-cold-wall:  14%|#3        | 414/3000 [11:36<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 6.861e-01]
a-cold-wall:  14%|#3        | 414/3000 [11:38<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  14%|#3        | 414/3000 [11:38<1:05:19,  1.52s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  14%|#3        | 415/3000 [11:38<1:04:25,  1.50s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  14%|#3        | 415/3000 [11:38<1:04:25,  1.50s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  14%|#3        | 415/3000 [11:39<1:04:25,  1.50s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  14%|#3        | 415/3000 [11:39<1:04:25,  1.50s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  14%|#3        | 416/3000 [11:39<55:11,  1.28s/it, lr: 1.0e-04 loss: 6.739e-01]  
a-cold-wall:  14%|#3        | 416/3000 [11:39<55:11,  1.28s/it, lr: 1.0e-04 loss: 6.739e-01]  
a-cold-wall:  14%|#3        | 416/3000 [11:42<55:11,  1.28s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  14%|#3        | 416/3000 [11:42<55:11,  1.28s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  14%|#3        | 417/3000 [11:42<1:15:29,  1.75s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  14%|#3        | 417/3000 [11:42<1:15:29,  1.75s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  14%|#3        | 417/3000 [11:44<1:15:29,  1.75s/it, lr: 1.0e-04 loss: 5.356e-01]
a-cold-wall:  14%|#3        | 417/3000 [11:44<1:15:29,  1.75s/it, lr: 1.0e-04 loss: 5.356e-01]
a-cold-wall:  14%|#3        | 418/3000 [11:44<1:30:00,  2.09s/it, lr: 1.0e-04 loss: 5.356e-01]
a-cold-wall:  14%|#3        | 418/3000 [11:44<1:30:00,  2.09s/it, lr: 1.0e-04 loss: 5.356e-01]
a-cold-wall:  14%|#3        | 418/3000 [11:46<1:30:00,  2.09s/it, lr: 1.0e-04 loss: 3.909e-01]
a-cold-wall:  14%|#3        | 418/3000 [11:46<1:30:00,  2.09s/it, lr: 1.0e-04 loss: 3.909e-01]
a-cold-wall:  14%|#3        | 419/3000 [11:46<1:22:59,  1.93s/it, lr: 1.0e-04 loss: 3.909e-01]
a-cold-wall:  14%|#3        | 419/3000 [11:46<1:22:59,  1.93s/it, lr: 1.0e-04 loss: 3.909e-01]
a-cold-wall:  14%|#3        | 419/3000 [11:47<1:22:59,  1.93s/it, lr: 1.0e-04 loss: 3.606e-01]
a-cold-wall:  14%|#3        | 419/3000 [11:47<1:22:59,  1.93s/it, lr: 1.0e-04 loss: 3.606e-01]
a-cold-wall:  14%|#4        | 420/3000 [11:49<1:22:57,  1.93s/it, lr: 1.0e-04 loss: 6.085e-01]
a-cold-wall:  14%|#4        | 420/3000 [11:49<1:22:57,  1.93s/it, lr: 1.0e-04 loss: 6.085e-01]
a-cold-wall:  14%|#4        | 421/3000 [11:49<58:54,  1.37s/it, lr: 1.0e-04 loss: 6.085e-01]  
a-cold-wall:  14%|#4        | 421/3000 [11:49<58:54,  1.37s/it, lr: 1.0e-04 loss: 6.085e-01]  
a-cold-wall:  14%|#4        | 421/3000 [11:50<58:54,  1.37s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  14%|#4        | 421/3000 [11:50<58:54,  1.37s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  14%|#4        | 422/3000 [11:50<1:00:37,  1.41s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  14%|#4        | 422/3000 [11:50<1:00:37,  1.41s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  14%|#4        | 422/3000 [11:53<1:00:37,  1.41s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  14%|#4        | 422/3000 [11:53<1:00:37,  1.41s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  14%|#4        | 423/3000 [11:53<1:17:11,  1.80s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  14%|#4        | 423/3000 [11:53<1:17:11,  1.80s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  14%|#4        | 423/3000 [11:54<1:17:11,  1.80s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  14%|#4        | 423/3000 [11:54<1:17:11,  1.80s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  14%|#4        | 424/3000 [11:55<1:12:44,  1.69s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  14%|#4        | 424/3000 [11:55<1:12:44,  1.69s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  14%|#4        | 424/3000 [11:56<1:12:44,  1.69s/it, lr: 1.0e-04 loss: 2.833e-01]
a-cold-wall:  14%|#4        | 424/3000 [11:56<1:12:44,  1.69s/it, lr: 1.0e-04 loss: 2.833e-01]
a-cold-wall:  14%|#4        | 425/3000 [11:56<1:11:46,  1.67s/it, lr: 1.0e-04 loss: 2.833e-01]
a-cold-wall:  14%|#4        | 425/3000 [11:56<1:11:46,  1.67s/it, lr: 1.0e-04 loss: 2.833e-01]
a-cold-wall:  14%|#4        | 425/3000 [11:59<1:11:46,  1.67s/it, lr: 1.0e-04 loss: 1.530e-02]
a-cold-wall:  14%|#4        | 425/3000 [11:59<1:11:46,  1.67s/it, lr: 1.0e-04 loss: 1.530e-02]
a-cold-wall:  14%|#4        | 426/3000 [11:59<1:26:07,  2.01s/it, lr: 1.0e-04 loss: 1.530e-02]
a-cold-wall:  14%|#4        | 426/3000 [11:59<1:26:07,  2.01s/it, lr: 1.0e-04 loss: 1.530e-02]
a-cold-wall:  14%|#4        | 426/3000 [12:00<1:26:07,  2.01s/it, lr: 1.0e-04 loss: 6.241e-01]
a-cold-wall:  14%|#4        | 426/3000 [12:00<1:26:07,  2.01s/it, lr: 1.0e-04 loss: 6.241e-01]
a-cold-wall:  14%|#4        | 427/3000 [12:00<1:10:30,  1.64s/it, lr: 1.0e-04 loss: 6.241e-01]
a-cold-wall:  14%|#4        | 427/3000 [12:00<1:10:30,  1.64s/it, lr: 1.0e-04 loss: 6.241e-01]
a-cold-wall:  14%|#4        | 427/3000 [12:00<1:10:30,  1.64s/it, lr: 1.0e-04 loss: 2.818e-01]
a-cold-wall:  14%|#4        | 427/3000 [12:00<1:10:30,  1.64s/it, lr: 1.0e-04 loss: 2.818e-01]
a-cold-wall:  14%|#4        | 428/3000 [12:00<59:33,  1.39s/it, lr: 1.0e-04 loss: 2.818e-01]  
a-cold-wall:  14%|#4        | 428/3000 [12:00<59:33,  1.39s/it, lr: 1.0e-04 loss: 2.818e-01]  
a-cold-wall:  14%|#4        | 428/3000 [12:02<59:33,  1.39s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  14%|#4        | 428/3000 [12:02<59:33,  1.39s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  14%|#4        | 429/3000 [12:02<59:49,  1.40s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  14%|#4        | 429/3000 [12:02<59:49,  1.40s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  14%|#4        | 429/3000 [12:03<59:49,  1.40s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  14%|#4        | 429/3000 [12:03<59:49,  1.40s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  14%|#4        | 430/3000 [12:05<59:47,  1.40s/it, lr: 1.0e-04 loss: 5.118e-01]
a-cold-wall:  14%|#4        | 430/3000 [12:05<59:47,  1.40s/it, lr: 1.0e-04 loss: 5.118e-01]
a-cold-wall:  14%|#4        | 431/3000 [12:05<46:20,  1.08s/it, lr: 1.0e-04 loss: 5.118e-01]
a-cold-wall:  14%|#4        | 431/3000 [12:05<46:20,  1.08s/it, lr: 1.0e-04 loss: 5.118e-01]
a-cold-wall:  14%|#4        | 431/3000 [12:08<46:20,  1.08s/it, lr: 1.0e-04 loss: 4.160e-01]
a-cold-wall:  14%|#4        | 431/3000 [12:08<46:20,  1.08s/it, lr: 1.0e-04 loss: 4.160e-01]
a-cold-wall:  14%|#4        | 432/3000 [12:08<1:05:13,  1.52s/it, lr: 1.0e-04 loss: 4.160e-01]
a-cold-wall:  14%|#4        | 432/3000 [12:08<1:05:13,  1.52s/it, lr: 1.0e-04 loss: 4.160e-01]
a-cold-wall:  14%|#4        | 432/3000 [12:08<1:05:13,  1.52s/it, lr: 1.0e-04 loss: 4.441e-01]
a-cold-wall:  14%|#4        | 432/3000 [12:08<1:05:13,  1.52s/it, lr: 1.0e-04 loss: 4.441e-01]
a-cold-wall:  14%|#4        | 433/3000 [12:08<56:33,  1.32s/it, lr: 1.0e-04 loss: 4.441e-01]  
a-cold-wall:  14%|#4        | 433/3000 [12:08<56:33,  1.32s/it, lr: 1.0e-04 loss: 4.441e-01]  
a-cold-wall:  14%|#4        | 433/3000 [12:10<56:33,  1.32s/it, lr: 1.0e-04 loss: 6.319e-02]
a-cold-wall:  14%|#4        | 433/3000 [12:10<56:33,  1.32s/it, lr: 1.0e-04 loss: 6.319e-02]
a-cold-wall:  14%|#4        | 434/3000 [12:10<57:44,  1.35s/it, lr: 1.0e-04 loss: 6.319e-02]
a-cold-wall:  14%|#4        | 434/3000 [12:10<57:44,  1.35s/it, lr: 1.0e-04 loss: 6.319e-02]
a-cold-wall:  14%|#4        | 434/3000 [12:13<57:44,  1.35s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  14%|#4        | 434/3000 [12:13<57:44,  1.35s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  14%|#4        | 435/3000 [12:13<1:15:31,  1.77s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  14%|#4        | 435/3000 [12:13<1:15:31,  1.77s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  14%|#4        | 435/3000 [12:13<1:15:31,  1.77s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  14%|#4        | 435/3000 [12:13<1:15:31,  1.77s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  15%|#4        | 436/3000 [12:13<1:02:59,  1.47s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  15%|#4        | 436/3000 [12:13<1:02:59,  1.47s/it, lr: 1.0e-04 loss: 1.402e-01]
a-cold-wall:  15%|#4        | 436/3000 [12:16<1:02:59,  1.47s/it, lr: 1.0e-04 loss: 2.481e-01]
a-cold-wall:  15%|#4        | 436/3000 [12:16<1:02:59,  1.47s/it, lr: 1.0e-04 loss: 2.481e-01]
a-cold-wall:  15%|#4        | 437/3000 [12:16<1:20:18,  1.88s/it, lr: 1.0e-04 loss: 2.481e-01]
a-cold-wall:  15%|#4        | 437/3000 [12:16<1:20:18,  1.88s/it, lr: 1.0e-04 loss: 2.481e-01]
a-cold-wall:  15%|#4        | 437/3000 [12:19<1:20:18,  1.88s/it, lr: 1.0e-04 loss: 3.802e-01]
a-cold-wall:  15%|#4        | 437/3000 [12:19<1:20:18,  1.88s/it, lr: 1.0e-04 loss: 3.802e-01]
a-cold-wall:  15%|#4        | 438/3000 [12:19<1:32:15,  2.16s/it, lr: 1.0e-04 loss: 3.802e-01]
a-cold-wall:  15%|#4        | 438/3000 [12:19<1:32:15,  2.16s/it, lr: 1.0e-04 loss: 3.802e-01]
a-cold-wall:  15%|#4        | 438/3000 [12:22<1:32:15,  2.16s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  15%|#4        | 438/3000 [12:22<1:32:15,  2.16s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  15%|#4        | 439/3000 [12:22<1:40:47,  2.36s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  15%|#4        | 439/3000 [12:22<1:40:47,  2.36s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  15%|#4        | 439/3000 [12:23<1:40:47,  2.36s/it, lr: 1.0e-04 loss: 4.572e-01]
a-cold-wall:  15%|#4        | 439/3000 [12:23<1:40:47,  2.36s/it, lr: 1.0e-04 loss: 4.572e-01]
a-cold-wall:  15%|#4        | 440/3000 [12:26<1:40:45,  2.36s/it, lr: 1.0e-04 loss: 2.907e-02]
a-cold-wall:  15%|#4        | 440/3000 [12:26<1:40:45,  2.36s/it, lr: 1.0e-04 loss: 2.907e-02]
a-cold-wall:  15%|#4        | 441/3000 [12:26<1:22:41,  1.94s/it, lr: 1.0e-04 loss: 2.907e-02]
a-cold-wall:  15%|#4        | 441/3000 [12:26<1:22:41,  1.94s/it, lr: 1.0e-04 loss: 2.907e-02]
a-cold-wall:  15%|#4        | 441/3000 [12:27<1:22:41,  1.94s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  15%|#4        | 441/3000 [12:27<1:22:41,  1.94s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  15%|#4        | 442/3000 [12:27<1:10:11,  1.65s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  15%|#4        | 442/3000 [12:27<1:10:11,  1.65s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  15%|#4        | 442/3000 [12:27<1:10:11,  1.65s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  15%|#4        | 442/3000 [12:27<1:10:11,  1.65s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  15%|#4        | 443/3000 [12:27<1:00:20,  1.42s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  15%|#4        | 443/3000 [12:27<1:00:20,  1.42s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  15%|#4        | 443/3000 [12:30<1:00:20,  1.42s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  15%|#4        | 443/3000 [12:30<1:00:20,  1.42s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  15%|#4        | 444/3000 [12:30<1:17:13,  1.81s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  15%|#4        | 444/3000 [12:30<1:17:13,  1.81s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  15%|#4        | 444/3000 [12:31<1:17:13,  1.81s/it, lr: 1.0e-04 loss: 6.176e-01]
a-cold-wall:  15%|#4        | 444/3000 [12:31<1:17:13,  1.81s/it, lr: 1.0e-04 loss: 6.176e-01]
a-cold-wall:  15%|#4        | 445/3000 [12:31<1:04:30,  1.51s/it, lr: 1.0e-04 loss: 6.176e-01]
a-cold-wall:  15%|#4        | 445/3000 [12:31<1:04:30,  1.51s/it, lr: 1.0e-04 loss: 6.176e-01]
a-cold-wall:  15%|#4        | 445/3000 [12:32<1:04:30,  1.51s/it, lr: 1.0e-04 loss: 5.456e-01]
a-cold-wall:  15%|#4        | 445/3000 [12:32<1:04:30,  1.51s/it, lr: 1.0e-04 loss: 5.456e-01]
a-cold-wall:  15%|#4        | 446/3000 [12:32<55:10,  1.30s/it, lr: 1.0e-04 loss: 5.456e-01]  
a-cold-wall:  15%|#4        | 446/3000 [12:32<55:10,  1.30s/it, lr: 1.0e-04 loss: 5.456e-01]  
a-cold-wall:  15%|#4        | 446/3000 [12:33<55:10,  1.30s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  15%|#4        | 446/3000 [12:33<55:10,  1.30s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  15%|#4        | 447/3000 [12:33<49:19,  1.16s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  15%|#4        | 447/3000 [12:33<49:19,  1.16s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  15%|#4        | 447/3000 [12:35<49:19,  1.16s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  15%|#4        | 447/3000 [12:35<49:19,  1.16s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  15%|#4        | 448/3000 [12:35<1:10:43,  1.66s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  15%|#4        | 448/3000 [12:35<1:10:43,  1.66s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  15%|#4        | 448/3000 [12:38<1:10:43,  1.66s/it, lr: 1.0e-04 loss: 1.842e-01]
a-cold-wall:  15%|#4        | 448/3000 [12:38<1:10:43,  1.66s/it, lr: 1.0e-04 loss: 1.842e-01]
a-cold-wall:  15%|#4        | 449/3000 [12:38<1:25:32,  2.01s/it, lr: 1.0e-04 loss: 1.842e-01]
a-cold-wall:  15%|#4        | 449/3000 [12:38<1:25:32,  2.01s/it, lr: 1.0e-04 loss: 1.842e-01]
a-cold-wall:  15%|#4        | 449/3000 [12:39<1:25:32,  2.01s/it, lr: 1.0e-04 loss: 4.470e-01]
a-cold-wall:  15%|#4        | 449/3000 [12:39<1:25:32,  2.01s/it, lr: 1.0e-04 loss: 4.470e-01]
a-cold-wall:  15%|#5        | 450/3000 [12:40<1:25:30,  2.01s/it, lr: 1.0e-04 loss: 2.298e-01]
a-cold-wall:  15%|#5        | 450/3000 [12:40<1:25:30,  2.01s/it, lr: 1.0e-04 loss: 2.298e-01]
a-cold-wall:  15%|#5        | 451/3000 [12:40<55:47,  1.31s/it, lr: 1.0e-04 loss: 2.298e-01]  
a-cold-wall:  15%|#5        | 451/3000 [12:40<55:47,  1.31s/it, lr: 1.0e-04 loss: 2.298e-01]  
a-cold-wall:  15%|#5        | 451/3000 [12:43<55:47,  1.31s/it, lr: 1.0e-04 loss: 6.684e-01]
a-cold-wall:  15%|#5        | 451/3000 [12:43<55:47,  1.31s/it, lr: 1.0e-04 loss: 6.684e-01]
a-cold-wall:  15%|#5        | 452/3000 [12:43<1:11:47,  1.69s/it, lr: 1.0e-04 loss: 6.684e-01]
a-cold-wall:  15%|#5        | 452/3000 [12:43<1:11:47,  1.69s/it, lr: 1.0e-04 loss: 6.684e-01]
a-cold-wall:  15%|#5        | 452/3000 [12:44<1:11:47,  1.69s/it, lr: 1.0e-04 loss: 2.396e-01]
a-cold-wall:  15%|#5        | 452/3000 [12:44<1:11:47,  1.69s/it, lr: 1.0e-04 loss: 2.396e-01]
a-cold-wall:  15%|#5        | 453/3000 [12:44<1:10:35,  1.66s/it, lr: 1.0e-04 loss: 2.396e-01]
a-cold-wall:  15%|#5        | 453/3000 [12:44<1:10:35,  1.66s/it, lr: 1.0e-04 loss: 2.396e-01]
a-cold-wall:  15%|#5        | 453/3000 [12:45<1:10:35,  1.66s/it, lr: 1.0e-04 loss: 5.288e-01]
a-cold-wall:  15%|#5        | 453/3000 [12:45<1:10:35,  1.66s/it, lr: 1.0e-04 loss: 5.288e-01]
a-cold-wall:  15%|#5        | 454/3000 [12:45<1:00:00,  1.41s/it, lr: 1.0e-04 loss: 5.288e-01]
a-cold-wall:  15%|#5        | 454/3000 [12:45<1:00:00,  1.41s/it, lr: 1.0e-04 loss: 5.288e-01]
a-cold-wall:  15%|#5        | 454/3000 [12:46<1:00:00,  1.41s/it, lr: 1.0e-04 loss: 3.045e-01]
a-cold-wall:  15%|#5        | 454/3000 [12:46<1:00:00,  1.41s/it, lr: 1.0e-04 loss: 3.045e-01]
a-cold-wall:  15%|#5        | 455/3000 [12:46<59:30,  1.40s/it, lr: 1.0e-04 loss: 3.045e-01]  
a-cold-wall:  15%|#5        | 455/3000 [12:46<59:30,  1.40s/it, lr: 1.0e-04 loss: 3.045e-01]  
a-cold-wall:  15%|#5        | 455/3000 [12:47<59:30,  1.40s/it, lr: 1.0e-04 loss: 6.012e-01]
a-cold-wall:  15%|#5        | 455/3000 [12:47<59:30,  1.40s/it, lr: 1.0e-04 loss: 6.012e-01]
a-cold-wall:  15%|#5        | 456/3000 [12:47<51:43,  1.22s/it, lr: 1.0e-04 loss: 6.012e-01]
a-cold-wall:  15%|#5        | 456/3000 [12:47<51:43,  1.22s/it, lr: 1.0e-04 loss: 6.012e-01]
a-cold-wall:  15%|#5        | 456/3000 [12:49<51:43,  1.22s/it, lr: 1.0e-04 loss: 7.148e-02]
a-cold-wall:  15%|#5        | 456/3000 [12:49<51:43,  1.22s/it, lr: 1.0e-04 loss: 7.148e-02]
a-cold-wall:  15%|#5        | 457/3000 [12:49<53:34,  1.26s/it, lr: 1.0e-04 loss: 7.148e-02]
a-cold-wall:  15%|#5        | 457/3000 [12:49<53:34,  1.26s/it, lr: 1.0e-04 loss: 7.148e-02]
a-cold-wall:  15%|#5        | 457/3000 [12:50<53:34,  1.26s/it, lr: 1.0e-04 loss: 3.359e-01]
a-cold-wall:  15%|#5        | 457/3000 [12:50<53:34,  1.26s/it, lr: 1.0e-04 loss: 3.359e-01]
a-cold-wall:  15%|#5        | 458/3000 [12:50<55:20,  1.31s/it, lr: 1.0e-04 loss: 3.359e-01]
a-cold-wall:  15%|#5        | 458/3000 [12:50<55:20,  1.31s/it, lr: 1.0e-04 loss: 3.359e-01]
a-cold-wall:  15%|#5        | 458/3000 [12:53<55:20,  1.31s/it, lr: 1.0e-04 loss: 3.125e-01]
a-cold-wall:  15%|#5        | 458/3000 [12:53<55:20,  1.31s/it, lr: 1.0e-04 loss: 3.125e-01]
a-cold-wall:  15%|#5        | 459/3000 [12:53<1:14:35,  1.76s/it, lr: 1.0e-04 loss: 3.125e-01]
a-cold-wall:  15%|#5        | 459/3000 [12:53<1:14:35,  1.76s/it, lr: 1.0e-04 loss: 3.125e-01]
a-cold-wall:  15%|#5        | 459/3000 [12:56<1:14:35,  1.76s/it, lr: 1.0e-04 loss: 2.829e-01]
a-cold-wall:  15%|#5        | 459/3000 [12:56<1:14:35,  1.76s/it, lr: 1.0e-04 loss: 2.829e-01]
a-cold-wall:  15%|#5        | 460/3000 [12:59<1:14:33,  1.76s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  15%|#5        | 460/3000 [12:59<1:14:33,  1.76s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  15%|#5        | 461/3000 [12:59<1:08:23,  1.62s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  15%|#5        | 461/3000 [12:59<1:08:23,  1.62s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  15%|#5        | 461/3000 [13:01<1:08:23,  1.62s/it, lr: 1.0e-04 loss: 1.583e-01]
a-cold-wall:  15%|#5        | 461/3000 [13:01<1:08:23,  1.62s/it, lr: 1.0e-04 loss: 1.583e-01]
a-cold-wall:  15%|#5        | 462/3000 [13:01<1:21:19,  1.92s/it, lr: 1.0e-04 loss: 1.583e-01]
a-cold-wall:  15%|#5        | 462/3000 [13:01<1:21:19,  1.92s/it, lr: 1.0e-04 loss: 1.583e-01]
a-cold-wall:  15%|#5        | 462/3000 [13:03<1:21:19,  1.92s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  15%|#5        | 462/3000 [13:03<1:21:19,  1.92s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  15%|#5        | 463/3000 [13:03<1:16:01,  1.80s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  15%|#5        | 463/3000 [13:03<1:16:01,  1.80s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  15%|#5        | 463/3000 [13:06<1:16:01,  1.80s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  15%|#5        | 463/3000 [13:06<1:16:01,  1.80s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  15%|#5        | 464/3000 [13:06<1:28:34,  2.10s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  15%|#5        | 464/3000 [13:06<1:28:34,  2.10s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  15%|#5        | 464/3000 [13:07<1:28:34,  2.10s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  15%|#5        | 464/3000 [13:07<1:28:34,  2.10s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  16%|#5        | 465/3000 [13:07<1:20:42,  1.91s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  16%|#5        | 465/3000 [13:07<1:20:42,  1.91s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  16%|#5        | 465/3000 [13:08<1:20:42,  1.91s/it, lr: 1.0e-04 loss: 6.023e-01]
a-cold-wall:  16%|#5        | 465/3000 [13:08<1:20:42,  1.91s/it, lr: 1.0e-04 loss: 6.023e-01]
a-cold-wall:  16%|#5        | 466/3000 [13:08<1:06:42,  1.58s/it, lr: 1.0e-04 loss: 6.023e-01]
a-cold-wall:  16%|#5        | 466/3000 [13:08<1:06:42,  1.58s/it, lr: 1.0e-04 loss: 6.023e-01]
a-cold-wall:  16%|#5        | 466/3000 [13:09<1:06:42,  1.58s/it, lr: 1.0e-04 loss: 4.360e-01]
a-cold-wall:  16%|#5        | 466/3000 [13:09<1:06:42,  1.58s/it, lr: 1.0e-04 loss: 4.360e-01]
a-cold-wall:  16%|#5        | 467/3000 [13:09<59:21,  1.41s/it, lr: 1.0e-04 loss: 4.360e-01]  
a-cold-wall:  16%|#5        | 467/3000 [13:09<59:21,  1.41s/it, lr: 1.0e-04 loss: 4.360e-01]  
a-cold-wall:  16%|#5        | 467/3000 [13:12<59:21,  1.41s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  16%|#5        | 467/3000 [13:12<59:21,  1.41s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  16%|#5        | 468/3000 [13:12<1:17:47,  1.84s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  16%|#5        | 468/3000 [13:12<1:17:47,  1.84s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  16%|#5        | 468/3000 [13:13<1:17:47,  1.84s/it, lr: 1.0e-04 loss: 7.327e-01]
a-cold-wall:  16%|#5        | 468/3000 [13:13<1:17:47,  1.84s/it, lr: 1.0e-04 loss: 7.327e-01]
a-cold-wall:  16%|#5        | 469/3000 [13:13<1:04:12,  1.52s/it, lr: 1.0e-04 loss: 7.327e-01]
a-cold-wall:  16%|#5        | 469/3000 [13:13<1:04:12,  1.52s/it, lr: 1.0e-04 loss: 7.327e-01]
a-cold-wall:  16%|#5        | 469/3000 [13:14<1:04:12,  1.52s/it, lr: 1.0e-04 loss: 7.264e-01]
a-cold-wall:  16%|#5        | 469/3000 [13:14<1:04:12,  1.52s/it, lr: 1.0e-04 loss: 7.264e-01]
a-cold-wall:  16%|#5        | 470/3000 [13:17<1:04:10,  1.52s/it, lr: 1.0e-04 loss: 6.155e-01]
a-cold-wall:  16%|#5        | 470/3000 [13:17<1:04:10,  1.52s/it, lr: 1.0e-04 loss: 6.155e-01]
a-cold-wall:  16%|#5        | 471/3000 [13:17<1:02:33,  1.48s/it, lr: 1.0e-04 loss: 6.155e-01]
a-cold-wall:  16%|#5        | 471/3000 [13:17<1:02:33,  1.48s/it, lr: 1.0e-04 loss: 6.155e-01]
a-cold-wall:  16%|#5        | 471/3000 [13:18<1:02:33,  1.48s/it, lr: 1.0e-04 loss: 1.592e-01]
a-cold-wall:  16%|#5        | 471/3000 [13:18<1:02:33,  1.48s/it, lr: 1.0e-04 loss: 1.592e-01]
a-cold-wall:  16%|#5        | 472/3000 [13:18<54:53,  1.30s/it, lr: 1.0e-04 loss: 1.592e-01]  
a-cold-wall:  16%|#5        | 472/3000 [13:18<54:53,  1.30s/it, lr: 1.0e-04 loss: 1.592e-01]  
a-cold-wall:  16%|#5        | 472/3000 [13:21<54:53,  1.30s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  16%|#5        | 472/3000 [13:21<54:53,  1.30s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  16%|#5        | 473/3000 [13:21<1:12:30,  1.72s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  16%|#5        | 473/3000 [13:21<1:12:30,  1.72s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  16%|#5        | 473/3000 [13:21<1:12:30,  1.72s/it, lr: 1.0e-04 loss: 6.205e-01]
a-cold-wall:  16%|#5        | 473/3000 [13:21<1:12:30,  1.72s/it, lr: 1.0e-04 loss: 6.205e-01]
a-cold-wall:  16%|#5        | 474/3000 [13:21<1:01:23,  1.46s/it, lr: 1.0e-04 loss: 6.205e-01]
a-cold-wall:  16%|#5        | 474/3000 [13:21<1:01:23,  1.46s/it, lr: 1.0e-04 loss: 6.205e-01]
a-cold-wall:  16%|#5        | 474/3000 [13:23<1:01:23,  1.46s/it, lr: 1.0e-04 loss: 3.321e-01]
a-cold-wall:  16%|#5        | 474/3000 [13:23<1:01:23,  1.46s/it, lr: 1.0e-04 loss: 3.321e-01]
a-cold-wall:  16%|#5        | 475/3000 [13:23<1:01:10,  1.45s/it, lr: 1.0e-04 loss: 3.321e-01]
a-cold-wall:  16%|#5        | 475/3000 [13:23<1:01:10,  1.45s/it, lr: 1.0e-04 loss: 3.321e-01]
a-cold-wall:  16%|#5        | 475/3000 [13:26<1:01:10,  1.45s/it, lr: 1.0e-04 loss: 7.697e-01]
a-cold-wall:  16%|#5        | 475/3000 [13:26<1:01:10,  1.45s/it, lr: 1.0e-04 loss: 7.697e-01]
a-cold-wall:  16%|#5        | 476/3000 [13:26<1:18:53,  1.88s/it, lr: 1.0e-04 loss: 7.697e-01]
a-cold-wall:  16%|#5        | 476/3000 [13:26<1:18:53,  1.88s/it, lr: 1.0e-04 loss: 7.697e-01]
a-cold-wall:  16%|#5        | 476/3000 [13:26<1:18:53,  1.88s/it, lr: 1.0e-04 loss: 4.854e-01]
a-cold-wall:  16%|#5        | 476/3000 [13:26<1:18:53,  1.88s/it, lr: 1.0e-04 loss: 4.854e-01]
a-cold-wall:  16%|#5        | 477/3000 [13:26<1:05:15,  1.55s/it, lr: 1.0e-04 loss: 4.854e-01]
a-cold-wall:  16%|#5        | 477/3000 [13:26<1:05:15,  1.55s/it, lr: 1.0e-04 loss: 4.854e-01]
a-cold-wall:  16%|#5        | 477/3000 [13:29<1:05:15,  1.55s/it, lr: 1.0e-04 loss: 3.695e-01]
a-cold-wall:  16%|#5        | 477/3000 [13:29<1:05:15,  1.55s/it, lr: 1.0e-04 loss: 3.695e-01]
a-cold-wall:  16%|#5        | 478/3000 [13:29<1:22:00,  1.95s/it, lr: 1.0e-04 loss: 3.695e-01]
a-cold-wall:  16%|#5        | 478/3000 [13:29<1:22:00,  1.95s/it, lr: 1.0e-04 loss: 3.695e-01]
a-cold-wall:  16%|#5        | 478/3000 [13:32<1:22:00,  1.95s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  16%|#5        | 478/3000 [13:32<1:22:00,  1.95s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  16%|#5        | 479/3000 [13:32<1:33:44,  2.23s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  16%|#5        | 479/3000 [13:32<1:33:44,  2.23s/it, lr: 1.0e-04 loss: 1.633e-01]
a-cold-wall:  16%|#5        | 479/3000 [13:33<1:33:44,  2.23s/it, lr: 1.0e-04 loss: 3.293e-01]
a-cold-wall:  16%|#5        | 479/3000 [13:33<1:33:44,  2.23s/it, lr: 1.0e-04 loss: 3.293e-01]
a-cold-wall:  16%|#6        | 480/3000 [13:34<1:33:42,  2.23s/it, lr: 1.0e-04 loss: 6.641e-01]
a-cold-wall:  16%|#6        | 480/3000 [13:34<1:33:42,  2.23s/it, lr: 1.0e-04 loss: 6.641e-01]
a-cold-wall:  16%|#6        | 481/3000 [13:34<58:04,  1.38s/it, lr: 1.0e-04 loss: 6.641e-01]  
a-cold-wall:  16%|#6        | 481/3000 [13:34<58:04,  1.38s/it, lr: 1.0e-04 loss: 6.641e-01]  
a-cold-wall:  16%|#6        | 481/3000 [13:37<58:04,  1.38s/it, lr: 1.0e-04 loss: 1.202e-01]
a-cold-wall:  16%|#6        | 481/3000 [13:37<58:04,  1.38s/it, lr: 1.0e-04 loss: 1.202e-01]
a-cold-wall:  16%|#6        | 482/3000 [13:37<1:13:50,  1.76s/it, lr: 1.0e-04 loss: 1.202e-01]
a-cold-wall:  16%|#6        | 482/3000 [13:37<1:13:50,  1.76s/it, lr: 1.0e-04 loss: 1.202e-01]
a-cold-wall:  16%|#6        | 482/3000 [13:38<1:13:50,  1.76s/it, lr: 1.0e-04 loss: 1.311e-01]
a-cold-wall:  16%|#6        | 482/3000 [13:38<1:13:50,  1.76s/it, lr: 1.0e-04 loss: 1.311e-01]
a-cold-wall:  16%|#6        | 483/3000 [13:38<1:10:00,  1.67s/it, lr: 1.0e-04 loss: 1.311e-01]
a-cold-wall:  16%|#6        | 483/3000 [13:38<1:10:00,  1.67s/it, lr: 1.0e-04 loss: 1.311e-01]
a-cold-wall:  16%|#6        | 483/3000 [13:40<1:10:00,  1.67s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  16%|#6        | 483/3000 [13:40<1:10:00,  1.67s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  16%|#6        | 484/3000 [13:40<1:07:03,  1.60s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  16%|#6        | 484/3000 [13:40<1:07:03,  1.60s/it, lr: 1.0e-04 loss: 3.213e-01]
a-cold-wall:  16%|#6        | 484/3000 [13:43<1:07:03,  1.60s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  16%|#6        | 484/3000 [13:43<1:07:03,  1.60s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  16%|#6        | 485/3000 [13:43<1:21:41,  1.95s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  16%|#6        | 485/3000 [13:43<1:21:41,  1.95s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  16%|#6        | 485/3000 [13:45<1:21:41,  1.95s/it, lr: 1.0e-04 loss: 2.073e-01]
a-cold-wall:  16%|#6        | 485/3000 [13:45<1:21:41,  1.95s/it, lr: 1.0e-04 loss: 2.073e-01]
a-cold-wall:  16%|#6        | 486/3000 [13:45<1:32:49,  2.22s/it, lr: 1.0e-04 loss: 2.073e-01]
a-cold-wall:  16%|#6        | 486/3000 [13:45<1:32:49,  2.22s/it, lr: 1.0e-04 loss: 2.073e-01]
a-cold-wall:  16%|#6        | 486/3000 [13:46<1:32:49,  2.22s/it, lr: 1.0e-04 loss: 2.718e-01]
a-cold-wall:  16%|#6        | 486/3000 [13:46<1:32:49,  2.22s/it, lr: 1.0e-04 loss: 2.718e-01]
a-cold-wall:  16%|#6        | 487/3000 [13:46<1:14:50,  1.79s/it, lr: 1.0e-04 loss: 2.718e-01]
a-cold-wall:  16%|#6        | 487/3000 [13:46<1:14:50,  1.79s/it, lr: 1.0e-04 loss: 2.718e-01]
a-cold-wall:  16%|#6        | 487/3000 [13:47<1:14:50,  1.79s/it, lr: 1.0e-04 loss: 7.129e-01]
a-cold-wall:  16%|#6        | 487/3000 [13:47<1:14:50,  1.79s/it, lr: 1.0e-04 loss: 7.129e-01]
a-cold-wall:  16%|#6        | 488/3000 [13:47<1:01:59,  1.48s/it, lr: 1.0e-04 loss: 7.129e-01]
a-cold-wall:  16%|#6        | 488/3000 [13:47<1:01:59,  1.48s/it, lr: 1.0e-04 loss: 7.129e-01]
a-cold-wall:  16%|#6        | 488/3000 [13:50<1:01:59,  1.48s/it, lr: 1.0e-04 loss: 5.276e-01]
a-cold-wall:  16%|#6        | 488/3000 [13:50<1:01:59,  1.48s/it, lr: 1.0e-04 loss: 5.276e-01]
a-cold-wall:  16%|#6        | 489/3000 [13:50<1:18:47,  1.88s/it, lr: 1.0e-04 loss: 5.276e-01]
a-cold-wall:  16%|#6        | 489/3000 [13:50<1:18:47,  1.88s/it, lr: 1.0e-04 loss: 5.276e-01]
a-cold-wall:  16%|#6        | 489/3000 [13:53<1:18:47,  1.88s/it, lr: 1.0e-04 loss: 9.777e-02]
a-cold-wall:  16%|#6        | 489/3000 [13:53<1:18:47,  1.88s/it, lr: 1.0e-04 loss: 9.777e-02]
a-cold-wall:  16%|#6        | 490/3000 [13:54<1:18:45,  1.88s/it, lr: 1.0e-04 loss: 4.432e-01]
a-cold-wall:  16%|#6        | 490/3000 [13:54<1:18:45,  1.88s/it, lr: 1.0e-04 loss: 4.432e-01]
a-cold-wall:  16%|#6        | 491/3000 [13:54<56:17,  1.35s/it, lr: 1.0e-04 loss: 4.432e-01]  
a-cold-wall:  16%|#6        | 491/3000 [13:54<56:17,  1.35s/it, lr: 1.0e-04 loss: 4.432e-01]  
a-cold-wall:  16%|#6        | 491/3000 [13:56<56:17,  1.35s/it, lr: 1.0e-04 loss: 5.559e-01]
a-cold-wall:  16%|#6        | 491/3000 [13:56<56:17,  1.35s/it, lr: 1.0e-04 loss: 5.559e-01]
a-cold-wall:  16%|#6        | 492/3000 [13:56<57:04,  1.37s/it, lr: 1.0e-04 loss: 5.559e-01]
a-cold-wall:  16%|#6        | 492/3000 [13:56<57:04,  1.37s/it, lr: 1.0e-04 loss: 5.559e-01]
a-cold-wall:  16%|#6        | 492/3000 [13:57<57:04,  1.37s/it, lr: 1.0e-04 loss: 1.859e-01]
a-cold-wall:  16%|#6        | 492/3000 [13:57<57:04,  1.37s/it, lr: 1.0e-04 loss: 1.859e-01]
a-cold-wall:  16%|#6        | 493/3000 [13:57<57:30,  1.38s/it, lr: 1.0e-04 loss: 1.859e-01]
a-cold-wall:  16%|#6        | 493/3000 [13:57<57:30,  1.38s/it, lr: 1.0e-04 loss: 1.859e-01]
a-cold-wall:  16%|#6        | 493/3000 [13:58<57:30,  1.38s/it, lr: 1.0e-04 loss: 6.475e-01]
a-cold-wall:  16%|#6        | 493/3000 [13:58<57:30,  1.38s/it, lr: 1.0e-04 loss: 6.475e-01]
a-cold-wall:  16%|#6        | 494/3000 [13:58<52:55,  1.27s/it, lr: 1.0e-04 loss: 6.475e-01]
a-cold-wall:  16%|#6        | 494/3000 [13:58<52:55,  1.27s/it, lr: 1.0e-04 loss: 6.475e-01]
a-cold-wall:  16%|#6        | 494/3000 [13:59<52:55,  1.27s/it, lr: 1.0e-04 loss: 2.205e-01]
a-cold-wall:  16%|#6        | 494/3000 [13:59<52:55,  1.27s/it, lr: 1.0e-04 loss: 2.205e-01]
a-cold-wall:  16%|#6        | 495/3000 [13:59<54:31,  1.31s/it, lr: 1.0e-04 loss: 2.205e-01]
a-cold-wall:  16%|#6        | 495/3000 [13:59<54:31,  1.31s/it, lr: 1.0e-04 loss: 2.205e-01]
a-cold-wall:  16%|#6        | 495/3000 [14:02<54:31,  1.31s/it, lr: 1.0e-04 loss: 1.308e-01]
a-cold-wall:  16%|#6        | 495/3000 [14:02<54:31,  1.31s/it, lr: 1.0e-04 loss: 1.308e-01]
a-cold-wall:  17%|#6        | 496/3000 [14:02<1:13:09,  1.75s/it, lr: 1.0e-04 loss: 1.308e-01]
a-cold-wall:  17%|#6        | 496/3000 [14:02<1:13:09,  1.75s/it, lr: 1.0e-04 loss: 1.308e-01]
a-cold-wall:  17%|#6        | 496/3000 [14:03<1:13:09,  1.75s/it, lr: 1.0e-04 loss: 3.383e-01]
a-cold-wall:  17%|#6        | 496/3000 [14:03<1:13:09,  1.75s/it, lr: 1.0e-04 loss: 3.383e-01]
a-cold-wall:  17%|#6        | 497/3000 [14:03<1:01:07,  1.47s/it, lr: 1.0e-04 loss: 3.383e-01]
a-cold-wall:  17%|#6        | 497/3000 [14:03<1:01:07,  1.47s/it, lr: 1.0e-04 loss: 3.383e-01]
a-cold-wall:  17%|#6        | 497/3000 [14:06<1:01:07,  1.47s/it, lr: 1.0e-04 loss: 2.266e-01]
a-cold-wall:  17%|#6        | 497/3000 [14:06<1:01:07,  1.47s/it, lr: 1.0e-04 loss: 2.266e-01]
a-cold-wall:  17%|#6        | 498/3000 [14:06<1:18:21,  1.88s/it, lr: 1.0e-04 loss: 2.266e-01]
a-cold-wall:  17%|#6        | 498/3000 [14:06<1:18:21,  1.88s/it, lr: 1.0e-04 loss: 2.266e-01]
a-cold-wall:  17%|#6        | 498/3000 [14:07<1:18:21,  1.88s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:  17%|#6        | 498/3000 [14:07<1:18:21,  1.88s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:  17%|#6        | 499/3000 [14:07<1:04:30,  1.55s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:  17%|#6        | 499/3000 [14:07<1:04:30,  1.55s/it, lr: 1.0e-04 loss: 2.908e-01]
a-cold-wall:  17%|#6        | 499/3000 [14:07<1:04:30,  1.55s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  17%|#6        | 499/3000 [14:07<1:04:30,  1.55s/it, lr: 1.0e-04 loss: 2.145e-01]
Saving at step 500
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000000500.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt

a-cold-wall:  17%|#6        | 500/3000 [14:10<1:04:28,  1.55s/it, lr: 1.0e-04 loss: 8.224e-01]
a-cold-wall:  17%|#6        | 500/3000 [14:10<1:04:28,  1.55s/it, lr: 1.0e-04 loss: 8.224e-01]
a-cold-wall:  17%|#6        | 501/3000 [14:10<1:04:20,  1.54s/it, lr: 1.0e-04 loss: 8.224e-01]
a-cold-wall:  17%|#6        | 501/3000 [14:10<1:04:20,  1.54s/it, lr: 1.0e-04 loss: 8.224e-01]
a-cold-wall:  17%|#6        | 501/3000 [14:11<1:04:20,  1.54s/it, lr: 1.0e-04 loss: 6.169e-01]
a-cold-wall:  17%|#6        | 501/3000 [14:11<1:04:20,  1.54s/it, lr: 1.0e-04 loss: 6.169e-01]
a-cold-wall:  17%|#6        | 502/3000 [14:11<58:16,  1.40s/it, lr: 1.0e-04 loss: 6.169e-01]  
a-cold-wall:  17%|#6        | 502/3000 [14:11<58:16,  1.40s/it, lr: 1.0e-04 loss: 6.169e-01]  
a-cold-wall:  17%|#6        | 502/3000 [14:12<58:16,  1.40s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  17%|#6        | 502/3000 [14:12<58:16,  1.40s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  17%|#6        | 503/3000 [14:12<51:07,  1.23s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  17%|#6        | 503/3000 [14:12<51:07,  1.23s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  17%|#6        | 503/3000 [14:14<51:07,  1.23s/it, lr: 1.0e-04 loss: 1.852e-01]
a-cold-wall:  17%|#6        | 503/3000 [14:14<51:07,  1.23s/it, lr: 1.0e-04 loss: 1.852e-01]
a-cold-wall:  17%|#6        | 504/3000 [14:14<53:25,  1.28s/it, lr: 1.0e-04 loss: 1.852e-01]
a-cold-wall:  17%|#6        | 504/3000 [14:14<53:25,  1.28s/it, lr: 1.0e-04 loss: 1.852e-01]
a-cold-wall:  17%|#6        | 504/3000 [14:15<53:25,  1.28s/it, lr: 1.0e-04 loss: 3.451e-01]
a-cold-wall:  17%|#6        | 504/3000 [14:15<53:25,  1.28s/it, lr: 1.0e-04 loss: 3.451e-01]
a-cold-wall:  17%|#6        | 505/3000 [14:15<54:53,  1.32s/it, lr: 1.0e-04 loss: 3.451e-01]
a-cold-wall:  17%|#6        | 505/3000 [14:15<54:53,  1.32s/it, lr: 1.0e-04 loss: 3.451e-01]
a-cold-wall:  17%|#6        | 505/3000 [14:16<54:53,  1.32s/it, lr: 1.0e-04 loss: 7.079e-01]
a-cold-wall:  17%|#6        | 505/3000 [14:16<54:53,  1.32s/it, lr: 1.0e-04 loss: 7.079e-01]
a-cold-wall:  17%|#6        | 506/3000 [14:16<48:10,  1.16s/it, lr: 1.0e-04 loss: 7.079e-01]
a-cold-wall:  17%|#6        | 506/3000 [14:16<48:10,  1.16s/it, lr: 1.0e-04 loss: 7.079e-01]
a-cold-wall:  17%|#6        | 506/3000 [14:17<48:10,  1.16s/it, lr: 1.0e-04 loss: 4.306e-01]
a-cold-wall:  17%|#6        | 506/3000 [14:17<48:10,  1.16s/it, lr: 1.0e-04 loss: 4.306e-01]
a-cold-wall:  17%|#6        | 507/3000 [14:17<51:04,  1.23s/it, lr: 1.0e-04 loss: 4.306e-01]
a-cold-wall:  17%|#6        | 507/3000 [14:17<51:04,  1.23s/it, lr: 1.0e-04 loss: 4.306e-01]
a-cold-wall:  17%|#6        | 507/3000 [14:20<51:04,  1.23s/it, lr: 1.0e-04 loss: 4.340e-01]
a-cold-wall:  17%|#6        | 507/3000 [14:20<51:04,  1.23s/it, lr: 1.0e-04 loss: 4.340e-01]
a-cold-wall:  17%|#6        | 508/3000 [14:20<1:10:32,  1.70s/it, lr: 1.0e-04 loss: 4.340e-01]
a-cold-wall:  17%|#6        | 508/3000 [14:20<1:10:32,  1.70s/it, lr: 1.0e-04 loss: 4.340e-01]
a-cold-wall:  17%|#6        | 508/3000 [14:21<1:10:32,  1.70s/it, lr: 1.0e-04 loss: 5.967e-01]
a-cold-wall:  17%|#6        | 508/3000 [14:21<1:10:32,  1.70s/it, lr: 1.0e-04 loss: 5.967e-01]
a-cold-wall:  17%|#6        | 509/3000 [14:21<58:53,  1.42s/it, lr: 1.0e-04 loss: 5.967e-01]  
a-cold-wall:  17%|#6        | 509/3000 [14:21<58:53,  1.42s/it, lr: 1.0e-04 loss: 5.967e-01]  
a-cold-wall:  17%|#6        | 509/3000 [14:22<58:53,  1.42s/it, lr: 1.0e-04 loss: 3.473e-02]
a-cold-wall:  17%|#6        | 509/3000 [14:22<58:53,  1.42s/it, lr: 1.0e-04 loss: 3.473e-02]
a-cold-wall:  17%|#7        | 510/3000 [14:23<58:51,  1.42s/it, lr: 1.0e-04 loss: 5.786e-01]
a-cold-wall:  17%|#7        | 510/3000 [14:23<58:51,  1.42s/it, lr: 1.0e-04 loss: 5.786e-01]
a-cold-wall:  17%|#7        | 511/3000 [14:23<39:01,  1.06it/s, lr: 1.0e-04 loss: 5.786e-01]
a-cold-wall:  17%|#7        | 511/3000 [14:23<39:01,  1.06it/s, lr: 1.0e-04 loss: 5.786e-01]
a-cold-wall:  17%|#7        | 511/3000 [14:24<39:01,  1.06it/s, lr: 1.0e-04 loss: 5.970e-01]
a-cold-wall:  17%|#7        | 511/3000 [14:24<39:01,  1.06it/s, lr: 1.0e-04 loss: 5.970e-01]
a-cold-wall:  17%|#7        | 512/3000 [14:24<43:50,  1.06s/it, lr: 1.0e-04 loss: 5.970e-01]
a-cold-wall:  17%|#7        | 512/3000 [14:24<43:50,  1.06s/it, lr: 1.0e-04 loss: 5.970e-01]
a-cold-wall:  17%|#7        | 512/3000 [14:26<43:50,  1.06s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  17%|#7        | 512/3000 [14:26<43:50,  1.06s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  17%|#7        | 513/3000 [14:26<49:19,  1.19s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  17%|#7        | 513/3000 [14:26<49:19,  1.19s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  17%|#7        | 513/3000 [14:27<49:19,  1.19s/it, lr: 1.0e-04 loss: 4.362e-01]
a-cold-wall:  17%|#7        | 513/3000 [14:27<49:19,  1.19s/it, lr: 1.0e-04 loss: 4.362e-01]
a-cold-wall:  17%|#7        | 514/3000 [14:27<51:49,  1.25s/it, lr: 1.0e-04 loss: 4.362e-01]
a-cold-wall:  17%|#7        | 514/3000 [14:27<51:49,  1.25s/it, lr: 1.0e-04 loss: 4.362e-01]
a-cold-wall:  17%|#7        | 514/3000 [14:29<51:49,  1.25s/it, lr: 1.0e-04 loss: 6.389e-01]
a-cold-wall:  17%|#7        | 514/3000 [14:29<51:49,  1.25s/it, lr: 1.0e-04 loss: 6.389e-01]
a-cold-wall:  17%|#7        | 515/3000 [14:29<53:40,  1.30s/it, lr: 1.0e-04 loss: 6.389e-01]
a-cold-wall:  17%|#7        | 515/3000 [14:29<53:40,  1.30s/it, lr: 1.0e-04 loss: 6.389e-01]
a-cold-wall:  17%|#7        | 515/3000 [14:30<53:40,  1.30s/it, lr: 1.0e-04 loss: 2.317e-01]
a-cold-wall:  17%|#7        | 515/3000 [14:30<53:40,  1.30s/it, lr: 1.0e-04 loss: 2.317e-01]
a-cold-wall:  17%|#7        | 516/3000 [14:30<55:03,  1.33s/it, lr: 1.0e-04 loss: 2.317e-01]
a-cold-wall:  17%|#7        | 516/3000 [14:30<55:03,  1.33s/it, lr: 1.0e-04 loss: 2.317e-01]
a-cold-wall:  17%|#7        | 516/3000 [14:32<55:03,  1.33s/it, lr: 1.0e-04 loss: 8.751e-01]
a-cold-wall:  17%|#7        | 516/3000 [14:32<55:03,  1.33s/it, lr: 1.0e-04 loss: 8.751e-01]
a-cold-wall:  17%|#7        | 517/3000 [14:32<56:15,  1.36s/it, lr: 1.0e-04 loss: 8.751e-01]
a-cold-wall:  17%|#7        | 517/3000 [14:32<56:15,  1.36s/it, lr: 1.0e-04 loss: 8.751e-01]
a-cold-wall:  17%|#7        | 517/3000 [14:32<56:15,  1.36s/it, lr: 1.0e-04 loss: 4.732e-01]
a-cold-wall:  17%|#7        | 517/3000 [14:32<56:15,  1.36s/it, lr: 1.0e-04 loss: 4.732e-01]
a-cold-wall:  17%|#7        | 518/3000 [14:32<48:41,  1.18s/it, lr: 1.0e-04 loss: 4.732e-01]
a-cold-wall:  17%|#7        | 518/3000 [14:32<48:41,  1.18s/it, lr: 1.0e-04 loss: 4.732e-01]
a-cold-wall:  17%|#7        | 518/3000 [14:33<48:41,  1.18s/it, lr: 1.0e-04 loss: 5.833e-02]
a-cold-wall:  17%|#7        | 518/3000 [14:33<48:41,  1.18s/it, lr: 1.0e-04 loss: 5.833e-02]
a-cold-wall:  17%|#7        | 519/3000 [14:33<43:24,  1.05s/it, lr: 1.0e-04 loss: 5.833e-02]
a-cold-wall:  17%|#7        | 519/3000 [14:33<43:24,  1.05s/it, lr: 1.0e-04 loss: 5.833e-02]
a-cold-wall:  17%|#7        | 519/3000 [14:34<43:24,  1.05s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  17%|#7        | 519/3000 [14:34<43:24,  1.05s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  17%|#7        | 520/3000 [14:36<43:23,  1.05s/it, lr: 1.0e-04 loss: 6.537e-01]
a-cold-wall:  17%|#7        | 520/3000 [14:36<43:23,  1.05s/it, lr: 1.0e-04 loss: 6.537e-01]
a-cold-wall:  17%|#7        | 521/3000 [14:36<36:47,  1.12it/s, lr: 1.0e-04 loss: 6.537e-01]
a-cold-wall:  17%|#7        | 521/3000 [14:36<36:47,  1.12it/s, lr: 1.0e-04 loss: 6.537e-01]
a-cold-wall:  17%|#7        | 521/3000 [14:39<36:47,  1.12it/s, lr: 1.0e-04 loss: 7.422e-01]
a-cold-wall:  17%|#7        | 521/3000 [14:39<36:47,  1.12it/s, lr: 1.0e-04 loss: 7.422e-01]
a-cold-wall:  17%|#7        | 522/3000 [14:39<56:32,  1.37s/it, lr: 1.0e-04 loss: 7.422e-01]
a-cold-wall:  17%|#7        | 522/3000 [14:39<56:32,  1.37s/it, lr: 1.0e-04 loss: 7.422e-01]
a-cold-wall:  17%|#7        | 522/3000 [14:39<56:32,  1.37s/it, lr: 1.0e-04 loss: 2.067e-01]
a-cold-wall:  17%|#7        | 522/3000 [14:39<56:32,  1.37s/it, lr: 1.0e-04 loss: 2.067e-01]
a-cold-wall:  17%|#7        | 523/3000 [14:39<49:41,  1.20s/it, lr: 1.0e-04 loss: 2.067e-01]
a-cold-wall:  17%|#7        | 523/3000 [14:39<49:41,  1.20s/it, lr: 1.0e-04 loss: 2.067e-01]
a-cold-wall:  17%|#7        | 523/3000 [14:42<49:41,  1.20s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  17%|#7        | 523/3000 [14:42<49:41,  1.20s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  17%|#7        | 524/3000 [14:42<1:07:59,  1.65s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  17%|#7        | 524/3000 [14:42<1:07:59,  1.65s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  17%|#7        | 524/3000 [14:44<1:07:59,  1.65s/it, lr: 1.0e-04 loss: 4.327e-02]
a-cold-wall:  17%|#7        | 524/3000 [14:44<1:07:59,  1.65s/it, lr: 1.0e-04 loss: 4.327e-02]
a-cold-wall:  18%|#7        | 525/3000 [14:44<1:05:51,  1.60s/it, lr: 1.0e-04 loss: 4.327e-02]
a-cold-wall:  18%|#7        | 525/3000 [14:44<1:05:51,  1.60s/it, lr: 1.0e-04 loss: 4.327e-02]
a-cold-wall:  18%|#7        | 525/3000 [14:47<1:05:51,  1.60s/it, lr: 1.0e-04 loss: 1.306e-01]
a-cold-wall:  18%|#7        | 525/3000 [14:47<1:05:51,  1.60s/it, lr: 1.0e-04 loss: 1.306e-01]
a-cold-wall:  18%|#7        | 526/3000 [14:47<1:20:19,  1.95s/it, lr: 1.0e-04 loss: 1.306e-01]
a-cold-wall:  18%|#7        | 526/3000 [14:47<1:20:19,  1.95s/it, lr: 1.0e-04 loss: 1.306e-01]
a-cold-wall:  18%|#7        | 526/3000 [14:50<1:20:19,  1.95s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  18%|#7        | 526/3000 [14:50<1:20:19,  1.95s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  18%|#7        | 527/3000 [14:50<1:33:29,  2.27s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  18%|#7        | 527/3000 [14:50<1:33:29,  2.27s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  18%|#7        | 527/3000 [14:53<1:33:29,  2.27s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  18%|#7        | 527/3000 [14:53<1:33:29,  2.27s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  18%|#7        | 528/3000 [14:53<1:40:28,  2.44s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  18%|#7        | 528/3000 [14:53<1:40:28,  2.44s/it, lr: 1.0e-04 loss: 1.253e-01]
a-cold-wall:  18%|#7        | 528/3000 [14:54<1:40:28,  2.44s/it, lr: 1.0e-04 loss: 4.447e-01]
a-cold-wall:  18%|#7        | 528/3000 [14:54<1:40:28,  2.44s/it, lr: 1.0e-04 loss: 4.447e-01]
a-cold-wall:  18%|#7        | 529/3000 [14:54<1:19:52,  1.94s/it, lr: 1.0e-04 loss: 4.447e-01]
a-cold-wall:  18%|#7        | 529/3000 [14:54<1:19:52,  1.94s/it, lr: 1.0e-04 loss: 4.447e-01]
a-cold-wall:  18%|#7        | 529/3000 [14:56<1:19:52,  1.94s/it, lr: 1.0e-04 loss: 4.880e-01]
a-cold-wall:  18%|#7        | 529/3000 [14:56<1:19:52,  1.94s/it, lr: 1.0e-04 loss: 4.880e-01]
a-cold-wall:  18%|#7        | 530/3000 [14:59<1:19:50,  1.94s/it, lr: 1.0e-04 loss: 6.330e-01]
a-cold-wall:  18%|#7        | 530/3000 [14:59<1:19:50,  1.94s/it, lr: 1.0e-04 loss: 6.330e-01]
a-cold-wall:  18%|#7        | 531/3000 [14:59<1:10:10,  1.71s/it, lr: 1.0e-04 loss: 6.330e-01]
a-cold-wall:  18%|#7        | 531/3000 [14:59<1:10:10,  1.71s/it, lr: 1.0e-04 loss: 6.330e-01]
a-cold-wall:  18%|#7        | 531/3000 [15:02<1:10:10,  1.71s/it, lr: 1.0e-04 loss: 4.560e-02]
a-cold-wall:  18%|#7        | 531/3000 [15:02<1:10:10,  1.71s/it, lr: 1.0e-04 loss: 4.560e-02]
a-cold-wall:  18%|#7        | 532/3000 [15:02<1:21:46,  1.99s/it, lr: 1.0e-04 loss: 4.560e-02]
a-cold-wall:  18%|#7        | 532/3000 [15:02<1:21:46,  1.99s/it, lr: 1.0e-04 loss: 4.560e-02]
a-cold-wall:  18%|#7        | 532/3000 [15:03<1:21:46,  1.99s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  18%|#7        | 532/3000 [15:03<1:21:46,  1.99s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  18%|#7        | 533/3000 [15:03<1:08:19,  1.66s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  18%|#7        | 533/3000 [15:03<1:08:19,  1.66s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  18%|#7        | 533/3000 [15:06<1:08:19,  1.66s/it, lr: 1.0e-04 loss: 2.877e-01]
a-cold-wall:  18%|#7        | 533/3000 [15:06<1:08:19,  1.66s/it, lr: 1.0e-04 loss: 2.877e-01]
a-cold-wall:  18%|#7        | 534/3000 [15:06<1:21:55,  1.99s/it, lr: 1.0e-04 loss: 2.877e-01]
a-cold-wall:  18%|#7        | 534/3000 [15:06<1:21:55,  1.99s/it, lr: 1.0e-04 loss: 2.877e-01]
a-cold-wall:  18%|#7        | 534/3000 [15:09<1:21:55,  1.99s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  18%|#7        | 534/3000 [15:09<1:21:55,  1.99s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  18%|#7        | 535/3000 [15:09<1:32:13,  2.24s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  18%|#7        | 535/3000 [15:09<1:32:13,  2.24s/it, lr: 1.0e-04 loss: 2.807e-01]
a-cold-wall:  18%|#7        | 535/3000 [15:12<1:32:13,  2.24s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#7        | 535/3000 [15:12<1:32:13,  2.24s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#7        | 536/3000 [15:12<1:39:53,  2.43s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#7        | 536/3000 [15:12<1:39:53,  2.43s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#7        | 536/3000 [15:12<1:39:53,  2.43s/it, lr: 1.0e-04 loss: 2.252e-01]
a-cold-wall:  18%|#7        | 536/3000 [15:12<1:39:53,  2.43s/it, lr: 1.0e-04 loss: 2.252e-01]
a-cold-wall:  18%|#7        | 537/3000 [15:12<1:19:56,  1.95s/it, lr: 1.0e-04 loss: 2.252e-01]
a-cold-wall:  18%|#7        | 537/3000 [15:12<1:19:56,  1.95s/it, lr: 1.0e-04 loss: 2.252e-01]
a-cold-wall:  18%|#7        | 537/3000 [15:14<1:19:56,  1.95s/it, lr: 1.0e-04 loss: 1.926e-01]
a-cold-wall:  18%|#7        | 537/3000 [15:14<1:19:56,  1.95s/it, lr: 1.0e-04 loss: 1.926e-01]
a-cold-wall:  18%|#7        | 538/3000 [15:14<1:13:34,  1.79s/it, lr: 1.0e-04 loss: 1.926e-01]
a-cold-wall:  18%|#7        | 538/3000 [15:14<1:13:34,  1.79s/it, lr: 1.0e-04 loss: 1.926e-01]
a-cold-wall:  18%|#7        | 538/3000 [15:15<1:13:34,  1.79s/it, lr: 1.0e-04 loss: 1.546e-02]
a-cold-wall:  18%|#7        | 538/3000 [15:15<1:13:34,  1.79s/it, lr: 1.0e-04 loss: 1.546e-02]
a-cold-wall:  18%|#7        | 539/3000 [15:15<1:09:11,  1.69s/it, lr: 1.0e-04 loss: 1.546e-02]
a-cold-wall:  18%|#7        | 539/3000 [15:15<1:09:11,  1.69s/it, lr: 1.0e-04 loss: 1.546e-02]
a-cold-wall:  18%|#7        | 539/3000 [15:16<1:09:11,  1.69s/it, lr: 1.0e-04 loss: 4.058e-01]
a-cold-wall:  18%|#7        | 539/3000 [15:16<1:09:11,  1.69s/it, lr: 1.0e-04 loss: 4.058e-01]
a-cold-wall:  18%|#8        | 540/3000 [15:19<1:09:09,  1.69s/it, lr: 1.0e-04 loss: 2.340e-01]
a-cold-wall:  18%|#8        | 540/3000 [15:19<1:09:09,  1.69s/it, lr: 1.0e-04 loss: 2.340e-01]
a-cold-wall:  18%|#8        | 541/3000 [15:19<1:05:42,  1.60s/it, lr: 1.0e-04 loss: 2.340e-01]
a-cold-wall:  18%|#8        | 541/3000 [15:19<1:05:42,  1.60s/it, lr: 1.0e-04 loss: 2.340e-01]
a-cold-wall:  18%|#8        | 541/3000 [15:20<1:05:42,  1.60s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  18%|#8        | 541/3000 [15:20<1:05:42,  1.60s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  18%|#8        | 542/3000 [15:20<57:06,  1.39s/it, lr: 1.0e-04 loss: 3.282e-01]  
a-cold-wall:  18%|#8        | 542/3000 [15:20<57:06,  1.39s/it, lr: 1.0e-04 loss: 3.282e-01]  
a-cold-wall:  18%|#8        | 542/3000 [15:20<57:06,  1.39s/it, lr: 1.0e-04 loss: 6.147e-01]
a-cold-wall:  18%|#8        | 542/3000 [15:20<57:06,  1.39s/it, lr: 1.0e-04 loss: 6.147e-01]
a-cold-wall:  18%|#8        | 543/3000 [15:20<50:11,  1.23s/it, lr: 1.0e-04 loss: 6.147e-01]
a-cold-wall:  18%|#8        | 543/3000 [15:20<50:11,  1.23s/it, lr: 1.0e-04 loss: 6.147e-01]
a-cold-wall:  18%|#8        | 543/3000 [15:22<50:11,  1.23s/it, lr: 1.0e-04 loss: 8.652e-01]
a-cold-wall:  18%|#8        | 543/3000 [15:22<50:11,  1.23s/it, lr: 1.0e-04 loss: 8.652e-01]
a-cold-wall:  18%|#8        | 544/3000 [15:22<52:45,  1.29s/it, lr: 1.0e-04 loss: 8.652e-01]
a-cold-wall:  18%|#8        | 544/3000 [15:22<52:45,  1.29s/it, lr: 1.0e-04 loss: 8.652e-01]
a-cold-wall:  18%|#8        | 544/3000 [15:25<52:45,  1.29s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  18%|#8        | 544/3000 [15:25<52:45,  1.29s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  18%|#8        | 545/3000 [15:25<1:11:16,  1.74s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  18%|#8        | 545/3000 [15:25<1:11:16,  1.74s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  18%|#8        | 545/3000 [15:26<1:11:16,  1.74s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  18%|#8        | 545/3000 [15:26<1:11:16,  1.74s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  18%|#8        | 546/3000 [15:26<1:07:32,  1.65s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  18%|#8        | 546/3000 [15:26<1:07:32,  1.65s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  18%|#8        | 546/3000 [15:28<1:07:32,  1.65s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  18%|#8        | 546/3000 [15:28<1:07:32,  1.65s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  18%|#8        | 547/3000 [15:28<1:04:51,  1.59s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  18%|#8        | 547/3000 [15:28<1:04:51,  1.59s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  18%|#8        | 547/3000 [15:28<1:04:51,  1.59s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  18%|#8        | 547/3000 [15:28<1:04:51,  1.59s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  18%|#8        | 548/3000 [15:28<54:53,  1.34s/it, lr: 1.0e-04 loss: 5.241e-01]  
a-cold-wall:  18%|#8        | 548/3000 [15:28<54:53,  1.34s/it, lr: 1.0e-04 loss: 5.241e-01]  
a-cold-wall:  18%|#8        | 548/3000 [15:31<54:53,  1.34s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  18%|#8        | 548/3000 [15:31<54:53,  1.34s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  18%|#8        | 549/3000 [15:31<1:13:38,  1.80s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  18%|#8        | 549/3000 [15:31<1:13:38,  1.80s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  18%|#8        | 549/3000 [15:32<1:13:38,  1.80s/it, lr: 1.0e-04 loss: 4.800e-01]
a-cold-wall:  18%|#8        | 549/3000 [15:32<1:13:38,  1.80s/it, lr: 1.0e-04 loss: 4.800e-01]
a-cold-wall:  18%|#8        | 550/3000 [15:35<1:13:37,  1.80s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  18%|#8        | 550/3000 [15:35<1:13:37,  1.80s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  18%|#8        | 551/3000 [15:35<1:06:38,  1.63s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  18%|#8        | 551/3000 [15:35<1:06:38,  1.63s/it, lr: 1.0e-04 loss: 6.887e-01]
a-cold-wall:  18%|#8        | 551/3000 [15:36<1:06:38,  1.63s/it, lr: 1.0e-04 loss: 2.860e-01]
a-cold-wall:  18%|#8        | 551/3000 [15:36<1:06:38,  1.63s/it, lr: 1.0e-04 loss: 2.860e-01]
a-cold-wall:  18%|#8        | 552/3000 [15:36<57:45,  1.42s/it, lr: 1.0e-04 loss: 2.860e-01]  
a-cold-wall:  18%|#8        | 552/3000 [15:36<57:45,  1.42s/it, lr: 1.0e-04 loss: 2.860e-01]  
a-cold-wall:  18%|#8        | 552/3000 [15:39<57:45,  1.42s/it, lr: 1.0e-04 loss: 3.386e-01]
a-cold-wall:  18%|#8        | 552/3000 [15:39<57:45,  1.42s/it, lr: 1.0e-04 loss: 3.386e-01]
a-cold-wall:  18%|#8        | 553/3000 [15:39<1:13:00,  1.79s/it, lr: 1.0e-04 loss: 3.386e-01]
a-cold-wall:  18%|#8        | 553/3000 [15:39<1:13:00,  1.79s/it, lr: 1.0e-04 loss: 3.386e-01]
a-cold-wall:  18%|#8        | 553/3000 [15:40<1:13:00,  1.79s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#8        | 553/3000 [15:40<1:13:00,  1.79s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#8        | 554/3000 [15:40<1:04:01,  1.57s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#8        | 554/3000 [15:40<1:04:01,  1.57s/it, lr: 1.0e-04 loss: 1.655e-01]
a-cold-wall:  18%|#8        | 554/3000 [15:40<1:04:01,  1.57s/it, lr: 1.0e-04 loss: 6.026e-01]
a-cold-wall:  18%|#8        | 554/3000 [15:40<1:04:01,  1.57s/it, lr: 1.0e-04 loss: 6.026e-01]
a-cold-wall:  18%|#8        | 555/3000 [15:40<54:37,  1.34s/it, lr: 1.0e-04 loss: 6.026e-01]  
a-cold-wall:  18%|#8        | 555/3000 [15:40<54:37,  1.34s/it, lr: 1.0e-04 loss: 6.026e-01]  
a-cold-wall:  18%|#8        | 555/3000 [15:43<54:37,  1.34s/it, lr: 1.0e-04 loss: 1.708e-01]
a-cold-wall:  18%|#8        | 555/3000 [15:43<54:37,  1.34s/it, lr: 1.0e-04 loss: 1.708e-01]
a-cold-wall:  19%|#8        | 556/3000 [15:43<1:12:30,  1.78s/it, lr: 1.0e-04 loss: 1.708e-01]
a-cold-wall:  19%|#8        | 556/3000 [15:43<1:12:30,  1.78s/it, lr: 1.0e-04 loss: 1.708e-01]
a-cold-wall:  19%|#8        | 556/3000 [15:45<1:12:30,  1.78s/it, lr: 1.0e-04 loss: 2.364e-01]
a-cold-wall:  19%|#8        | 556/3000 [15:45<1:12:30,  1.78s/it, lr: 1.0e-04 loss: 2.364e-01]
a-cold-wall:  19%|#8        | 557/3000 [15:45<1:08:21,  1.68s/it, lr: 1.0e-04 loss: 2.364e-01]
a-cold-wall:  19%|#8        | 557/3000 [15:45<1:08:21,  1.68s/it, lr: 1.0e-04 loss: 2.364e-01]
a-cold-wall:  19%|#8        | 557/3000 [15:46<1:08:21,  1.68s/it, lr: 1.0e-04 loss: 5.637e-01]
a-cold-wall:  19%|#8        | 557/3000 [15:46<1:08:21,  1.68s/it, lr: 1.0e-04 loss: 5.637e-01]
a-cold-wall:  19%|#8        | 558/3000 [15:46<1:05:19,  1.61s/it, lr: 1.0e-04 loss: 5.637e-01]
a-cold-wall:  19%|#8        | 558/3000 [15:46<1:05:19,  1.61s/it, lr: 1.0e-04 loss: 5.637e-01]
a-cold-wall:  19%|#8        | 558/3000 [15:47<1:05:19,  1.61s/it, lr: 1.0e-04 loss: 2.594e-01]
a-cold-wall:  19%|#8        | 558/3000 [15:47<1:05:19,  1.61s/it, lr: 1.0e-04 loss: 2.594e-01]
a-cold-wall:  19%|#8        | 559/3000 [15:47<1:03:05,  1.55s/it, lr: 1.0e-04 loss: 2.594e-01]
a-cold-wall:  19%|#8        | 559/3000 [15:47<1:03:05,  1.55s/it, lr: 1.0e-04 loss: 2.594e-01]
a-cold-wall:  19%|#8        | 559/3000 [15:49<1:03:05,  1.55s/it, lr: 1.0e-04 loss: 6.056e-02]
a-cold-wall:  19%|#8        | 559/3000 [15:49<1:03:05,  1.55s/it, lr: 1.0e-04 loss: 6.056e-02]
a-cold-wall:  19%|#8        | 560/3000 [15:52<1:03:04,  1.55s/it, lr: 1.0e-04 loss: 6.735e-01]
a-cold-wall:  19%|#8        | 560/3000 [15:52<1:03:04,  1.55s/it, lr: 1.0e-04 loss: 6.735e-01]
a-cold-wall:  19%|#8        | 561/3000 [15:52<1:00:53,  1.50s/it, lr: 1.0e-04 loss: 6.735e-01]
a-cold-wall:  19%|#8        | 561/3000 [15:52<1:00:53,  1.50s/it, lr: 1.0e-04 loss: 6.735e-01]
a-cold-wall:  19%|#8        | 561/3000 [15:53<1:00:53,  1.50s/it, lr: 1.0e-04 loss: 4.142e-01]
a-cold-wall:  19%|#8        | 561/3000 [15:53<1:00:53,  1.50s/it, lr: 1.0e-04 loss: 4.142e-01]
a-cold-wall:  19%|#8        | 562/3000 [15:53<1:00:04,  1.48s/it, lr: 1.0e-04 loss: 4.142e-01]
a-cold-wall:  19%|#8        | 562/3000 [15:53<1:00:04,  1.48s/it, lr: 1.0e-04 loss: 4.142e-01]
a-cold-wall:  19%|#8        | 562/3000 [15:56<1:00:04,  1.48s/it, lr: 1.0e-04 loss: 6.824e-01]
a-cold-wall:  19%|#8        | 562/3000 [15:56<1:00:04,  1.48s/it, lr: 1.0e-04 loss: 6.824e-01]
a-cold-wall:  19%|#8        | 563/3000 [15:56<1:14:44,  1.84s/it, lr: 1.0e-04 loss: 6.824e-01]
a-cold-wall:  19%|#8        | 563/3000 [15:56<1:14:44,  1.84s/it, lr: 1.0e-04 loss: 6.824e-01]
a-cold-wall:  19%|#8        | 563/3000 [15:57<1:14:44,  1.84s/it, lr: 1.0e-04 loss: 4.364e-02]
a-cold-wall:  19%|#8        | 563/3000 [15:57<1:14:44,  1.84s/it, lr: 1.0e-04 loss: 4.364e-02]
a-cold-wall:  19%|#8        | 564/3000 [15:57<1:02:52,  1.55s/it, lr: 1.0e-04 loss: 4.364e-02]
a-cold-wall:  19%|#8        | 564/3000 [15:57<1:02:52,  1.55s/it, lr: 1.0e-04 loss: 4.364e-02]
a-cold-wall:  19%|#8        | 564/3000 [16:00<1:02:52,  1.55s/it, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  19%|#8        | 564/3000 [16:00<1:02:52,  1.55s/it, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  19%|#8        | 565/3000 [16:00<1:18:21,  1.93s/it, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  19%|#8        | 565/3000 [16:00<1:18:21,  1.93s/it, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  19%|#8        | 565/3000 [16:03<1:18:21,  1.93s/it, lr: 1.0e-04 loss: 4.368e-01]
a-cold-wall:  19%|#8        | 565/3000 [16:03<1:18:21,  1.93s/it, lr: 1.0e-04 loss: 4.368e-01]
a-cold-wall:  19%|#8        | 566/3000 [16:03<1:29:09,  2.20s/it, lr: 1.0e-04 loss: 4.368e-01]
a-cold-wall:  19%|#8        | 566/3000 [16:03<1:29:09,  2.20s/it, lr: 1.0e-04 loss: 4.368e-01]
a-cold-wall:  19%|#8        | 566/3000 [16:04<1:29:09,  2.20s/it, lr: 1.0e-04 loss: 4.952e-01]
a-cold-wall:  19%|#8        | 566/3000 [16:04<1:29:09,  2.20s/it, lr: 1.0e-04 loss: 4.952e-01]
a-cold-wall:  19%|#8        | 567/3000 [16:04<1:14:48,  1.84s/it, lr: 1.0e-04 loss: 4.952e-01]
a-cold-wall:  19%|#8        | 567/3000 [16:04<1:14:48,  1.84s/it, lr: 1.0e-04 loss: 4.952e-01]
a-cold-wall:  19%|#8        | 567/3000 [16:04<1:14:48,  1.84s/it, lr: 1.0e-04 loss: 3.675e-02]
a-cold-wall:  19%|#8        | 567/3000 [16:04<1:14:48,  1.84s/it, lr: 1.0e-04 loss: 3.675e-02]
a-cold-wall:  19%|#8        | 568/3000 [16:04<1:01:48,  1.52s/it, lr: 1.0e-04 loss: 3.675e-02]
a-cold-wall:  19%|#8        | 568/3000 [16:04<1:01:48,  1.52s/it, lr: 1.0e-04 loss: 3.675e-02]
a-cold-wall:  19%|#8        | 568/3000 [16:06<1:01:48,  1.52s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  19%|#8        | 568/3000 [16:06<1:01:48,  1.52s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  19%|#8        | 569/3000 [16:06<1:00:28,  1.49s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  19%|#8        | 569/3000 [16:06<1:00:28,  1.49s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  19%|#8        | 569/3000 [16:06<1:00:28,  1.49s/it, lr: 1.0e-04 loss: 5.904e-01]
a-cold-wall:  19%|#8        | 569/3000 [16:06<1:00:28,  1.49s/it, lr: 1.0e-04 loss: 5.904e-01]
a-cold-wall:  19%|#9        | 570/3000 [16:09<1:00:26,  1.49s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  19%|#9        | 570/3000 [16:09<1:00:26,  1.49s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  19%|#9        | 571/3000 [16:09<59:15,  1.46s/it, lr: 1.0e-04 loss: 5.108e-01]  
a-cold-wall:  19%|#9        | 571/3000 [16:09<59:15,  1.46s/it, lr: 1.0e-04 loss: 5.108e-01]  
a-cold-wall:  19%|#9        | 571/3000 [16:10<59:15,  1.46s/it, lr: 1.0e-04 loss: 3.748e-01]
a-cold-wall:  19%|#9        | 571/3000 [16:10<59:15,  1.46s/it, lr: 1.0e-04 loss: 3.748e-01]
a-cold-wall:  19%|#9        | 572/3000 [16:10<52:54,  1.31s/it, lr: 1.0e-04 loss: 3.748e-01]
a-cold-wall:  19%|#9        | 572/3000 [16:10<52:54,  1.31s/it, lr: 1.0e-04 loss: 3.748e-01]
a-cold-wall:  19%|#9        | 572/3000 [16:11<52:54,  1.31s/it, lr: 1.0e-04 loss: 7.063e-01]
a-cold-wall:  19%|#9        | 572/3000 [16:11<52:54,  1.31s/it, lr: 1.0e-04 loss: 7.063e-01]
a-cold-wall:  19%|#9        | 573/3000 [16:11<46:58,  1.16s/it, lr: 1.0e-04 loss: 7.063e-01]
a-cold-wall:  19%|#9        | 573/3000 [16:11<46:58,  1.16s/it, lr: 1.0e-04 loss: 7.063e-01]
a-cold-wall:  19%|#9        | 573/3000 [16:12<46:58,  1.16s/it, lr: 1.0e-04 loss: 2.731e-01]
a-cold-wall:  19%|#9        | 573/3000 [16:12<46:58,  1.16s/it, lr: 1.0e-04 loss: 2.731e-01]
a-cold-wall:  19%|#9        | 574/3000 [16:12<50:54,  1.26s/it, lr: 1.0e-04 loss: 2.731e-01]
a-cold-wall:  19%|#9        | 574/3000 [16:12<50:54,  1.26s/it, lr: 1.0e-04 loss: 2.731e-01]
a-cold-wall:  19%|#9        | 574/3000 [16:13<50:54,  1.26s/it, lr: 1.0e-04 loss: 6.130e-01]
a-cold-wall:  19%|#9        | 574/3000 [16:13<50:54,  1.26s/it, lr: 1.0e-04 loss: 6.130e-01]
a-cold-wall:  19%|#9        | 575/3000 [16:13<44:58,  1.11s/it, lr: 1.0e-04 loss: 6.130e-01]
a-cold-wall:  19%|#9        | 575/3000 [16:13<44:58,  1.11s/it, lr: 1.0e-04 loss: 6.130e-01]
a-cold-wall:  19%|#9        | 575/3000 [16:14<44:58,  1.11s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  19%|#9        | 575/3000 [16:14<44:58,  1.11s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  19%|#9        | 576/3000 [16:14<40:50,  1.01s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  19%|#9        | 576/3000 [16:14<40:50,  1.01s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  19%|#9        | 576/3000 [16:15<40:50,  1.01s/it, lr: 1.0e-04 loss: 5.668e-01]
a-cold-wall:  19%|#9        | 576/3000 [16:15<40:50,  1.01s/it, lr: 1.0e-04 loss: 5.668e-01]
a-cold-wall:  19%|#9        | 577/3000 [16:15<45:31,  1.13s/it, lr: 1.0e-04 loss: 5.668e-01]
a-cold-wall:  19%|#9        | 577/3000 [16:15<45:31,  1.13s/it, lr: 1.0e-04 loss: 5.668e-01]
a-cold-wall:  19%|#9        | 577/3000 [16:16<45:31,  1.13s/it, lr: 1.0e-04 loss: 2.187e-01]
a-cold-wall:  19%|#9        | 577/3000 [16:16<45:31,  1.13s/it, lr: 1.0e-04 loss: 2.187e-01]
a-cold-wall:  19%|#9        | 578/3000 [16:16<41:02,  1.02s/it, lr: 1.0e-04 loss: 2.187e-01]
a-cold-wall:  19%|#9        | 578/3000 [16:16<41:02,  1.02s/it, lr: 1.0e-04 loss: 2.187e-01]
a-cold-wall:  19%|#9        | 578/3000 [16:17<41:02,  1.02s/it, lr: 1.0e-04 loss: 7.198e-01]
a-cold-wall:  19%|#9        | 578/3000 [16:17<41:02,  1.02s/it, lr: 1.0e-04 loss: 7.198e-01]
a-cold-wall:  19%|#9        | 579/3000 [16:17<45:56,  1.14s/it, lr: 1.0e-04 loss: 7.198e-01]
a-cold-wall:  19%|#9        | 579/3000 [16:17<45:56,  1.14s/it, lr: 1.0e-04 loss: 7.198e-01]
a-cold-wall:  19%|#9        | 579/3000 [16:18<45:56,  1.14s/it, lr: 1.0e-04 loss: 2.191e-01]
a-cold-wall:  19%|#9        | 579/3000 [16:18<45:56,  1.14s/it, lr: 1.0e-04 loss: 2.191e-01]
a-cold-wall:  19%|#9        | 580/3000 [16:19<45:54,  1.14s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  19%|#9        | 580/3000 [16:19<45:54,  1.14s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  19%|#9        | 581/3000 [16:19<33:55,  1.19it/s, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  19%|#9        | 581/3000 [16:19<33:55,  1.19it/s, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  19%|#9        | 581/3000 [16:22<33:55,  1.19it/s, lr: 1.0e-04 loss: 4.795e-01]
a-cold-wall:  19%|#9        | 581/3000 [16:22<33:55,  1.19it/s, lr: 1.0e-04 loss: 4.795e-01]
a-cold-wall:  19%|#9        | 582/3000 [16:22<53:54,  1.34s/it, lr: 1.0e-04 loss: 4.795e-01]
a-cold-wall:  19%|#9        | 582/3000 [16:22<53:54,  1.34s/it, lr: 1.0e-04 loss: 4.795e-01]
a-cold-wall:  19%|#9        | 582/3000 [16:23<53:54,  1.34s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  19%|#9        | 582/3000 [16:23<53:54,  1.34s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  19%|#9        | 583/3000 [16:23<54:40,  1.36s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  19%|#9        | 583/3000 [16:23<54:40,  1.36s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  19%|#9        | 583/3000 [16:25<54:40,  1.36s/it, lr: 1.0e-04 loss: 5.938e-01]
a-cold-wall:  19%|#9        | 583/3000 [16:25<54:40,  1.36s/it, lr: 1.0e-04 loss: 5.938e-01]
a-cold-wall:  19%|#9        | 584/3000 [16:25<55:05,  1.37s/it, lr: 1.0e-04 loss: 5.938e-01]
a-cold-wall:  19%|#9        | 584/3000 [16:25<55:05,  1.37s/it, lr: 1.0e-04 loss: 5.938e-01]
a-cold-wall:  19%|#9        | 584/3000 [16:28<55:05,  1.37s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  19%|#9        | 584/3000 [16:28<55:05,  1.37s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  20%|#9        | 585/3000 [16:28<1:11:46,  1.78s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  20%|#9        | 585/3000 [16:28<1:11:46,  1.78s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  20%|#9        | 585/3000 [16:29<1:11:46,  1.78s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  20%|#9        | 585/3000 [16:29<1:11:46,  1.78s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  20%|#9        | 586/3000 [16:29<1:07:30,  1.68s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  20%|#9        | 586/3000 [16:29<1:07:30,  1.68s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  20%|#9        | 586/3000 [16:30<1:07:30,  1.68s/it, lr: 1.0e-04 loss: 5.558e-01]
a-cold-wall:  20%|#9        | 586/3000 [16:30<1:07:30,  1.68s/it, lr: 1.0e-04 loss: 5.558e-01]
a-cold-wall:  20%|#9        | 587/3000 [16:30<56:31,  1.41s/it, lr: 1.0e-04 loss: 5.558e-01]  
a-cold-wall:  20%|#9        | 587/3000 [16:30<56:31,  1.41s/it, lr: 1.0e-04 loss: 5.558e-01]  
a-cold-wall:  20%|#9        | 587/3000 [16:31<56:31,  1.41s/it, lr: 1.0e-04 loss: 6.912e-01]
a-cold-wall:  20%|#9        | 587/3000 [16:31<56:31,  1.41s/it, lr: 1.0e-04 loss: 6.912e-01]
a-cold-wall:  20%|#9        | 588/3000 [16:31<56:24,  1.40s/it, lr: 1.0e-04 loss: 6.912e-01]
a-cold-wall:  20%|#9        | 588/3000 [16:31<56:24,  1.40s/it, lr: 1.0e-04 loss: 6.912e-01]
a-cold-wall:  20%|#9        | 588/3000 [16:33<56:24,  1.40s/it, lr: 1.0e-04 loss: 1.547e-01]
a-cold-wall:  20%|#9        | 588/3000 [16:33<56:24,  1.40s/it, lr: 1.0e-04 loss: 1.547e-01]
a-cold-wall:  20%|#9        | 589/3000 [16:33<56:28,  1.41s/it, lr: 1.0e-04 loss: 1.547e-01]
a-cold-wall:  20%|#9        | 589/3000 [16:33<56:28,  1.41s/it, lr: 1.0e-04 loss: 1.547e-01]
a-cold-wall:  20%|#9        | 589/3000 [16:34<56:28,  1.41s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  20%|#9        | 589/3000 [16:34<56:28,  1.41s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  20%|#9        | 590/3000 [16:35<56:27,  1.41s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  20%|#9        | 590/3000 [16:35<56:27,  1.41s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  20%|#9        | 591/3000 [16:35<43:28,  1.08s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  20%|#9        | 591/3000 [16:35<43:28,  1.08s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  20%|#9        | 591/3000 [16:36<43:28,  1.08s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  20%|#9        | 591/3000 [16:36<43:28,  1.08s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  20%|#9        | 592/3000 [16:36<40:00,  1.00it/s, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  20%|#9        | 592/3000 [16:36<40:00,  1.00it/s, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  20%|#9        | 592/3000 [16:39<40:00,  1.00it/s, lr: 1.0e-04 loss: 2.236e-02]
a-cold-wall:  20%|#9        | 592/3000 [16:39<40:00,  1.00it/s, lr: 1.0e-04 loss: 2.236e-02]
a-cold-wall:  20%|#9        | 593/3000 [16:39<59:21,  1.48s/it, lr: 1.0e-04 loss: 2.236e-02]
a-cold-wall:  20%|#9        | 593/3000 [16:39<59:21,  1.48s/it, lr: 1.0e-04 loss: 2.236e-02]
a-cold-wall:  20%|#9        | 593/3000 [16:42<59:21,  1.48s/it, lr: 1.0e-04 loss: 3.936e-01]
a-cold-wall:  20%|#9        | 593/3000 [16:42<59:21,  1.48s/it, lr: 1.0e-04 loss: 3.936e-01]
a-cold-wall:  20%|#9        | 594/3000 [16:42<1:13:58,  1.84s/it, lr: 1.0e-04 loss: 3.936e-01]
a-cold-wall:  20%|#9        | 594/3000 [16:42<1:13:58,  1.84s/it, lr: 1.0e-04 loss: 3.936e-01]
a-cold-wall:  20%|#9        | 594/3000 [16:43<1:13:58,  1.84s/it, lr: 1.0e-04 loss: 4.081e-01]
a-cold-wall:  20%|#9        | 594/3000 [16:43<1:13:58,  1.84s/it, lr: 1.0e-04 loss: 4.081e-01]
a-cold-wall:  20%|#9        | 595/3000 [16:43<1:10:46,  1.77s/it, lr: 1.0e-04 loss: 4.081e-01]
a-cold-wall:  20%|#9        | 595/3000 [16:43<1:10:46,  1.77s/it, lr: 1.0e-04 loss: 4.081e-01]
a-cold-wall:  20%|#9        | 595/3000 [16:46<1:10:46,  1.77s/it, lr: 1.0e-04 loss: 8.109e-02]
a-cold-wall:  20%|#9        | 595/3000 [16:46<1:10:46,  1.77s/it, lr: 1.0e-04 loss: 8.109e-02]
a-cold-wall:  20%|#9        | 596/3000 [16:46<1:23:16,  2.08s/it, lr: 1.0e-04 loss: 8.109e-02]
a-cold-wall:  20%|#9        | 596/3000 [16:46<1:23:16,  2.08s/it, lr: 1.0e-04 loss: 8.109e-02]
a-cold-wall:  20%|#9        | 596/3000 [16:47<1:23:16,  2.08s/it, lr: 1.0e-04 loss: 5.020e-01]
a-cold-wall:  20%|#9        | 596/3000 [16:47<1:23:16,  2.08s/it, lr: 1.0e-04 loss: 5.020e-01]
a-cold-wall:  20%|#9        | 597/3000 [16:47<1:10:19,  1.76s/it, lr: 1.0e-04 loss: 5.020e-01]
a-cold-wall:  20%|#9        | 597/3000 [16:47<1:10:19,  1.76s/it, lr: 1.0e-04 loss: 5.020e-01]
a-cold-wall:  20%|#9        | 597/3000 [16:50<1:10:19,  1.76s/it, lr: 1.0e-04 loss: 3.842e-01]
a-cold-wall:  20%|#9        | 597/3000 [16:50<1:10:19,  1.76s/it, lr: 1.0e-04 loss: 3.842e-01]
a-cold-wall:  20%|#9        | 598/3000 [16:50<1:22:49,  2.07s/it, lr: 1.0e-04 loss: 3.842e-01]
a-cold-wall:  20%|#9        | 598/3000 [16:50<1:22:49,  2.07s/it, lr: 1.0e-04 loss: 3.842e-01]
a-cold-wall:  20%|#9        | 598/3000 [16:53<1:22:49,  2.07s/it, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  20%|#9        | 598/3000 [16:53<1:22:49,  2.07s/it, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  20%|#9        | 599/3000 [16:53<1:32:06,  2.30s/it, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  20%|#9        | 599/3000 [16:53<1:32:06,  2.30s/it, lr: 1.0e-04 loss: 5.361e-01]
a-cold-wall:  20%|#9        | 599/3000 [16:56<1:32:06,  2.30s/it, lr: 1.0e-04 loss: 5.294e-01]
a-cold-wall:  20%|#9        | 599/3000 [16:56<1:32:06,  2.30s/it, lr: 1.0e-04 loss: 5.294e-01]
a-cold-wall:  20%|##        | 600/3000 [16:59<1:32:03,  2.30s/it, lr: 1.0e-04 loss: 4.263e-02]
a-cold-wall:  20%|##        | 600/3000 [16:59<1:32:03,  2.30s/it, lr: 1.0e-04 loss: 4.263e-02]
a-cold-wall:  20%|##        | 601/3000 [16:59<1:15:48,  1.90s/it, lr: 1.0e-04 loss: 4.263e-02]
a-cold-wall:  20%|##        | 601/3000 [16:59<1:15:48,  1.90s/it, lr: 1.0e-04 loss: 4.263e-02]
a-cold-wall:  20%|##        | 601/3000 [16:59<1:15:48,  1.90s/it, lr: 1.0e-04 loss: 1.960e-01]
a-cold-wall:  20%|##        | 601/3000 [16:59<1:15:48,  1.90s/it, lr: 1.0e-04 loss: 1.960e-01]
a-cold-wall:  20%|##        | 602/3000 [16:59<1:04:28,  1.61s/it, lr: 1.0e-04 loss: 1.960e-01]
a-cold-wall:  20%|##        | 602/3000 [16:59<1:04:28,  1.61s/it, lr: 1.0e-04 loss: 1.960e-01]
a-cold-wall:  20%|##        | 602/3000 [17:01<1:04:28,  1.61s/it, lr: 1.0e-04 loss: 5.723e-01]
a-cold-wall:  20%|##        | 602/3000 [17:01<1:04:28,  1.61s/it, lr: 1.0e-04 loss: 5.723e-01]
a-cold-wall:  20%|##        | 603/3000 [17:01<1:01:53,  1.55s/it, lr: 1.0e-04 loss: 5.723e-01]
a-cold-wall:  20%|##        | 603/3000 [17:01<1:01:53,  1.55s/it, lr: 1.0e-04 loss: 5.723e-01]
a-cold-wall:  20%|##        | 603/3000 [17:02<1:01:53,  1.55s/it, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  20%|##        | 603/3000 [17:02<1:01:53,  1.55s/it, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  20%|##        | 604/3000 [17:02<1:00:15,  1.51s/it, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  20%|##        | 604/3000 [17:02<1:00:15,  1.51s/it, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  20%|##        | 604/3000 [17:03<1:00:15,  1.51s/it, lr: 1.0e-04 loss: 7.231e-01]
a-cold-wall:  20%|##        | 604/3000 [17:03<1:00:15,  1.51s/it, lr: 1.0e-04 loss: 7.231e-01]
a-cold-wall:  20%|##        | 605/3000 [17:03<51:39,  1.29s/it, lr: 1.0e-04 loss: 7.231e-01]  
a-cold-wall:  20%|##        | 605/3000 [17:03<51:39,  1.29s/it, lr: 1.0e-04 loss: 7.231e-01]  
a-cold-wall:  20%|##        | 605/3000 [17:04<51:39,  1.29s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  20%|##        | 605/3000 [17:04<51:39,  1.29s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  20%|##        | 606/3000 [17:04<53:01,  1.33s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  20%|##        | 606/3000 [17:04<53:01,  1.33s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  20%|##        | 606/3000 [17:05<53:01,  1.33s/it, lr: 1.0e-04 loss: 2.096e-01]
a-cold-wall:  20%|##        | 606/3000 [17:05<53:01,  1.33s/it, lr: 1.0e-04 loss: 2.096e-01]
a-cold-wall:  20%|##        | 607/3000 [17:05<46:22,  1.16s/it, lr: 1.0e-04 loss: 2.096e-01]
a-cold-wall:  20%|##        | 607/3000 [17:05<46:22,  1.16s/it, lr: 1.0e-04 loss: 2.096e-01]
a-cold-wall:  20%|##        | 607/3000 [17:06<46:22,  1.16s/it, lr: 1.0e-04 loss: 2.417e-01]
a-cold-wall:  20%|##        | 607/3000 [17:06<46:22,  1.16s/it, lr: 1.0e-04 loss: 2.417e-01]
a-cold-wall:  20%|##        | 608/3000 [17:06<41:30,  1.04s/it, lr: 1.0e-04 loss: 2.417e-01]
a-cold-wall:  20%|##        | 608/3000 [17:06<41:30,  1.04s/it, lr: 1.0e-04 loss: 2.417e-01]
a-cold-wall:  20%|##        | 608/3000 [17:07<41:30,  1.04s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  20%|##        | 608/3000 [17:07<41:30,  1.04s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  20%|##        | 609/3000 [17:07<40:56,  1.03s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  20%|##        | 609/3000 [17:07<40:56,  1.03s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  20%|##        | 609/3000 [17:08<40:56,  1.03s/it, lr: 1.0e-04 loss: 9.180e-02]
a-cold-wall:  20%|##        | 609/3000 [17:08<40:56,  1.03s/it, lr: 1.0e-04 loss: 9.180e-02]
a-cold-wall:  20%|##        | 610/3000 [17:09<40:55,  1.03s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  20%|##        | 610/3000 [17:09<40:55,  1.03s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  20%|##        | 611/3000 [17:09<28:55,  1.38it/s, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  20%|##        | 611/3000 [17:09<28:55,  1.38it/s, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  20%|##        | 611/3000 [17:10<28:55,  1.38it/s, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  20%|##        | 611/3000 [17:10<28:55,  1.38it/s, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  20%|##        | 612/3000 [17:10<35:42,  1.11it/s, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  20%|##        | 612/3000 [17:10<35:42,  1.11it/s, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  20%|##        | 612/3000 [17:12<35:42,  1.11it/s, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  20%|##        | 612/3000 [17:12<35:42,  1.11it/s, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  20%|##        | 613/3000 [17:12<40:58,  1.03s/it, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  20%|##        | 613/3000 [17:12<40:58,  1.03s/it, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  20%|##        | 613/3000 [17:13<40:58,  1.03s/it, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  20%|##        | 613/3000 [17:13<40:58,  1.03s/it, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  20%|##        | 614/3000 [17:13<37:49,  1.05it/s, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  20%|##        | 614/3000 [17:13<37:49,  1.05it/s, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  20%|##        | 614/3000 [17:15<37:49,  1.05it/s, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  20%|##        | 614/3000 [17:15<37:49,  1.05it/s, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  20%|##        | 615/3000 [17:15<59:09,  1.49s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  20%|##        | 615/3000 [17:15<59:09,  1.49s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  20%|##        | 615/3000 [17:17<59:09,  1.49s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:  20%|##        | 615/3000 [17:17<59:09,  1.49s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:  21%|##        | 616/3000 [17:17<58:13,  1.47s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:  21%|##        | 616/3000 [17:17<58:13,  1.47s/it, lr: 1.0e-04 loss: 2.561e-01]
a-cold-wall:  21%|##        | 616/3000 [17:20<58:13,  1.47s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  21%|##        | 616/3000 [17:20<58:13,  1.47s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  21%|##        | 617/3000 [17:20<1:13:51,  1.86s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  21%|##        | 617/3000 [17:20<1:13:51,  1.86s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  21%|##        | 617/3000 [17:22<1:13:51,  1.86s/it, lr: 1.0e-04 loss: 3.268e-01]
a-cold-wall:  21%|##        | 617/3000 [17:22<1:13:51,  1.86s/it, lr: 1.0e-04 loss: 3.268e-01]
a-cold-wall:  21%|##        | 618/3000 [17:22<1:25:15,  2.15s/it, lr: 1.0e-04 loss: 3.268e-01]
a-cold-wall:  21%|##        | 618/3000 [17:22<1:25:15,  2.15s/it, lr: 1.0e-04 loss: 3.268e-01]
a-cold-wall:  21%|##        | 618/3000 [17:23<1:25:15,  2.15s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  21%|##        | 618/3000 [17:23<1:25:15,  2.15s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  21%|##        | 619/3000 [17:23<1:08:51,  1.74s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  21%|##        | 619/3000 [17:23<1:08:51,  1.74s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  21%|##        | 619/3000 [17:25<1:08:51,  1.74s/it, lr: 1.0e-04 loss: 2.583e-01]
a-cold-wall:  21%|##        | 619/3000 [17:25<1:08:51,  1.74s/it, lr: 1.0e-04 loss: 2.583e-01]
a-cold-wall:  21%|##        | 620/3000 [17:25<1:08:49,  1.74s/it, lr: 1.0e-04 loss: 3.745e-02]
a-cold-wall:  21%|##        | 620/3000 [17:25<1:08:49,  1.74s/it, lr: 1.0e-04 loss: 3.745e-02]
a-cold-wall:  21%|##        | 621/3000 [17:25<44:06,  1.11s/it, lr: 1.0e-04 loss: 3.745e-02]  
a-cold-wall:  21%|##        | 621/3000 [17:25<44:06,  1.11s/it, lr: 1.0e-04 loss: 3.745e-02]  
a-cold-wall:  21%|##        | 621/3000 [17:27<44:06,  1.11s/it, lr: 1.0e-04 loss: 6.789e-02]
a-cold-wall:  21%|##        | 621/3000 [17:27<44:06,  1.11s/it, lr: 1.0e-04 loss: 6.789e-02]
a-cold-wall:  21%|##        | 622/3000 [17:27<44:51,  1.13s/it, lr: 1.0e-04 loss: 6.789e-02]
a-cold-wall:  21%|##        | 622/3000 [17:27<44:51,  1.13s/it, lr: 1.0e-04 loss: 6.789e-02]
a-cold-wall:  21%|##        | 622/3000 [17:27<44:51,  1.13s/it, lr: 1.0e-04 loss: 5.175e-01]
a-cold-wall:  21%|##        | 622/3000 [17:27<44:51,  1.13s/it, lr: 1.0e-04 loss: 5.175e-01]
a-cold-wall:  21%|##        | 623/3000 [17:27<40:48,  1.03s/it, lr: 1.0e-04 loss: 5.175e-01]
a-cold-wall:  21%|##        | 623/3000 [17:27<40:48,  1.03s/it, lr: 1.0e-04 loss: 5.175e-01]
a-cold-wall:  21%|##        | 623/3000 [17:29<40:48,  1.03s/it, lr: 1.0e-04 loss: 6.050e-01]
a-cold-wall:  21%|##        | 623/3000 [17:29<40:48,  1.03s/it, lr: 1.0e-04 loss: 6.050e-01]
a-cold-wall:  21%|##        | 624/3000 [17:29<45:00,  1.14s/it, lr: 1.0e-04 loss: 6.050e-01]
a-cold-wall:  21%|##        | 624/3000 [17:29<45:00,  1.14s/it, lr: 1.0e-04 loss: 6.050e-01]
a-cold-wall:  21%|##        | 624/3000 [17:32<45:00,  1.14s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  21%|##        | 624/3000 [17:32<45:00,  1.14s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  21%|##        | 625/3000 [17:32<1:04:14,  1.62s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  21%|##        | 625/3000 [17:32<1:04:14,  1.62s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  21%|##        | 625/3000 [17:33<1:04:14,  1.62s/it, lr: 1.0e-04 loss: 3.763e-01]
a-cold-wall:  21%|##        | 625/3000 [17:33<1:04:14,  1.62s/it, lr: 1.0e-04 loss: 3.763e-01]
a-cold-wall:  21%|##        | 626/3000 [17:33<1:01:49,  1.56s/it, lr: 1.0e-04 loss: 3.763e-01]
a-cold-wall:  21%|##        | 626/3000 [17:33<1:01:49,  1.56s/it, lr: 1.0e-04 loss: 3.763e-01]
a-cold-wall:  21%|##        | 626/3000 [17:34<1:01:49,  1.56s/it, lr: 1.0e-04 loss: 4.834e-01]
a-cold-wall:  21%|##        | 626/3000 [17:34<1:01:49,  1.56s/it, lr: 1.0e-04 loss: 4.834e-01]
a-cold-wall:  21%|##        | 627/3000 [17:34<1:00:26,  1.53s/it, lr: 1.0e-04 loss: 4.834e-01]
a-cold-wall:  21%|##        | 627/3000 [17:34<1:00:26,  1.53s/it, lr: 1.0e-04 loss: 4.834e-01]
a-cold-wall:  21%|##        | 627/3000 [17:37<1:00:26,  1.53s/it, lr: 1.0e-04 loss: 1.409e-01]
a-cold-wall:  21%|##        | 627/3000 [17:37<1:00:26,  1.53s/it, lr: 1.0e-04 loss: 1.409e-01]
a-cold-wall:  21%|##        | 628/3000 [17:37<1:16:11,  1.93s/it, lr: 1.0e-04 loss: 1.409e-01]
a-cold-wall:  21%|##        | 628/3000 [17:37<1:16:11,  1.93s/it, lr: 1.0e-04 loss: 1.409e-01]
a-cold-wall:  21%|##        | 628/3000 [17:38<1:16:11,  1.93s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  21%|##        | 628/3000 [17:38<1:16:11,  1.93s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  21%|##        | 629/3000 [17:38<1:02:24,  1.58s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  21%|##        | 629/3000 [17:38<1:02:24,  1.58s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  21%|##        | 629/3000 [17:40<1:02:24,  1.58s/it, lr: 1.0e-04 loss: 6.124e-01]
a-cold-wall:  21%|##        | 629/3000 [17:40<1:02:24,  1.58s/it, lr: 1.0e-04 loss: 6.124e-01]
a-cold-wall:  21%|##1       | 630/3000 [17:43<1:02:23,  1.58s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  21%|##1       | 630/3000 [17:43<1:02:23,  1.58s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  21%|##1       | 631/3000 [17:43<1:00:27,  1.53s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  21%|##1       | 631/3000 [17:43<1:00:27,  1.53s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  21%|##1       | 631/3000 [17:46<1:00:27,  1.53s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  21%|##1       | 631/3000 [17:46<1:00:27,  1.53s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  21%|##1       | 632/3000 [17:46<1:13:44,  1.87s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  21%|##1       | 632/3000 [17:46<1:13:44,  1.87s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  21%|##1       | 632/3000 [17:47<1:13:44,  1.87s/it, lr: 1.0e-04 loss: 2.574e-01]
a-cold-wall:  21%|##1       | 632/3000 [17:47<1:13:44,  1.87s/it, lr: 1.0e-04 loss: 2.574e-01]
a-cold-wall:  21%|##1       | 633/3000 [17:47<1:02:15,  1.58s/it, lr: 1.0e-04 loss: 2.574e-01]
a-cold-wall:  21%|##1       | 633/3000 [17:47<1:02:15,  1.58s/it, lr: 1.0e-04 loss: 2.574e-01]
a-cold-wall:  21%|##1       | 633/3000 [17:47<1:02:15,  1.58s/it, lr: 1.0e-04 loss: 6.654e-01]
a-cold-wall:  21%|##1       | 633/3000 [17:47<1:02:15,  1.58s/it, lr: 1.0e-04 loss: 6.654e-01]
a-cold-wall:  21%|##1       | 634/3000 [17:47<53:36,  1.36s/it, lr: 1.0e-04 loss: 6.654e-01]  
a-cold-wall:  21%|##1       | 634/3000 [17:47<53:36,  1.36s/it, lr: 1.0e-04 loss: 6.654e-01]  
a-cold-wall:  21%|##1       | 634/3000 [17:50<53:36,  1.36s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:  21%|##1       | 634/3000 [17:50<53:36,  1.36s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:  21%|##1       | 635/3000 [17:50<1:10:18,  1.78s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:  21%|##1       | 635/3000 [17:50<1:10:18,  1.78s/it, lr: 1.0e-04 loss: 3.924e-01]
a-cold-wall:  21%|##1       | 635/3000 [17:53<1:10:18,  1.78s/it, lr: 1.0e-04 loss: 1.714e-01]
a-cold-wall:  21%|##1       | 635/3000 [17:53<1:10:18,  1.78s/it, lr: 1.0e-04 loss: 1.714e-01]
a-cold-wall:  21%|##1       | 636/3000 [17:53<1:24:28,  2.14s/it, lr: 1.0e-04 loss: 1.714e-01]
a-cold-wall:  21%|##1       | 636/3000 [17:53<1:24:28,  2.14s/it, lr: 1.0e-04 loss: 1.714e-01]
a-cold-wall:  21%|##1       | 636/3000 [17:56<1:24:28,  2.14s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  21%|##1       | 636/3000 [17:56<1:24:28,  2.14s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  21%|##1       | 637/3000 [17:56<1:33:26,  2.37s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  21%|##1       | 637/3000 [17:56<1:33:26,  2.37s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  21%|##1       | 637/3000 [17:58<1:33:26,  2.37s/it, lr: 1.0e-04 loss: 1.796e-01]
a-cold-wall:  21%|##1       | 637/3000 [17:58<1:33:26,  2.37s/it, lr: 1.0e-04 loss: 1.796e-01]
a-cold-wall:  21%|##1       | 638/3000 [17:58<1:22:34,  2.10s/it, lr: 1.0e-04 loss: 1.796e-01]
a-cold-wall:  21%|##1       | 638/3000 [17:58<1:22:34,  2.10s/it, lr: 1.0e-04 loss: 1.796e-01]
a-cold-wall:  21%|##1       | 638/3000 [17:58<1:22:34,  2.10s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  21%|##1       | 638/3000 [17:58<1:22:34,  2.10s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  21%|##1       | 639/3000 [17:58<1:06:57,  1.70s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  21%|##1       | 639/3000 [17:58<1:06:57,  1.70s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  21%|##1       | 639/3000 [17:59<1:06:57,  1.70s/it, lr: 1.0e-04 loss: 7.508e-01]
a-cold-wall:  21%|##1       | 639/3000 [17:59<1:06:57,  1.70s/it, lr: 1.0e-04 loss: 7.508e-01]
a-cold-wall:  21%|##1       | 640/3000 [18:01<1:06:55,  1.70s/it, lr: 1.0e-04 loss: 3.209e-01]
a-cold-wall:  21%|##1       | 640/3000 [18:01<1:06:55,  1.70s/it, lr: 1.0e-04 loss: 3.209e-01]
a-cold-wall:  21%|##1       | 641/3000 [18:01<49:18,  1.25s/it, lr: 1.0e-04 loss: 3.209e-01]  
a-cold-wall:  21%|##1       | 641/3000 [18:01<49:18,  1.25s/it, lr: 1.0e-04 loss: 3.209e-01]  
a-cold-wall:  21%|##1       | 641/3000 [18:01<49:18,  1.25s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  21%|##1       | 641/3000 [18:01<49:18,  1.25s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  21%|##1       | 642/3000 [18:01<44:28,  1.13s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  21%|##1       | 642/3000 [18:01<44:28,  1.13s/it, lr: 1.0e-04 loss: 6.796e-01]
a-cold-wall:  21%|##1       | 642/3000 [18:04<44:28,  1.13s/it, lr: 1.0e-04 loss: 4.400e-01]
a-cold-wall:  21%|##1       | 642/3000 [18:04<44:28,  1.13s/it, lr: 1.0e-04 loss: 4.400e-01]
a-cold-wall:  21%|##1       | 643/3000 [18:04<1:02:39,  1.59s/it, lr: 1.0e-04 loss: 4.400e-01]
a-cold-wall:  21%|##1       | 643/3000 [18:04<1:02:39,  1.59s/it, lr: 1.0e-04 loss: 4.400e-01]
a-cold-wall:  21%|##1       | 643/3000 [18:05<1:02:39,  1.59s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  21%|##1       | 643/3000 [18:05<1:02:39,  1.59s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  21%|##1       | 644/3000 [18:05<53:38,  1.37s/it, lr: 1.0e-04 loss: 1.524e-01]  
a-cold-wall:  21%|##1       | 644/3000 [18:05<53:38,  1.37s/it, lr: 1.0e-04 loss: 1.524e-01]  
a-cold-wall:  21%|##1       | 644/3000 [18:06<53:38,  1.37s/it, lr: 1.0e-04 loss: 2.159e-01]
a-cold-wall:  21%|##1       | 644/3000 [18:06<53:38,  1.37s/it, lr: 1.0e-04 loss: 2.159e-01]
a-cold-wall:  22%|##1       | 645/3000 [18:06<46:54,  1.20s/it, lr: 1.0e-04 loss: 2.159e-01]
a-cold-wall:  22%|##1       | 645/3000 [18:06<46:54,  1.20s/it, lr: 1.0e-04 loss: 2.159e-01]
a-cold-wall:  22%|##1       | 645/3000 [18:07<46:54,  1.20s/it, lr: 1.0e-04 loss: 1.596e-01]
a-cold-wall:  22%|##1       | 645/3000 [18:07<46:54,  1.20s/it, lr: 1.0e-04 loss: 1.596e-01]
a-cold-wall:  22%|##1       | 646/3000 [18:07<42:07,  1.07s/it, lr: 1.0e-04 loss: 1.596e-01]
a-cold-wall:  22%|##1       | 646/3000 [18:07<42:07,  1.07s/it, lr: 1.0e-04 loss: 1.596e-01]
a-cold-wall:  22%|##1       | 646/3000 [18:09<42:07,  1.07s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  22%|##1       | 646/3000 [18:09<42:07,  1.07s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  22%|##1       | 647/3000 [18:09<1:02:29,  1.59s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  22%|##1       | 647/3000 [18:09<1:02:29,  1.59s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  22%|##1       | 647/3000 [18:12<1:02:29,  1.59s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  22%|##1       | 647/3000 [18:12<1:02:29,  1.59s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  22%|##1       | 648/3000 [18:12<1:17:02,  1.97s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  22%|##1       | 648/3000 [18:12<1:17:02,  1.97s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  22%|##1       | 648/3000 [18:14<1:17:02,  1.97s/it, lr: 1.0e-04 loss: 2.475e-01]
a-cold-wall:  22%|##1       | 648/3000 [18:14<1:17:02,  1.97s/it, lr: 1.0e-04 loss: 2.475e-01]
a-cold-wall:  22%|##1       | 649/3000 [18:14<1:10:49,  1.81s/it, lr: 1.0e-04 loss: 2.475e-01]
a-cold-wall:  22%|##1       | 649/3000 [18:14<1:10:49,  1.81s/it, lr: 1.0e-04 loss: 2.475e-01]
a-cold-wall:  22%|##1       | 649/3000 [18:15<1:10:49,  1.81s/it, lr: 1.0e-04 loss: 5.798e-01]
a-cold-wall:  22%|##1       | 649/3000 [18:15<1:10:49,  1.81s/it, lr: 1.0e-04 loss: 5.798e-01]
a-cold-wall:  22%|##1       | 650/3000 [18:16<1:10:48,  1.81s/it, lr: 1.0e-04 loss: 4.849e-01]
a-cold-wall:  22%|##1       | 650/3000 [18:16<1:10:48,  1.81s/it, lr: 1.0e-04 loss: 4.849e-01]
a-cold-wall:  22%|##1       | 651/3000 [18:16<45:07,  1.15s/it, lr: 1.0e-04 loss: 4.849e-01]  
a-cold-wall:  22%|##1       | 651/3000 [18:16<45:07,  1.15s/it, lr: 1.0e-04 loss: 4.849e-01]  
a-cold-wall:  22%|##1       | 651/3000 [18:17<45:07,  1.15s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  22%|##1       | 651/3000 [18:17<45:07,  1.15s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  22%|##1       | 652/3000 [18:17<47:46,  1.22s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  22%|##1       | 652/3000 [18:17<47:46,  1.22s/it, lr: 1.0e-04 loss: 6.724e-01]
a-cold-wall:  22%|##1       | 652/3000 [18:20<47:46,  1.22s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  22%|##1       | 652/3000 [18:20<47:46,  1.22s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  22%|##1       | 653/3000 [18:20<1:04:23,  1.65s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  22%|##1       | 653/3000 [18:20<1:04:23,  1.65s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  22%|##1       | 653/3000 [18:21<1:04:23,  1.65s/it, lr: 1.0e-04 loss: 3.406e-01]
a-cold-wall:  22%|##1       | 653/3000 [18:21<1:04:23,  1.65s/it, lr: 1.0e-04 loss: 3.406e-01]
a-cold-wall:  22%|##1       | 654/3000 [18:21<1:02:18,  1.59s/it, lr: 1.0e-04 loss: 3.406e-01]
a-cold-wall:  22%|##1       | 654/3000 [18:21<1:02:18,  1.59s/it, lr: 1.0e-04 loss: 3.406e-01]
a-cold-wall:  22%|##1       | 654/3000 [18:23<1:02:18,  1.59s/it, lr: 1.0e-04 loss: 3.512e-02]
a-cold-wall:  22%|##1       | 654/3000 [18:23<1:02:18,  1.59s/it, lr: 1.0e-04 loss: 3.512e-02]
a-cold-wall:  22%|##1       | 655/3000 [18:23<1:00:26,  1.55s/it, lr: 1.0e-04 loss: 3.512e-02]
a-cold-wall:  22%|##1       | 655/3000 [18:23<1:00:26,  1.55s/it, lr: 1.0e-04 loss: 3.512e-02]
a-cold-wall:  22%|##1       | 655/3000 [18:23<1:00:26,  1.55s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  22%|##1       | 655/3000 [18:23<1:00:26,  1.55s/it, lr: 1.0e-04 loss: 4.260e-01]
a-cold-wall:  22%|##1       | 656/3000 [18:23<51:38,  1.32s/it, lr: 1.0e-04 loss: 4.260e-01]  
a-cold-wall:  22%|##1       | 656/3000 [18:23<51:38,  1.32s/it, lr: 1.0e-04 loss: 4.260e-01]  
a-cold-wall:  22%|##1       | 656/3000 [18:26<51:38,  1.32s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  22%|##1       | 656/3000 [18:26<51:38,  1.32s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  22%|##1       | 657/3000 [18:26<1:09:13,  1.77s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  22%|##1       | 657/3000 [18:26<1:09:13,  1.77s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  22%|##1       | 657/3000 [18:29<1:09:13,  1.77s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  22%|##1       | 657/3000 [18:29<1:09:13,  1.77s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  22%|##1       | 658/3000 [18:29<1:21:49,  2.10s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  22%|##1       | 658/3000 [18:29<1:21:49,  2.10s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  22%|##1       | 658/3000 [18:30<1:21:49,  2.10s/it, lr: 1.0e-04 loss: 4.731e-02]
a-cold-wall:  22%|##1       | 658/3000 [18:30<1:21:49,  2.10s/it, lr: 1.0e-04 loss: 4.731e-02]
a-cold-wall:  22%|##1       | 659/3000 [18:30<1:06:16,  1.70s/it, lr: 1.0e-04 loss: 4.731e-02]
a-cold-wall:  22%|##1       | 659/3000 [18:30<1:06:16,  1.70s/it, lr: 1.0e-04 loss: 4.731e-02]
a-cold-wall:  22%|##1       | 659/3000 [18:33<1:06:16,  1.70s/it, lr: 1.0e-04 loss: 4.963e-01]
a-cold-wall:  22%|##1       | 659/3000 [18:33<1:06:16,  1.70s/it, lr: 1.0e-04 loss: 4.963e-01]
a-cold-wall:  22%|##2       | 660/3000 [18:36<1:06:15,  1.70s/it, lr: 1.0e-04 loss: 9.193e-02]
a-cold-wall:  22%|##2       | 660/3000 [18:36<1:06:15,  1.70s/it, lr: 1.0e-04 loss: 9.193e-02]
a-cold-wall:  22%|##2       | 661/3000 [18:36<1:01:33,  1.58s/it, lr: 1.0e-04 loss: 9.193e-02]
a-cold-wall:  22%|##2       | 661/3000 [18:36<1:01:33,  1.58s/it, lr: 1.0e-04 loss: 9.193e-02]
a-cold-wall:  22%|##2       | 661/3000 [18:37<1:01:33,  1.58s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  22%|##2       | 661/3000 [18:37<1:01:33,  1.58s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  22%|##2       | 662/3000 [18:37<59:56,  1.54s/it, lr: 1.0e-04 loss: 4.889e-01]  
a-cold-wall:  22%|##2       | 662/3000 [18:37<59:56,  1.54s/it, lr: 1.0e-04 loss: 4.889e-01]  
a-cold-wall:  22%|##2       | 662/3000 [18:39<59:56,  1.54s/it, lr: 1.0e-04 loss: 2.967e-01]
a-cold-wall:  22%|##2       | 662/3000 [18:39<59:56,  1.54s/it, lr: 1.0e-04 loss: 2.967e-01]
a-cold-wall:  22%|##2       | 663/3000 [18:39<1:00:22,  1.55s/it, lr: 1.0e-04 loss: 2.967e-01]
a-cold-wall:  22%|##2       | 663/3000 [18:39<1:00:22,  1.55s/it, lr: 1.0e-04 loss: 2.967e-01]
a-cold-wall:  22%|##2       | 663/3000 [18:42<1:00:22,  1.55s/it, lr: 1.0e-04 loss: 6.196e-01]
a-cold-wall:  22%|##2       | 663/3000 [18:42<1:00:22,  1.55s/it, lr: 1.0e-04 loss: 6.196e-01]
a-cold-wall:  22%|##2       | 664/3000 [18:42<1:14:23,  1.91s/it, lr: 1.0e-04 loss: 6.196e-01]
a-cold-wall:  22%|##2       | 664/3000 [18:42<1:14:23,  1.91s/it, lr: 1.0e-04 loss: 6.196e-01]
a-cold-wall:  22%|##2       | 664/3000 [18:42<1:14:23,  1.91s/it, lr: 1.0e-04 loss: 3.828e-02]
a-cold-wall:  22%|##2       | 664/3000 [18:42<1:14:23,  1.91s/it, lr: 1.0e-04 loss: 3.828e-02]
a-cold-wall:  22%|##2       | 665/3000 [18:43<1:04:04,  1.65s/it, lr: 1.0e-04 loss: 3.828e-02]
a-cold-wall:  22%|##2       | 665/3000 [18:43<1:04:04,  1.65s/it, lr: 1.0e-04 loss: 3.828e-02]
a-cold-wall:  22%|##2       | 665/3000 [18:45<1:04:04,  1.65s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  22%|##2       | 665/3000 [18:45<1:04:04,  1.65s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  22%|##2       | 666/3000 [18:45<1:17:39,  2.00s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  22%|##2       | 666/3000 [18:45<1:17:39,  2.00s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  22%|##2       | 666/3000 [18:46<1:17:39,  2.00s/it, lr: 1.0e-04 loss: 1.512e-02]
a-cold-wall:  22%|##2       | 666/3000 [18:46<1:17:39,  2.00s/it, lr: 1.0e-04 loss: 1.512e-02]
a-cold-wall:  22%|##2       | 667/3000 [18:46<1:03:39,  1.64s/it, lr: 1.0e-04 loss: 1.512e-02]
a-cold-wall:  22%|##2       | 667/3000 [18:46<1:03:39,  1.64s/it, lr: 1.0e-04 loss: 1.512e-02]
a-cold-wall:  22%|##2       | 667/3000 [18:47<1:03:39,  1.64s/it, lr: 1.0e-04 loss: 6.656e-01]
a-cold-wall:  22%|##2       | 667/3000 [18:47<1:03:39,  1.64s/it, lr: 1.0e-04 loss: 6.656e-01]
a-cold-wall:  22%|##2       | 668/3000 [18:47<53:39,  1.38s/it, lr: 1.0e-04 loss: 6.656e-01]  
a-cold-wall:  22%|##2       | 668/3000 [18:47<53:39,  1.38s/it, lr: 1.0e-04 loss: 6.656e-01]  
a-cold-wall:  22%|##2       | 668/3000 [18:48<53:39,  1.38s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  22%|##2       | 668/3000 [18:48<53:39,  1.38s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  22%|##2       | 669/3000 [18:48<53:55,  1.39s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  22%|##2       | 669/3000 [18:48<53:55,  1.39s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  22%|##2       | 669/3000 [18:50<53:55,  1.39s/it, lr: 1.0e-04 loss: 1.608e-01]
a-cold-wall:  22%|##2       | 669/3000 [18:50<53:55,  1.39s/it, lr: 1.0e-04 loss: 1.608e-01]
a-cold-wall:  22%|##2       | 670/3000 [18:53<53:54,  1.39s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  22%|##2       | 670/3000 [18:53<53:54,  1.39s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  22%|##2       | 671/3000 [18:53<54:25,  1.40s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  22%|##2       | 671/3000 [18:53<54:25,  1.40s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  22%|##2       | 671/3000 [18:55<54:25,  1.40s/it, lr: 1.0e-04 loss: 4.780e-01]
a-cold-wall:  22%|##2       | 671/3000 [18:55<54:25,  1.40s/it, lr: 1.0e-04 loss: 4.780e-01]
a-cold-wall:  22%|##2       | 672/3000 [18:55<1:08:12,  1.76s/it, lr: 1.0e-04 loss: 4.780e-01]
a-cold-wall:  22%|##2       | 672/3000 [18:55<1:08:12,  1.76s/it, lr: 1.0e-04 loss: 4.780e-01]
a-cold-wall:  22%|##2       | 672/3000 [18:58<1:08:12,  1.76s/it, lr: 1.0e-04 loss: 7.206e-03]
a-cold-wall:  22%|##2       | 672/3000 [18:58<1:08:12,  1.76s/it, lr: 1.0e-04 loss: 7.206e-03]
a-cold-wall:  22%|##2       | 673/3000 [18:58<1:19:27,  2.05s/it, lr: 1.0e-04 loss: 7.206e-03]
a-cold-wall:  22%|##2       | 673/3000 [18:58<1:19:27,  2.05s/it, lr: 1.0e-04 loss: 7.206e-03]
a-cold-wall:  22%|##2       | 673/3000 [18:59<1:19:27,  2.05s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  22%|##2       | 673/3000 [18:59<1:19:27,  2.05s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  22%|##2       | 674/3000 [18:59<1:05:38,  1.69s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  22%|##2       | 674/3000 [18:59<1:05:38,  1.69s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  22%|##2       | 674/3000 [19:02<1:05:38,  1.69s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  22%|##2       | 674/3000 [19:02<1:05:38,  1.69s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  22%|##2       | 675/3000 [19:02<1:18:05,  2.02s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  22%|##2       | 675/3000 [19:02<1:18:05,  2.02s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  22%|##2       | 675/3000 [19:03<1:18:05,  2.02s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  22%|##2       | 675/3000 [19:03<1:18:05,  2.02s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  23%|##2       | 676/3000 [19:03<1:06:31,  1.72s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  23%|##2       | 676/3000 [19:03<1:06:31,  1.72s/it, lr: 1.0e-04 loss: 4.960e-01]
a-cold-wall:  23%|##2       | 676/3000 [19:06<1:06:31,  1.72s/it, lr: 1.0e-04 loss: 7.158e-01]
a-cold-wall:  23%|##2       | 676/3000 [19:06<1:06:31,  1.72s/it, lr: 1.0e-04 loss: 7.158e-01]
a-cold-wall:  23%|##2       | 677/3000 [19:06<1:19:30,  2.05s/it, lr: 1.0e-04 loss: 7.158e-01]
a-cold-wall:  23%|##2       | 677/3000 [19:06<1:19:30,  2.05s/it, lr: 1.0e-04 loss: 7.158e-01]
a-cold-wall:  23%|##2       | 677/3000 [19:06<1:19:30,  2.05s/it, lr: 1.0e-04 loss: 1.856e-01]
a-cold-wall:  23%|##2       | 677/3000 [19:06<1:19:30,  2.05s/it, lr: 1.0e-04 loss: 1.856e-01]
a-cold-wall:  23%|##2       | 678/3000 [19:06<1:04:36,  1.67s/it, lr: 1.0e-04 loss: 1.856e-01]
a-cold-wall:  23%|##2       | 678/3000 [19:06<1:04:36,  1.67s/it, lr: 1.0e-04 loss: 1.856e-01]
a-cold-wall:  23%|##2       | 678/3000 [19:08<1:04:36,  1.67s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  23%|##2       | 678/3000 [19:08<1:04:36,  1.67s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  23%|##2       | 679/3000 [19:08<1:01:48,  1.60s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  23%|##2       | 679/3000 [19:08<1:01:48,  1.60s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  23%|##2       | 679/3000 [19:11<1:01:48,  1.60s/it, lr: 1.0e-04 loss: 9.152e-02]
a-cold-wall:  23%|##2       | 679/3000 [19:11<1:01:48,  1.60s/it, lr: 1.0e-04 loss: 9.152e-02]
a-cold-wall:  23%|##2       | 680/3000 [19:11<1:01:46,  1.60s/it, lr: 1.0e-04 loss: 5.862e-01]
a-cold-wall:  23%|##2       | 680/3000 [19:11<1:01:46,  1.60s/it, lr: 1.0e-04 loss: 5.862e-01]
a-cold-wall:  23%|##2       | 681/3000 [19:11<40:06,  1.04s/it, lr: 1.0e-04 loss: 5.862e-01]  
a-cold-wall:  23%|##2       | 681/3000 [19:11<40:06,  1.04s/it, lr: 1.0e-04 loss: 5.862e-01]  
a-cold-wall:  23%|##2       | 681/3000 [19:12<40:06,  1.04s/it, lr: 1.0e-04 loss: 3.725e-01]
a-cold-wall:  23%|##2       | 681/3000 [19:12<40:06,  1.04s/it, lr: 1.0e-04 loss: 3.725e-01]
a-cold-wall:  23%|##2       | 682/3000 [19:12<37:15,  1.04it/s, lr: 1.0e-04 loss: 3.725e-01]
a-cold-wall:  23%|##2       | 682/3000 [19:12<37:15,  1.04it/s, lr: 1.0e-04 loss: 3.725e-01]
a-cold-wall:  23%|##2       | 682/3000 [19:15<37:15,  1.04it/s, lr: 1.0e-04 loss: 2.452e-01]
a-cold-wall:  23%|##2       | 682/3000 [19:15<37:15,  1.04it/s, lr: 1.0e-04 loss: 2.452e-01]
a-cold-wall:  23%|##2       | 683/3000 [19:15<56:32,  1.46s/it, lr: 1.0e-04 loss: 2.452e-01]
a-cold-wall:  23%|##2       | 683/3000 [19:15<56:32,  1.46s/it, lr: 1.0e-04 loss: 2.452e-01]
a-cold-wall:  23%|##2       | 683/3000 [19:16<56:32,  1.46s/it, lr: 1.0e-04 loss: 6.743e-01]
a-cold-wall:  23%|##2       | 683/3000 [19:16<56:32,  1.46s/it, lr: 1.0e-04 loss: 6.743e-01]
a-cold-wall:  23%|##2       | 684/3000 [19:16<48:58,  1.27s/it, lr: 1.0e-04 loss: 6.743e-01]
a-cold-wall:  23%|##2       | 684/3000 [19:16<48:58,  1.27s/it, lr: 1.0e-04 loss: 6.743e-01]
a-cold-wall:  23%|##2       | 684/3000 [19:17<48:58,  1.27s/it, lr: 1.0e-04 loss: 3.444e-01]
a-cold-wall:  23%|##2       | 684/3000 [19:17<48:58,  1.27s/it, lr: 1.0e-04 loss: 3.444e-01]
a-cold-wall:  23%|##2       | 685/3000 [19:17<50:39,  1.31s/it, lr: 1.0e-04 loss: 3.444e-01]
a-cold-wall:  23%|##2       | 685/3000 [19:17<50:39,  1.31s/it, lr: 1.0e-04 loss: 3.444e-01]
a-cold-wall:  23%|##2       | 685/3000 [19:19<50:39,  1.31s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  23%|##2       | 685/3000 [19:19<50:39,  1.31s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  23%|##2       | 686/3000 [19:19<51:53,  1.35s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  23%|##2       | 686/3000 [19:19<51:53,  1.35s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  23%|##2       | 686/3000 [19:20<51:53,  1.35s/it, lr: 1.0e-04 loss: 5.652e-01]
a-cold-wall:  23%|##2       | 686/3000 [19:20<51:53,  1.35s/it, lr: 1.0e-04 loss: 5.652e-01]
a-cold-wall:  23%|##2       | 687/3000 [19:20<52:47,  1.37s/it, lr: 1.0e-04 loss: 5.652e-01]
a-cold-wall:  23%|##2       | 687/3000 [19:20<52:47,  1.37s/it, lr: 1.0e-04 loss: 5.652e-01]
a-cold-wall:  23%|##2       | 687/3000 [19:21<52:47,  1.37s/it, lr: 1.0e-04 loss: 2.097e-01]
a-cold-wall:  23%|##2       | 687/3000 [19:21<52:47,  1.37s/it, lr: 1.0e-04 loss: 2.097e-01]
a-cold-wall:  23%|##2       | 688/3000 [19:21<45:42,  1.19s/it, lr: 1.0e-04 loss: 2.097e-01]
a-cold-wall:  23%|##2       | 688/3000 [19:21<45:42,  1.19s/it, lr: 1.0e-04 loss: 2.097e-01]
a-cold-wall:  23%|##2       | 688/3000 [19:24<45:42,  1.19s/it, lr: 1.0e-04 loss: 5.409e-01]
a-cold-wall:  23%|##2       | 688/3000 [19:24<45:42,  1.19s/it, lr: 1.0e-04 loss: 5.409e-01]
a-cold-wall:  23%|##2       | 689/3000 [19:24<1:05:04,  1.69s/it, lr: 1.0e-04 loss: 5.409e-01]
a-cold-wall:  23%|##2       | 689/3000 [19:24<1:05:04,  1.69s/it, lr: 1.0e-04 loss: 5.409e-01]
a-cold-wall:  23%|##2       | 689/3000 [19:25<1:05:04,  1.69s/it, lr: 1.0e-04 loss: 3.135e-02]
a-cold-wall:  23%|##2       | 689/3000 [19:25<1:05:04,  1.69s/it, lr: 1.0e-04 loss: 3.135e-02]
a-cold-wall:  23%|##3       | 690/3000 [19:27<1:05:03,  1.69s/it, lr: 1.0e-04 loss: 2.583e-01]
a-cold-wall:  23%|##3       | 690/3000 [19:27<1:05:03,  1.69s/it, lr: 1.0e-04 loss: 2.583e-01]
a-cold-wall:  23%|##3       | 691/3000 [19:27<47:49,  1.24s/it, lr: 1.0e-04 loss: 2.583e-01]  
a-cold-wall:  23%|##3       | 691/3000 [19:27<47:49,  1.24s/it, lr: 1.0e-04 loss: 2.583e-01]  
a-cold-wall:  23%|##3       | 691/3000 [19:30<47:49,  1.24s/it, lr: 1.0e-04 loss: 5.093e-01]
a-cold-wall:  23%|##3       | 691/3000 [19:30<47:49,  1.24s/it, lr: 1.0e-04 loss: 5.093e-01]
a-cold-wall:  23%|##3       | 692/3000 [19:30<1:03:12,  1.64s/it, lr: 1.0e-04 loss: 5.093e-01]
a-cold-wall:  23%|##3       | 692/3000 [19:30<1:03:12,  1.64s/it, lr: 1.0e-04 loss: 5.093e-01]
a-cold-wall:  23%|##3       | 692/3000 [19:31<1:03:12,  1.64s/it, lr: 1.0e-04 loss: 6.335e-02]
a-cold-wall:  23%|##3       | 692/3000 [19:31<1:03:12,  1.64s/it, lr: 1.0e-04 loss: 6.335e-02]
a-cold-wall:  23%|##3       | 693/3000 [19:31<1:01:08,  1.59s/it, lr: 1.0e-04 loss: 6.335e-02]
a-cold-wall:  23%|##3       | 693/3000 [19:31<1:01:08,  1.59s/it, lr: 1.0e-04 loss: 6.335e-02]
a-cold-wall:  23%|##3       | 693/3000 [19:33<1:01:08,  1.59s/it, lr: 1.0e-04 loss: 5.425e-01]
a-cold-wall:  23%|##3       | 693/3000 [19:33<1:01:08,  1.59s/it, lr: 1.0e-04 loss: 5.425e-01]
a-cold-wall:  23%|##3       | 694/3000 [19:33<59:32,  1.55s/it, lr: 1.0e-04 loss: 5.425e-01]  
a-cold-wall:  23%|##3       | 694/3000 [19:33<59:32,  1.55s/it, lr: 1.0e-04 loss: 5.425e-01]  
a-cold-wall:  23%|##3       | 694/3000 [19:35<59:32,  1.55s/it, lr: 1.0e-04 loss: 5.902e-02]
a-cold-wall:  23%|##3       | 694/3000 [19:35<59:32,  1.55s/it, lr: 1.0e-04 loss: 5.902e-02]
a-cold-wall:  23%|##3       | 695/3000 [19:35<1:13:47,  1.92s/it, lr: 1.0e-04 loss: 5.902e-02]
a-cold-wall:  23%|##3       | 695/3000 [19:35<1:13:47,  1.92s/it, lr: 1.0e-04 loss: 5.902e-02]
a-cold-wall:  23%|##3       | 695/3000 [19:36<1:13:47,  1.92s/it, lr: 1.0e-04 loss: 6.073e-01]
a-cold-wall:  23%|##3       | 695/3000 [19:36<1:13:47,  1.92s/it, lr: 1.0e-04 loss: 6.073e-01]
a-cold-wall:  23%|##3       | 696/3000 [19:36<1:01:10,  1.59s/it, lr: 1.0e-04 loss: 6.073e-01]
a-cold-wall:  23%|##3       | 696/3000 [19:36<1:01:10,  1.59s/it, lr: 1.0e-04 loss: 6.073e-01]
a-cold-wall:  23%|##3       | 696/3000 [19:38<1:01:10,  1.59s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  23%|##3       | 696/3000 [19:38<1:01:10,  1.59s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  23%|##3       | 697/3000 [19:38<59:30,  1.55s/it, lr: 1.0e-04 loss: 5.407e-01]  
a-cold-wall:  23%|##3       | 697/3000 [19:38<59:30,  1.55s/it, lr: 1.0e-04 loss: 5.407e-01]  
a-cold-wall:  23%|##3       | 697/3000 [19:41<59:30,  1.55s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  23%|##3       | 697/3000 [19:41<59:30,  1.55s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  23%|##3       | 698/3000 [19:41<1:14:52,  1.95s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  23%|##3       | 698/3000 [19:41<1:14:52,  1.95s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  23%|##3       | 698/3000 [19:41<1:14:52,  1.95s/it, lr: 1.0e-04 loss: 4.792e-01]
a-cold-wall:  23%|##3       | 698/3000 [19:41<1:14:52,  1.95s/it, lr: 1.0e-04 loss: 4.792e-01]
a-cold-wall:  23%|##3       | 699/3000 [19:41<1:01:06,  1.59s/it, lr: 1.0e-04 loss: 4.792e-01]
a-cold-wall:  23%|##3       | 699/3000 [19:41<1:01:06,  1.59s/it, lr: 1.0e-04 loss: 4.792e-01]
a-cold-wall:  23%|##3       | 699/3000 [19:44<1:01:06,  1.59s/it, lr: 1.0e-04 loss: 8.719e-02]
a-cold-wall:  23%|##3       | 699/3000 [19:44<1:01:06,  1.59s/it, lr: 1.0e-04 loss: 8.719e-02]
a-cold-wall:  23%|##3       | 700/3000 [19:46<1:01:04,  1.59s/it, lr: 1.0e-04 loss: 4.351e-01]
a-cold-wall:  23%|##3       | 700/3000 [19:46<1:01:04,  1.59s/it, lr: 1.0e-04 loss: 4.351e-01]
a-cold-wall:  23%|##3       | 701/3000 [19:46<45:38,  1.19s/it, lr: 1.0e-04 loss: 4.351e-01]  
a-cold-wall:  23%|##3       | 701/3000 [19:46<45:38,  1.19s/it, lr: 1.0e-04 loss: 4.351e-01]  
a-cold-wall:  23%|##3       | 701/3000 [19:49<45:38,  1.19s/it, lr: 1.0e-04 loss: 7.856e-02]
a-cold-wall:  23%|##3       | 701/3000 [19:49<45:38,  1.19s/it, lr: 1.0e-04 loss: 7.856e-02]
a-cold-wall:  23%|##3       | 702/3000 [19:49<1:01:47,  1.61s/it, lr: 1.0e-04 loss: 7.856e-02]
a-cold-wall:  23%|##3       | 702/3000 [19:49<1:01:47,  1.61s/it, lr: 1.0e-04 loss: 7.856e-02]
a-cold-wall:  23%|##3       | 702/3000 [19:49<1:01:47,  1.61s/it, lr: 1.0e-04 loss: 7.016e-01]
a-cold-wall:  23%|##3       | 702/3000 [19:49<1:01:47,  1.61s/it, lr: 1.0e-04 loss: 7.016e-01]
a-cold-wall:  23%|##3       | 703/3000 [19:49<53:11,  1.39s/it, lr: 1.0e-04 loss: 7.016e-01]  
a-cold-wall:  23%|##3       | 703/3000 [19:49<53:11,  1.39s/it, lr: 1.0e-04 loss: 7.016e-01]  
a-cold-wall:  23%|##3       | 703/3000 [19:50<53:11,  1.39s/it, lr: 1.0e-04 loss: 5.685e-01]
a-cold-wall:  23%|##3       | 703/3000 [19:50<53:11,  1.39s/it, lr: 1.0e-04 loss: 5.685e-01]
a-cold-wall:  23%|##3       | 704/3000 [19:50<49:08,  1.28s/it, lr: 1.0e-04 loss: 5.685e-01]
a-cold-wall:  23%|##3       | 704/3000 [19:50<49:08,  1.28s/it, lr: 1.0e-04 loss: 5.685e-01]
a-cold-wall:  23%|##3       | 704/3000 [19:51<49:08,  1.28s/it, lr: 1.0e-04 loss: 7.097e-02]
a-cold-wall:  23%|##3       | 704/3000 [19:51<49:08,  1.28s/it, lr: 1.0e-04 loss: 7.097e-02]
a-cold-wall:  24%|##3       | 705/3000 [19:51<44:18,  1.16s/it, lr: 1.0e-04 loss: 7.097e-02]
a-cold-wall:  24%|##3       | 705/3000 [19:51<44:18,  1.16s/it, lr: 1.0e-04 loss: 7.097e-02]
a-cold-wall:  24%|##3       | 705/3000 [19:53<44:18,  1.16s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:  24%|##3       | 705/3000 [19:53<44:18,  1.16s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:  24%|##3       | 706/3000 [19:53<47:07,  1.23s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:  24%|##3       | 706/3000 [19:53<47:07,  1.23s/it, lr: 1.0e-04 loss: 3.134e-01]
a-cold-wall:  24%|##3       | 706/3000 [19:53<47:07,  1.23s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  24%|##3       | 706/3000 [19:53<47:07,  1.23s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  24%|##3       | 707/3000 [19:53<41:46,  1.09s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  24%|##3       | 707/3000 [19:53<41:46,  1.09s/it, lr: 1.0e-04 loss: 3.886e-01]
a-cold-wall:  24%|##3       | 707/3000 [19:55<41:46,  1.09s/it, lr: 1.0e-04 loss: 1.423e-01]
a-cold-wall:  24%|##3       | 707/3000 [19:55<41:46,  1.09s/it, lr: 1.0e-04 loss: 1.423e-01]
a-cold-wall:  24%|##3       | 708/3000 [19:55<45:21,  1.19s/it, lr: 1.0e-04 loss: 1.423e-01]
a-cold-wall:  24%|##3       | 708/3000 [19:55<45:21,  1.19s/it, lr: 1.0e-04 loss: 1.423e-01]
a-cold-wall:  24%|##3       | 708/3000 [19:56<45:21,  1.19s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  24%|##3       | 708/3000 [19:56<45:21,  1.19s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  24%|##3       | 709/3000 [19:56<42:54,  1.12s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  24%|##3       | 709/3000 [19:56<42:54,  1.12s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  24%|##3       | 709/3000 [19:57<42:54,  1.12s/it, lr: 1.0e-04 loss: 4.785e-01]
a-cold-wall:  24%|##3       | 709/3000 [19:57<42:54,  1.12s/it, lr: 1.0e-04 loss: 4.785e-01]
a-cold-wall:  24%|##3       | 710/3000 [19:58<42:53,  1.12s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  24%|##3       | 710/3000 [19:58<42:53,  1.12s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  24%|##3       | 711/3000 [19:58<29:44,  1.28it/s, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  24%|##3       | 711/3000 [19:58<29:44,  1.28it/s, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  24%|##3       | 711/3000 [19:59<29:44,  1.28it/s, lr: 1.0e-04 loss: 1.933e-01]
a-cold-wall:  24%|##3       | 711/3000 [19:59<29:44,  1.28it/s, lr: 1.0e-04 loss: 1.933e-01]
a-cold-wall:  24%|##3       | 712/3000 [19:59<29:26,  1.30it/s, lr: 1.0e-04 loss: 1.933e-01]
a-cold-wall:  24%|##3       | 712/3000 [19:59<29:26,  1.30it/s, lr: 1.0e-04 loss: 1.933e-01]
a-cold-wall:  24%|##3       | 712/3000 [20:01<29:26,  1.30it/s, lr: 1.0e-04 loss: 1.647e-01]
a-cold-wall:  24%|##3       | 712/3000 [20:01<29:26,  1.30it/s, lr: 1.0e-04 loss: 1.647e-01]
a-cold-wall:  24%|##3       | 713/3000 [20:01<50:15,  1.32s/it, lr: 1.0e-04 loss: 1.647e-01]
a-cold-wall:  24%|##3       | 713/3000 [20:01<50:15,  1.32s/it, lr: 1.0e-04 loss: 1.647e-01]
a-cold-wall:  24%|##3       | 713/3000 [20:03<50:15,  1.32s/it, lr: 1.0e-04 loss: 3.435e-02]
a-cold-wall:  24%|##3       | 713/3000 [20:03<50:15,  1.32s/it, lr: 1.0e-04 loss: 3.435e-02]
a-cold-wall:  24%|##3       | 714/3000 [20:03<51:23,  1.35s/it, lr: 1.0e-04 loss: 3.435e-02]
a-cold-wall:  24%|##3       | 714/3000 [20:03<51:23,  1.35s/it, lr: 1.0e-04 loss: 3.435e-02]
a-cold-wall:  24%|##3       | 714/3000 [20:04<51:23,  1.35s/it, lr: 1.0e-04 loss: 6.655e-01]
a-cold-wall:  24%|##3       | 714/3000 [20:04<51:23,  1.35s/it, lr: 1.0e-04 loss: 6.655e-01]
a-cold-wall:  24%|##3       | 715/3000 [20:04<52:19,  1.37s/it, lr: 1.0e-04 loss: 6.655e-01]
a-cold-wall:  24%|##3       | 715/3000 [20:04<52:19,  1.37s/it, lr: 1.0e-04 loss: 6.655e-01]
a-cold-wall:  24%|##3       | 715/3000 [20:06<52:19,  1.37s/it, lr: 1.0e-04 loss: 2.193e-01]
a-cold-wall:  24%|##3       | 715/3000 [20:06<52:19,  1.37s/it, lr: 1.0e-04 loss: 2.193e-01]
a-cold-wall:  24%|##3       | 716/3000 [20:06<52:46,  1.39s/it, lr: 1.0e-04 loss: 2.193e-01]
a-cold-wall:  24%|##3       | 716/3000 [20:06<52:46,  1.39s/it, lr: 1.0e-04 loss: 2.193e-01]
a-cold-wall:  24%|##3       | 716/3000 [20:07<52:46,  1.39s/it, lr: 1.0e-04 loss: 6.590e-01]
a-cold-wall:  24%|##3       | 716/3000 [20:07<52:46,  1.39s/it, lr: 1.0e-04 loss: 6.590e-01]
a-cold-wall:  24%|##3       | 717/3000 [20:07<52:58,  1.39s/it, lr: 1.0e-04 loss: 6.590e-01]
a-cold-wall:  24%|##3       | 717/3000 [20:07<52:58,  1.39s/it, lr: 1.0e-04 loss: 6.590e-01]
a-cold-wall:  24%|##3       | 717/3000 [20:08<52:58,  1.39s/it, lr: 1.0e-04 loss: 6.059e-01]
a-cold-wall:  24%|##3       | 717/3000 [20:08<52:58,  1.39s/it, lr: 1.0e-04 loss: 6.059e-01]
a-cold-wall:  24%|##3       | 718/3000 [20:08<48:23,  1.27s/it, lr: 1.0e-04 loss: 6.059e-01]
a-cold-wall:  24%|##3       | 718/3000 [20:08<48:23,  1.27s/it, lr: 1.0e-04 loss: 6.059e-01]
a-cold-wall:  24%|##3       | 718/3000 [20:10<48:23,  1.27s/it, lr: 1.0e-04 loss: 5.147e-01]
a-cold-wall:  24%|##3       | 718/3000 [20:10<48:23,  1.27s/it, lr: 1.0e-04 loss: 5.147e-01]
a-cold-wall:  24%|##3       | 719/3000 [20:10<51:16,  1.35s/it, lr: 1.0e-04 loss: 5.147e-01]
a-cold-wall:  24%|##3       | 719/3000 [20:10<51:16,  1.35s/it, lr: 1.0e-04 loss: 5.147e-01]
a-cold-wall:  24%|##3       | 719/3000 [20:13<51:16,  1.35s/it, lr: 1.0e-04 loss: 3.393e-02]
a-cold-wall:  24%|##3       | 719/3000 [20:13<51:16,  1.35s/it, lr: 1.0e-04 loss: 3.393e-02]
a-cold-wall:  24%|##4       | 720/3000 [20:13<51:14,  1.35s/it, lr: 1.0e-04 loss: 4.644e-01]
a-cold-wall:  24%|##4       | 720/3000 [20:13<51:14,  1.35s/it, lr: 1.0e-04 loss: 4.644e-01]
a-cold-wall:  24%|##4       | 721/3000 [20:13<34:16,  1.11it/s, lr: 1.0e-04 loss: 4.644e-01]
a-cold-wall:  24%|##4       | 721/3000 [20:13<34:16,  1.11it/s, lr: 1.0e-04 loss: 4.644e-01]
a-cold-wall:  24%|##4       | 721/3000 [20:14<34:16,  1.11it/s, lr: 1.0e-04 loss: 4.784e-01]
a-cold-wall:  24%|##4       | 721/3000 [20:14<34:16,  1.11it/s, lr: 1.0e-04 loss: 4.784e-01]
a-cold-wall:  24%|##4       | 722/3000 [20:14<32:43,  1.16it/s, lr: 1.0e-04 loss: 4.784e-01]
a-cold-wall:  24%|##4       | 722/3000 [20:14<32:43,  1.16it/s, lr: 1.0e-04 loss: 4.784e-01]
a-cold-wall:  24%|##4       | 722/3000 [20:17<32:43,  1.16it/s, lr: 1.0e-04 loss: 1.954e-01]
a-cold-wall:  24%|##4       | 722/3000 [20:17<32:43,  1.16it/s, lr: 1.0e-04 loss: 1.954e-01]
a-cold-wall:  24%|##4       | 723/3000 [20:17<52:33,  1.39s/it, lr: 1.0e-04 loss: 1.954e-01]
a-cold-wall:  24%|##4       | 723/3000 [20:17<52:33,  1.39s/it, lr: 1.0e-04 loss: 1.954e-01]
a-cold-wall:  24%|##4       | 723/3000 [20:18<52:33,  1.39s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  24%|##4       | 723/3000 [20:18<52:33,  1.39s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  24%|##4       | 724/3000 [20:18<45:57,  1.21s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  24%|##4       | 724/3000 [20:18<45:57,  1.21s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  24%|##4       | 724/3000 [20:19<45:57,  1.21s/it, lr: 1.0e-04 loss: 2.160e-01]
a-cold-wall:  24%|##4       | 724/3000 [20:19<45:57,  1.21s/it, lr: 1.0e-04 loss: 2.160e-01]
a-cold-wall:  24%|##4       | 725/3000 [20:19<47:58,  1.27s/it, lr: 1.0e-04 loss: 2.160e-01]
a-cold-wall:  24%|##4       | 725/3000 [20:19<47:58,  1.27s/it, lr: 1.0e-04 loss: 2.160e-01]
a-cold-wall:  24%|##4       | 725/3000 [20:20<47:58,  1.27s/it, lr: 1.0e-04 loss: 5.629e-01]
a-cold-wall:  24%|##4       | 725/3000 [20:20<47:58,  1.27s/it, lr: 1.0e-04 loss: 5.629e-01]
a-cold-wall:  24%|##4       | 726/3000 [20:20<49:27,  1.30s/it, lr: 1.0e-04 loss: 5.629e-01]
a-cold-wall:  24%|##4       | 726/3000 [20:20<49:27,  1.30s/it, lr: 1.0e-04 loss: 5.629e-01]
a-cold-wall:  24%|##4       | 726/3000 [20:22<49:27,  1.30s/it, lr: 1.0e-04 loss: 1.609e-01]
a-cold-wall:  24%|##4       | 726/3000 [20:22<49:27,  1.30s/it, lr: 1.0e-04 loss: 1.609e-01]
a-cold-wall:  24%|##4       | 727/3000 [20:22<50:37,  1.34s/it, lr: 1.0e-04 loss: 1.609e-01]
a-cold-wall:  24%|##4       | 727/3000 [20:22<50:37,  1.34s/it, lr: 1.0e-04 loss: 1.609e-01]
a-cold-wall:  24%|##4       | 727/3000 [20:23<50:37,  1.34s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  24%|##4       | 727/3000 [20:23<50:37,  1.34s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  24%|##4       | 728/3000 [20:23<44:05,  1.16s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  24%|##4       | 728/3000 [20:23<44:05,  1.16s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  24%|##4       | 728/3000 [20:25<44:05,  1.16s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  24%|##4       | 728/3000 [20:25<44:05,  1.16s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  24%|##4       | 729/3000 [20:25<1:02:40,  1.66s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  24%|##4       | 729/3000 [20:25<1:02:40,  1.66s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  24%|##4       | 729/3000 [20:27<1:02:40,  1.66s/it, lr: 1.0e-04 loss: 2.947e-01]
a-cold-wall:  24%|##4       | 729/3000 [20:27<1:02:40,  1.66s/it, lr: 1.0e-04 loss: 2.947e-01]
a-cold-wall:  24%|##4       | 730/3000 [20:28<1:02:39,  1.66s/it, lr: 1.0e-04 loss: 2.052e-01]
a-cold-wall:  24%|##4       | 730/3000 [20:28<1:02:39,  1.66s/it, lr: 1.0e-04 loss: 2.052e-01]
a-cold-wall:  24%|##4       | 731/3000 [20:28<42:19,  1.12s/it, lr: 1.0e-04 loss: 2.052e-01]  
a-cold-wall:  24%|##4       | 731/3000 [20:28<42:19,  1.12s/it, lr: 1.0e-04 loss: 2.052e-01]  
a-cold-wall:  24%|##4       | 731/3000 [20:29<42:19,  1.12s/it, lr: 1.0e-04 loss: 3.988e-01]
a-cold-wall:  24%|##4       | 731/3000 [20:29<42:19,  1.12s/it, lr: 1.0e-04 loss: 3.988e-01]
a-cold-wall:  24%|##4       | 732/3000 [20:29<44:54,  1.19s/it, lr: 1.0e-04 loss: 3.988e-01]
a-cold-wall:  24%|##4       | 732/3000 [20:29<44:54,  1.19s/it, lr: 1.0e-04 loss: 3.988e-01]
a-cold-wall:  24%|##4       | 732/3000 [20:32<44:54,  1.19s/it, lr: 1.0e-04 loss: 6.517e-01]
a-cold-wall:  24%|##4       | 732/3000 [20:32<44:54,  1.19s/it, lr: 1.0e-04 loss: 6.517e-01]
a-cold-wall:  24%|##4       | 733/3000 [20:32<1:01:13,  1.62s/it, lr: 1.0e-04 loss: 6.517e-01]
a-cold-wall:  24%|##4       | 733/3000 [20:32<1:01:13,  1.62s/it, lr: 1.0e-04 loss: 6.517e-01]
a-cold-wall:  24%|##4       | 733/3000 [20:35<1:01:13,  1.62s/it, lr: 1.0e-04 loss: 4.569e-01]
a-cold-wall:  24%|##4       | 733/3000 [20:35<1:01:13,  1.62s/it, lr: 1.0e-04 loss: 4.569e-01]
a-cold-wall:  24%|##4       | 734/3000 [20:35<1:13:53,  1.96s/it, lr: 1.0e-04 loss: 4.569e-01]
a-cold-wall:  24%|##4       | 734/3000 [20:35<1:13:53,  1.96s/it, lr: 1.0e-04 loss: 4.569e-01]
a-cold-wall:  24%|##4       | 734/3000 [20:37<1:13:53,  1.96s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  24%|##4       | 734/3000 [20:37<1:13:53,  1.96s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  24%|##4       | 735/3000 [20:37<1:08:41,  1.82s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  24%|##4       | 735/3000 [20:37<1:08:41,  1.82s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  24%|##4       | 735/3000 [20:38<1:08:41,  1.82s/it, lr: 1.0e-04 loss: 1.869e-01]
a-cold-wall:  24%|##4       | 735/3000 [20:38<1:08:41,  1.82s/it, lr: 1.0e-04 loss: 1.869e-01]
a-cold-wall:  25%|##4       | 736/3000 [20:38<57:06,  1.51s/it, lr: 1.0e-04 loss: 1.869e-01]  
a-cold-wall:  25%|##4       | 736/3000 [20:38<57:06,  1.51s/it, lr: 1.0e-04 loss: 1.869e-01]  
a-cold-wall:  25%|##4       | 736/3000 [20:39<57:06,  1.51s/it, lr: 1.0e-04 loss: 2.016e-01]
a-cold-wall:  25%|##4       | 736/3000 [20:39<57:06,  1.51s/it, lr: 1.0e-04 loss: 2.016e-01]
a-cold-wall:  25%|##4       | 737/3000 [20:39<55:55,  1.48s/it, lr: 1.0e-04 loss: 2.016e-01]
a-cold-wall:  25%|##4       | 737/3000 [20:39<55:55,  1.48s/it, lr: 1.0e-04 loss: 2.016e-01]
a-cold-wall:  25%|##4       | 737/3000 [20:42<55:55,  1.48s/it, lr: 1.0e-04 loss: 6.504e-01]
a-cold-wall:  25%|##4       | 737/3000 [20:42<55:55,  1.48s/it, lr: 1.0e-04 loss: 6.504e-01]
a-cold-wall:  25%|##4       | 738/3000 [20:42<1:10:57,  1.88s/it, lr: 1.0e-04 loss: 6.504e-01]
a-cold-wall:  25%|##4       | 738/3000 [20:42<1:10:57,  1.88s/it, lr: 1.0e-04 loss: 6.504e-01]
a-cold-wall:  25%|##4       | 738/3000 [20:43<1:10:57,  1.88s/it, lr: 1.0e-04 loss: 7.708e-01]
a-cold-wall:  25%|##4       | 738/3000 [20:43<1:10:57,  1.88s/it, lr: 1.0e-04 loss: 7.708e-01]
a-cold-wall:  25%|##4       | 739/3000 [20:43<1:05:31,  1.74s/it, lr: 1.0e-04 loss: 7.708e-01]
a-cold-wall:  25%|##4       | 739/3000 [20:43<1:05:31,  1.74s/it, lr: 1.0e-04 loss: 7.708e-01]
a-cold-wall:  25%|##4       | 739/3000 [20:46<1:05:31,  1.74s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  25%|##4       | 739/3000 [20:46<1:05:31,  1.74s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  25%|##4       | 740/3000 [20:47<1:05:29,  1.74s/it, lr: 1.0e-04 loss: 7.265e-02]
a-cold-wall:  25%|##4       | 740/3000 [20:47<1:05:29,  1.74s/it, lr: 1.0e-04 loss: 7.265e-02]
a-cold-wall:  25%|##4       | 741/3000 [20:48<47:39,  1.27s/it, lr: 1.0e-04 loss: 7.265e-02]  
a-cold-wall:  25%|##4       | 741/3000 [20:48<47:39,  1.27s/it, lr: 1.0e-04 loss: 7.265e-02]  
a-cold-wall:  25%|##4       | 741/3000 [20:50<47:39,  1.27s/it, lr: 1.0e-04 loss: 2.197e-01]
a-cold-wall:  25%|##4       | 741/3000 [20:50<47:39,  1.27s/it, lr: 1.0e-04 loss: 2.197e-01]
a-cold-wall:  25%|##4       | 742/3000 [20:50<1:02:04,  1.65s/it, lr: 1.0e-04 loss: 2.197e-01]
a-cold-wall:  25%|##4       | 742/3000 [20:50<1:02:04,  1.65s/it, lr: 1.0e-04 loss: 2.197e-01]
a-cold-wall:  25%|##4       | 742/3000 [20:53<1:02:04,  1.65s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  25%|##4       | 742/3000 [20:53<1:02:04,  1.65s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  25%|##4       | 743/3000 [20:53<1:13:46,  1.96s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  25%|##4       | 743/3000 [20:53<1:13:46,  1.96s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  25%|##4       | 743/3000 [20:56<1:13:46,  1.96s/it, lr: 1.0e-04 loss: 1.597e-01]
a-cold-wall:  25%|##4       | 743/3000 [20:56<1:13:46,  1.96s/it, lr: 1.0e-04 loss: 1.597e-01]
a-cold-wall:  25%|##4       | 744/3000 [20:56<1:22:48,  2.20s/it, lr: 1.0e-04 loss: 1.597e-01]
a-cold-wall:  25%|##4       | 744/3000 [20:56<1:22:48,  2.20s/it, lr: 1.0e-04 loss: 1.597e-01]
a-cold-wall:  25%|##4       | 744/3000 [20:57<1:22:48,  2.20s/it, lr: 1.0e-04 loss: 5.183e-01]
a-cold-wall:  25%|##4       | 744/3000 [20:57<1:22:48,  2.20s/it, lr: 1.0e-04 loss: 5.183e-01]
a-cold-wall:  25%|##4       | 745/3000 [20:57<1:12:31,  1.93s/it, lr: 1.0e-04 loss: 5.183e-01]
a-cold-wall:  25%|##4       | 745/3000 [20:57<1:12:31,  1.93s/it, lr: 1.0e-04 loss: 5.183e-01]
a-cold-wall:  25%|##4       | 745/3000 [21:00<1:12:31,  1.93s/it, lr: 1.0e-04 loss: 2.575e-01]
a-cold-wall:  25%|##4       | 745/3000 [21:00<1:12:31,  1.93s/it, lr: 1.0e-04 loss: 2.575e-01]
a-cold-wall:  25%|##4       | 746/3000 [21:00<1:22:01,  2.18s/it, lr: 1.0e-04 loss: 2.575e-01]
a-cold-wall:  25%|##4       | 746/3000 [21:00<1:22:01,  2.18s/it, lr: 1.0e-04 loss: 2.575e-01]
a-cold-wall:  25%|##4       | 746/3000 [21:01<1:22:01,  2.18s/it, lr: 1.0e-04 loss: 3.309e-01]
a-cold-wall:  25%|##4       | 746/3000 [21:01<1:22:01,  2.18s/it, lr: 1.0e-04 loss: 3.309e-01]
a-cold-wall:  25%|##4       | 747/3000 [21:01<1:13:33,  1.96s/it, lr: 1.0e-04 loss: 3.309e-01]
a-cold-wall:  25%|##4       | 747/3000 [21:01<1:13:33,  1.96s/it, lr: 1.0e-04 loss: 3.309e-01]
a-cold-wall:  25%|##4       | 747/3000 [21:03<1:13:33,  1.96s/it, lr: 1.0e-04 loss: 6.672e-01]
a-cold-wall:  25%|##4       | 747/3000 [21:03<1:13:33,  1.96s/it, lr: 1.0e-04 loss: 6.672e-01]
a-cold-wall:  25%|##4       | 748/3000 [21:03<1:07:22,  1.80s/it, lr: 1.0e-04 loss: 6.672e-01]
a-cold-wall:  25%|##4       | 748/3000 [21:03<1:07:22,  1.80s/it, lr: 1.0e-04 loss: 6.672e-01]
a-cold-wall:  25%|##4       | 748/3000 [21:06<1:07:22,  1.80s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  25%|##4       | 748/3000 [21:06<1:07:22,  1.80s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  25%|##4       | 749/3000 [21:06<1:19:04,  2.11s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  25%|##4       | 749/3000 [21:06<1:19:04,  2.11s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  25%|##4       | 749/3000 [21:07<1:19:04,  2.11s/it, lr: 1.0e-04 loss: 6.797e-02]
a-cold-wall:  25%|##4       | 749/3000 [21:07<1:19:04,  2.11s/it, lr: 1.0e-04 loss: 6.797e-02]
Saving at step 750
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000000750.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt

a-cold-wall:  25%|##5       | 750/3000 [21:09<1:19:02,  2.11s/it, lr: 1.0e-04 loss: 5.977e-01]
a-cold-wall:  25%|##5       | 750/3000 [21:09<1:19:02,  2.11s/it, lr: 1.0e-04 loss: 5.977e-01]
a-cold-wall:  25%|##5       | 751/3000 [21:09<56:58,  1.52s/it, lr: 1.0e-04 loss: 5.977e-01]  
a-cold-wall:  25%|##5       | 751/3000 [21:09<56:58,  1.52s/it, lr: 1.0e-04 loss: 5.977e-01]  
a-cold-wall:  25%|##5       | 751/3000 [21:12<56:58,  1.52s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  25%|##5       | 751/3000 [21:12<56:58,  1.52s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  25%|##5       | 752/3000 [21:12<1:09:15,  1.85s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  25%|##5       | 752/3000 [21:12<1:09:15,  1.85s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  25%|##5       | 752/3000 [21:14<1:09:15,  1.85s/it, lr: 1.0e-04 loss: 5.399e-01]
a-cold-wall:  25%|##5       | 752/3000 [21:14<1:09:15,  1.85s/it, lr: 1.0e-04 loss: 5.399e-01]
a-cold-wall:  25%|##5       | 753/3000 [21:14<1:18:57,  2.11s/it, lr: 1.0e-04 loss: 5.399e-01]
a-cold-wall:  25%|##5       | 753/3000 [21:14<1:18:57,  2.11s/it, lr: 1.0e-04 loss: 5.399e-01]
a-cold-wall:  25%|##5       | 753/3000 [21:15<1:18:57,  2.11s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  25%|##5       | 753/3000 [21:15<1:18:57,  2.11s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  25%|##5       | 754/3000 [21:15<1:05:03,  1.74s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  25%|##5       | 754/3000 [21:15<1:05:03,  1.74s/it, lr: 1.0e-04 loss: 1.290e-01]
a-cold-wall:  25%|##5       | 754/3000 [21:17<1:05:03,  1.74s/it, lr: 1.0e-04 loss: 4.138e-01]
a-cold-wall:  25%|##5       | 754/3000 [21:17<1:05:03,  1.74s/it, lr: 1.0e-04 loss: 4.138e-01]
a-cold-wall:  25%|##5       | 755/3000 [21:17<1:01:31,  1.64s/it, lr: 1.0e-04 loss: 4.138e-01]
a-cold-wall:  25%|##5       | 755/3000 [21:17<1:01:31,  1.64s/it, lr: 1.0e-04 loss: 4.138e-01]
a-cold-wall:  25%|##5       | 755/3000 [21:18<1:01:31,  1.64s/it, lr: 1.0e-04 loss: 2.734e-01]
a-cold-wall:  25%|##5       | 755/3000 [21:18<1:01:31,  1.64s/it, lr: 1.0e-04 loss: 2.734e-01]
a-cold-wall:  25%|##5       | 756/3000 [21:18<59:02,  1.58s/it, lr: 1.0e-04 loss: 2.734e-01]  
a-cold-wall:  25%|##5       | 756/3000 [21:18<59:02,  1.58s/it, lr: 1.0e-04 loss: 2.734e-01]  
a-cold-wall:  25%|##5       | 756/3000 [21:19<59:02,  1.58s/it, lr: 1.0e-04 loss: 9.876e-02]
a-cold-wall:  25%|##5       | 756/3000 [21:19<59:02,  1.58s/it, lr: 1.0e-04 loss: 9.876e-02]
a-cold-wall:  25%|##5       | 757/3000 [21:19<57:04,  1.53s/it, lr: 1.0e-04 loss: 9.876e-02]
a-cold-wall:  25%|##5       | 757/3000 [21:19<57:04,  1.53s/it, lr: 1.0e-04 loss: 9.876e-02]
a-cold-wall:  25%|##5       | 757/3000 [21:20<57:04,  1.53s/it, lr: 1.0e-04 loss: 6.876e-01]
a-cold-wall:  25%|##5       | 757/3000 [21:20<57:04,  1.53s/it, lr: 1.0e-04 loss: 6.876e-01]
a-cold-wall:  25%|##5       | 758/3000 [21:20<48:29,  1.30s/it, lr: 1.0e-04 loss: 6.876e-01]
a-cold-wall:  25%|##5       | 758/3000 [21:20<48:29,  1.30s/it, lr: 1.0e-04 loss: 6.876e-01]
a-cold-wall:  25%|##5       | 758/3000 [21:23<48:29,  1.30s/it, lr: 1.0e-04 loss: 3.571e-01]
a-cold-wall:  25%|##5       | 758/3000 [21:23<48:29,  1.30s/it, lr: 1.0e-04 loss: 3.571e-01]
a-cold-wall:  25%|##5       | 759/3000 [21:23<1:05:39,  1.76s/it, lr: 1.0e-04 loss: 3.571e-01]
a-cold-wall:  25%|##5       | 759/3000 [21:23<1:05:39,  1.76s/it, lr: 1.0e-04 loss: 3.571e-01]
a-cold-wall:  25%|##5       | 759/3000 [21:24<1:05:39,  1.76s/it, lr: 1.0e-04 loss: 5.095e-01]
a-cold-wall:  25%|##5       | 759/3000 [21:24<1:05:39,  1.76s/it, lr: 1.0e-04 loss: 5.095e-01]
a-cold-wall:  25%|##5       | 760/3000 [21:25<1:05:37,  1.76s/it, lr: 1.0e-04 loss: 2.021e-01]
a-cold-wall:  25%|##5       | 760/3000 [21:25<1:05:37,  1.76s/it, lr: 1.0e-04 loss: 2.021e-01]
a-cold-wall:  25%|##5       | 761/3000 [21:25<41:45,  1.12s/it, lr: 1.0e-04 loss: 2.021e-01]  
a-cold-wall:  25%|##5       | 761/3000 [21:25<41:45,  1.12s/it, lr: 1.0e-04 loss: 2.021e-01]  
a-cold-wall:  25%|##5       | 761/3000 [21:28<41:45,  1.12s/it, lr: 1.0e-04 loss: 1.085e-01]
a-cold-wall:  25%|##5       | 761/3000 [21:28<41:45,  1.12s/it, lr: 1.0e-04 loss: 1.085e-01]
a-cold-wall:  25%|##5       | 762/3000 [21:28<57:26,  1.54s/it, lr: 1.0e-04 loss: 1.085e-01]
a-cold-wall:  25%|##5       | 762/3000 [21:28<57:26,  1.54s/it, lr: 1.0e-04 loss: 1.085e-01]
a-cold-wall:  25%|##5       | 762/3000 [21:30<57:26,  1.54s/it, lr: 1.0e-04 loss: 4.574e-01]
a-cold-wall:  25%|##5       | 762/3000 [21:30<57:26,  1.54s/it, lr: 1.0e-04 loss: 4.574e-01]
a-cold-wall:  25%|##5       | 763/3000 [21:30<57:42,  1.55s/it, lr: 1.0e-04 loss: 4.574e-01]
a-cold-wall:  25%|##5       | 763/3000 [21:30<57:42,  1.55s/it, lr: 1.0e-04 loss: 4.574e-01]
a-cold-wall:  25%|##5       | 763/3000 [21:31<57:42,  1.55s/it, lr: 1.0e-04 loss: 6.837e-01]
a-cold-wall:  25%|##5       | 763/3000 [21:31<57:42,  1.55s/it, lr: 1.0e-04 loss: 6.837e-01]
a-cold-wall:  25%|##5       | 764/3000 [21:31<56:21,  1.51s/it, lr: 1.0e-04 loss: 6.837e-01]
a-cold-wall:  25%|##5       | 764/3000 [21:31<56:21,  1.51s/it, lr: 1.0e-04 loss: 6.837e-01]
a-cold-wall:  25%|##5       | 764/3000 [21:32<56:21,  1.51s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  25%|##5       | 764/3000 [21:32<56:21,  1.51s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  26%|##5       | 765/3000 [21:32<48:14,  1.29s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  26%|##5       | 765/3000 [21:32<48:14,  1.29s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  26%|##5       | 765/3000 [21:33<48:14,  1.29s/it, lr: 1.0e-04 loss: 1.658e-01]
a-cold-wall:  26%|##5       | 765/3000 [21:33<48:14,  1.29s/it, lr: 1.0e-04 loss: 1.658e-01]
a-cold-wall:  26%|##5       | 766/3000 [21:33<50:35,  1.36s/it, lr: 1.0e-04 loss: 1.658e-01]
a-cold-wall:  26%|##5       | 766/3000 [21:33<50:35,  1.36s/it, lr: 1.0e-04 loss: 1.658e-01]
a-cold-wall:  26%|##5       | 766/3000 [21:34<50:35,  1.36s/it, lr: 1.0e-04 loss: 1.108e-01]
a-cold-wall:  26%|##5       | 766/3000 [21:34<50:35,  1.36s/it, lr: 1.0e-04 loss: 1.108e-01]
a-cold-wall:  26%|##5       | 767/3000 [21:34<43:51,  1.18s/it, lr: 1.0e-04 loss: 1.108e-01]
a-cold-wall:  26%|##5       | 767/3000 [21:34<43:51,  1.18s/it, lr: 1.0e-04 loss: 1.108e-01]
a-cold-wall:  26%|##5       | 767/3000 [21:37<43:51,  1.18s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:  26%|##5       | 767/3000 [21:37<43:51,  1.18s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:  26%|##5       | 768/3000 [21:37<1:01:47,  1.66s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:  26%|##5       | 768/3000 [21:37<1:01:47,  1.66s/it, lr: 1.0e-04 loss: 3.663e-01]
a-cold-wall:  26%|##5       | 768/3000 [21:38<1:01:47,  1.66s/it, lr: 1.0e-04 loss: 3.867e-01]
a-cold-wall:  26%|##5       | 768/3000 [21:38<1:01:47,  1.66s/it, lr: 1.0e-04 loss: 3.867e-01]
a-cold-wall:  26%|##5       | 769/3000 [21:38<51:42,  1.39s/it, lr: 1.0e-04 loss: 3.867e-01]  
a-cold-wall:  26%|##5       | 769/3000 [21:38<51:42,  1.39s/it, lr: 1.0e-04 loss: 3.867e-01]  
a-cold-wall:  26%|##5       | 769/3000 [21:38<51:42,  1.39s/it, lr: 1.0e-04 loss: 2.254e-01]
a-cold-wall:  26%|##5       | 769/3000 [21:38<51:42,  1.39s/it, lr: 1.0e-04 loss: 2.254e-01]
a-cold-wall:  26%|##5       | 770/3000 [21:40<51:41,  1.39s/it, lr: 1.0e-04 loss: 7.386e-01]
a-cold-wall:  26%|##5       | 770/3000 [21:40<51:41,  1.39s/it, lr: 1.0e-04 loss: 7.386e-01]
a-cold-wall:  26%|##5       | 771/3000 [21:40<39:57,  1.08s/it, lr: 1.0e-04 loss: 7.386e-01]
a-cold-wall:  26%|##5       | 771/3000 [21:40<39:57,  1.08s/it, lr: 1.0e-04 loss: 7.386e-01]
a-cold-wall:  26%|##5       | 771/3000 [21:40<39:57,  1.08s/it, lr: 1.0e-04 loss: 4.594e-01]
a-cold-wall:  26%|##5       | 771/3000 [21:40<39:57,  1.08s/it, lr: 1.0e-04 loss: 4.594e-01]
a-cold-wall:  26%|##5       | 772/3000 [21:40<37:01,  1.00it/s, lr: 1.0e-04 loss: 4.594e-01]
a-cold-wall:  26%|##5       | 772/3000 [21:40<37:01,  1.00it/s, lr: 1.0e-04 loss: 4.594e-01]
a-cold-wall:  26%|##5       | 772/3000 [21:42<37:01,  1.00it/s, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  26%|##5       | 772/3000 [21:42<37:01,  1.00it/s, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  26%|##5       | 773/3000 [21:42<41:01,  1.11s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  26%|##5       | 773/3000 [21:42<41:01,  1.11s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  26%|##5       | 773/3000 [21:43<41:01,  1.11s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  26%|##5       | 773/3000 [21:43<41:01,  1.11s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  26%|##5       | 774/3000 [21:43<44:15,  1.19s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  26%|##5       | 774/3000 [21:43<44:15,  1.19s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  26%|##5       | 774/3000 [21:46<44:15,  1.19s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  26%|##5       | 774/3000 [21:46<44:15,  1.19s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  26%|##5       | 775/3000 [21:46<1:01:27,  1.66s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  26%|##5       | 775/3000 [21:46<1:01:27,  1.66s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  26%|##5       | 775/3000 [21:48<1:01:27,  1.66s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  26%|##5       | 775/3000 [21:48<1:01:27,  1.66s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  26%|##5       | 776/3000 [21:48<58:41,  1.58s/it, lr: 1.0e-04 loss: 5.918e-01]  
a-cold-wall:  26%|##5       | 776/3000 [21:48<58:41,  1.58s/it, lr: 1.0e-04 loss: 5.918e-01]  
a-cold-wall:  26%|##5       | 776/3000 [21:49<58:41,  1.58s/it, lr: 1.0e-04 loss: 9.790e-02]
a-cold-wall:  26%|##5       | 776/3000 [21:49<58:41,  1.58s/it, lr: 1.0e-04 loss: 9.790e-02]
a-cold-wall:  26%|##5       | 777/3000 [21:49<58:33,  1.58s/it, lr: 1.0e-04 loss: 9.790e-02]
a-cold-wall:  26%|##5       | 777/3000 [21:49<58:33,  1.58s/it, lr: 1.0e-04 loss: 9.790e-02]
a-cold-wall:  26%|##5       | 777/3000 [21:50<58:33,  1.58s/it, lr: 1.0e-04 loss: 4.372e-02]
a-cold-wall:  26%|##5       | 777/3000 [21:50<58:33,  1.58s/it, lr: 1.0e-04 loss: 4.372e-02]
a-cold-wall:  26%|##5       | 778/3000 [21:50<49:30,  1.34s/it, lr: 1.0e-04 loss: 4.372e-02]
a-cold-wall:  26%|##5       | 778/3000 [21:50<49:30,  1.34s/it, lr: 1.0e-04 loss: 4.372e-02]
a-cold-wall:  26%|##5       | 778/3000 [21:53<49:30,  1.34s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  26%|##5       | 778/3000 [21:53<49:30,  1.34s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  26%|##5       | 779/3000 [21:53<1:06:08,  1.79s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  26%|##5       | 779/3000 [21:53<1:06:08,  1.79s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  26%|##5       | 779/3000 [21:54<1:06:08,  1.79s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:  26%|##5       | 779/3000 [21:54<1:06:08,  1.79s/it, lr: 1.0e-04 loss: 5.816e-01]
a-cold-wall:  26%|##6       | 780/3000 [21:57<1:06:06,  1.79s/it, lr: 1.0e-04 loss: 2.346e-01]
a-cold-wall:  26%|##6       | 780/3000 [21:57<1:06:06,  1.79s/it, lr: 1.0e-04 loss: 2.346e-01]
a-cold-wall:  26%|##6       | 781/3000 [21:57<59:52,  1.62s/it, lr: 1.0e-04 loss: 2.346e-01]  
a-cold-wall:  26%|##6       | 781/3000 [21:57<59:52,  1.62s/it, lr: 1.0e-04 loss: 2.346e-01]  
a-cold-wall:  26%|##6       | 781/3000 [21:58<59:52,  1.62s/it, lr: 1.0e-04 loss: 1.616e-01]
a-cold-wall:  26%|##6       | 781/3000 [21:58<59:52,  1.62s/it, lr: 1.0e-04 loss: 1.616e-01]
a-cold-wall:  26%|##6       | 782/3000 [21:58<51:49,  1.40s/it, lr: 1.0e-04 loss: 1.616e-01]
a-cold-wall:  26%|##6       | 782/3000 [21:58<51:49,  1.40s/it, lr: 1.0e-04 loss: 1.616e-01]
a-cold-wall:  26%|##6       | 782/3000 [21:58<51:49,  1.40s/it, lr: 1.0e-04 loss: 4.661e-01]
a-cold-wall:  26%|##6       | 782/3000 [21:58<51:49,  1.40s/it, lr: 1.0e-04 loss: 4.661e-01]
a-cold-wall:  26%|##6       | 783/3000 [21:58<45:36,  1.23s/it, lr: 1.0e-04 loss: 4.661e-01]
a-cold-wall:  26%|##6       | 783/3000 [21:58<45:36,  1.23s/it, lr: 1.0e-04 loss: 4.661e-01]
a-cold-wall:  26%|##6       | 783/3000 [22:01<45:36,  1.23s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  26%|##6       | 783/3000 [22:01<45:36,  1.23s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  26%|##6       | 784/3000 [22:01<1:01:41,  1.67s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  26%|##6       | 784/3000 [22:01<1:01:41,  1.67s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  26%|##6       | 784/3000 [22:03<1:01:41,  1.67s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  26%|##6       | 784/3000 [22:03<1:01:41,  1.67s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  26%|##6       | 785/3000 [22:03<59:17,  1.61s/it, lr: 1.0e-04 loss: 2.084e-01]  
a-cold-wall:  26%|##6       | 785/3000 [22:03<59:17,  1.61s/it, lr: 1.0e-04 loss: 2.084e-01]  
a-cold-wall:  26%|##6       | 785/3000 [22:04<59:17,  1.61s/it, lr: 1.0e-04 loss: 7.240e-01]
a-cold-wall:  26%|##6       | 785/3000 [22:04<59:17,  1.61s/it, lr: 1.0e-04 loss: 7.240e-01]
a-cold-wall:  26%|##6       | 786/3000 [22:04<57:10,  1.55s/it, lr: 1.0e-04 loss: 7.240e-01]
a-cold-wall:  26%|##6       | 786/3000 [22:04<57:10,  1.55s/it, lr: 1.0e-04 loss: 7.240e-01]
a-cold-wall:  26%|##6       | 786/3000 [22:05<57:10,  1.55s/it, lr: 1.0e-04 loss: 6.418e-01]
a-cold-wall:  26%|##6       | 786/3000 [22:05<57:10,  1.55s/it, lr: 1.0e-04 loss: 6.418e-01]
a-cold-wall:  26%|##6       | 787/3000 [22:05<48:44,  1.32s/it, lr: 1.0e-04 loss: 6.418e-01]
a-cold-wall:  26%|##6       | 787/3000 [22:05<48:44,  1.32s/it, lr: 1.0e-04 loss: 6.418e-01]
a-cold-wall:  26%|##6       | 787/3000 [22:06<48:44,  1.32s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  26%|##6       | 787/3000 [22:06<48:44,  1.32s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  26%|##6       | 788/3000 [22:06<42:32,  1.15s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  26%|##6       | 788/3000 [22:06<42:32,  1.15s/it, lr: 1.0e-04 loss: 1.646e-01]
a-cold-wall:  26%|##6       | 788/3000 [22:06<42:32,  1.15s/it, lr: 1.0e-04 loss: 7.853e-01]
a-cold-wall:  26%|##6       | 788/3000 [22:06<42:32,  1.15s/it, lr: 1.0e-04 loss: 7.853e-01]
a-cold-wall:  26%|##6       | 789/3000 [22:06<38:11,  1.04s/it, lr: 1.0e-04 loss: 7.853e-01]
a-cold-wall:  26%|##6       | 789/3000 [22:06<38:11,  1.04s/it, lr: 1.0e-04 loss: 7.853e-01]
a-cold-wall:  26%|##6       | 789/3000 [22:07<38:11,  1.04s/it, lr: 1.0e-04 loss: 6.103e-01]
a-cold-wall:  26%|##6       | 789/3000 [22:07<38:11,  1.04s/it, lr: 1.0e-04 loss: 6.103e-01]
a-cold-wall:  26%|##6       | 790/3000 [22:10<38:10,  1.04s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  26%|##6       | 790/3000 [22:10<38:10,  1.04s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  26%|##6       | 791/3000 [22:10<46:09,  1.25s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  26%|##6       | 791/3000 [22:10<46:09,  1.25s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  26%|##6       | 791/3000 [22:12<46:09,  1.25s/it, lr: 1.0e-04 loss: 3.809e-01]
a-cold-wall:  26%|##6       | 791/3000 [22:12<46:09,  1.25s/it, lr: 1.0e-04 loss: 3.809e-01]
a-cold-wall:  26%|##6       | 792/3000 [22:12<47:15,  1.28s/it, lr: 1.0e-04 loss: 3.809e-01]
a-cold-wall:  26%|##6       | 792/3000 [22:12<47:15,  1.28s/it, lr: 1.0e-04 loss: 3.809e-01]
a-cold-wall:  26%|##6       | 792/3000 [22:14<47:15,  1.28s/it, lr: 1.0e-04 loss: 1.613e-01]
a-cold-wall:  26%|##6       | 792/3000 [22:14<47:15,  1.28s/it, lr: 1.0e-04 loss: 1.613e-01]
a-cold-wall:  26%|##6       | 793/3000 [22:14<1:02:18,  1.69s/it, lr: 1.0e-04 loss: 1.613e-01]
a-cold-wall:  26%|##6       | 793/3000 [22:14<1:02:18,  1.69s/it, lr: 1.0e-04 loss: 1.613e-01]
a-cold-wall:  26%|##6       | 793/3000 [22:16<1:02:18,  1.69s/it, lr: 1.0e-04 loss: 4.668e-01]
a-cold-wall:  26%|##6       | 793/3000 [22:16<1:02:18,  1.69s/it, lr: 1.0e-04 loss: 4.668e-01]
a-cold-wall:  26%|##6       | 794/3000 [22:16<59:09,  1.61s/it, lr: 1.0e-04 loss: 4.668e-01]  
a-cold-wall:  26%|##6       | 794/3000 [22:16<59:09,  1.61s/it, lr: 1.0e-04 loss: 4.668e-01]  
a-cold-wall:  26%|##6       | 794/3000 [22:17<59:09,  1.61s/it, lr: 1.0e-04 loss: 4.188e-02]
a-cold-wall:  26%|##6       | 794/3000 [22:17<59:09,  1.61s/it, lr: 1.0e-04 loss: 4.188e-02]
a-cold-wall:  26%|##6       | 795/3000 [22:17<50:35,  1.38s/it, lr: 1.0e-04 loss: 4.188e-02]
a-cold-wall:  26%|##6       | 795/3000 [22:17<50:35,  1.38s/it, lr: 1.0e-04 loss: 4.188e-02]
a-cold-wall:  26%|##6       | 795/3000 [22:18<50:35,  1.38s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  26%|##6       | 795/3000 [22:18<50:35,  1.38s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  27%|##6       | 796/3000 [22:18<51:09,  1.39s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  27%|##6       | 796/3000 [22:18<51:09,  1.39s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  27%|##6       | 796/3000 [22:21<51:09,  1.39s/it, lr: 1.0e-04 loss: 3.069e-01]
a-cold-wall:  27%|##6       | 796/3000 [22:21<51:09,  1.39s/it, lr: 1.0e-04 loss: 3.069e-01]
a-cold-wall:  27%|##6       | 797/3000 [22:21<1:07:13,  1.83s/it, lr: 1.0e-04 loss: 3.069e-01]
a-cold-wall:  27%|##6       | 797/3000 [22:21<1:07:13,  1.83s/it, lr: 1.0e-04 loss: 3.069e-01]
a-cold-wall:  27%|##6       | 797/3000 [22:24<1:07:13,  1.83s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  27%|##6       | 797/3000 [22:24<1:07:13,  1.83s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  27%|##6       | 798/3000 [22:24<1:18:52,  2.15s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  27%|##6       | 798/3000 [22:24<1:18:52,  2.15s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  27%|##6       | 798/3000 [22:27<1:18:52,  2.15s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  27%|##6       | 798/3000 [22:27<1:18:52,  2.15s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  27%|##6       | 799/3000 [22:27<1:27:08,  2.38s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  27%|##6       | 799/3000 [22:27<1:27:08,  2.38s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  27%|##6       | 799/3000 [22:28<1:27:08,  2.38s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  27%|##6       | 799/3000 [22:28<1:27:08,  2.38s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  27%|##6       | 800/3000 [22:31<1:27:06,  2.38s/it, lr: 1.0e-04 loss: 4.170e-01]
a-cold-wall:  27%|##6       | 800/3000 [22:31<1:27:06,  2.38s/it, lr: 1.0e-04 loss: 4.170e-01]
a-cold-wall:  27%|##6       | 801/3000 [22:31<1:11:39,  1.96s/it, lr: 1.0e-04 loss: 4.170e-01]
a-cold-wall:  27%|##6       | 801/3000 [22:31<1:11:39,  1.96s/it, lr: 1.0e-04 loss: 4.170e-01]
a-cold-wall:  27%|##6       | 801/3000 [22:32<1:11:39,  1.96s/it, lr: 1.0e-04 loss: 5.312e-01]
a-cold-wall:  27%|##6       | 801/3000 [22:32<1:11:39,  1.96s/it, lr: 1.0e-04 loss: 5.312e-01]
a-cold-wall:  27%|##6       | 802/3000 [22:32<1:00:50,  1.66s/it, lr: 1.0e-04 loss: 5.312e-01]
a-cold-wall:  27%|##6       | 802/3000 [22:32<1:00:50,  1.66s/it, lr: 1.0e-04 loss: 5.312e-01]
a-cold-wall:  27%|##6       | 802/3000 [22:33<1:00:50,  1.66s/it, lr: 1.0e-04 loss: 1.068e-01]
a-cold-wall:  27%|##6       | 802/3000 [22:33<1:00:50,  1.66s/it, lr: 1.0e-04 loss: 1.068e-01]
a-cold-wall:  27%|##6       | 803/3000 [22:33<51:57,  1.42s/it, lr: 1.0e-04 loss: 1.068e-01]  
a-cold-wall:  27%|##6       | 803/3000 [22:33<51:57,  1.42s/it, lr: 1.0e-04 loss: 1.068e-01]  
a-cold-wall:  27%|##6       | 803/3000 [22:34<51:57,  1.42s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  27%|##6       | 803/3000 [22:34<51:57,  1.42s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  27%|##6       | 804/3000 [22:34<47:28,  1.30s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  27%|##6       | 804/3000 [22:34<47:28,  1.30s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  27%|##6       | 804/3000 [22:36<47:28,  1.30s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  27%|##6       | 804/3000 [22:36<47:28,  1.30s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  27%|##6       | 805/3000 [22:36<1:03:35,  1.74s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  27%|##6       | 805/3000 [22:36<1:03:35,  1.74s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  27%|##6       | 805/3000 [22:38<1:03:35,  1.74s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  27%|##6       | 805/3000 [22:38<1:03:35,  1.74s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  27%|##6       | 806/3000 [22:38<1:00:23,  1.65s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  27%|##6       | 806/3000 [22:38<1:00:23,  1.65s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  27%|##6       | 806/3000 [22:41<1:00:23,  1.65s/it, lr: 1.0e-04 loss: 2.536e-01]
a-cold-wall:  27%|##6       | 806/3000 [22:41<1:00:23,  1.65s/it, lr: 1.0e-04 loss: 2.536e-01]
a-cold-wall:  27%|##6       | 807/3000 [22:41<1:13:36,  2.01s/it, lr: 1.0e-04 loss: 2.536e-01]
a-cold-wall:  27%|##6       | 807/3000 [22:41<1:13:36,  2.01s/it, lr: 1.0e-04 loss: 2.536e-01]
a-cold-wall:  27%|##6       | 807/3000 [22:44<1:13:36,  2.01s/it, lr: 1.0e-04 loss: 1.657e-01]
a-cold-wall:  27%|##6       | 807/3000 [22:44<1:13:36,  2.01s/it, lr: 1.0e-04 loss: 1.657e-01]
a-cold-wall:  27%|##6       | 808/3000 [22:44<1:23:00,  2.27s/it, lr: 1.0e-04 loss: 1.657e-01]
a-cold-wall:  27%|##6       | 808/3000 [22:44<1:23:00,  2.27s/it, lr: 1.0e-04 loss: 1.657e-01]
a-cold-wall:  27%|##6       | 808/3000 [22:44<1:23:00,  2.27s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  27%|##6       | 808/3000 [22:44<1:23:00,  2.27s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  27%|##6       | 809/3000 [22:44<1:06:29,  1.82s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  27%|##6       | 809/3000 [22:44<1:06:29,  1.82s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  27%|##6       | 809/3000 [22:45<1:06:29,  1.82s/it, lr: 1.0e-04 loss: 4.182e-01]
a-cold-wall:  27%|##6       | 809/3000 [22:45<1:06:29,  1.82s/it, lr: 1.0e-04 loss: 4.182e-01]
a-cold-wall:  27%|##7       | 810/3000 [22:46<1:06:28,  1.82s/it, lr: 1.0e-04 loss: 3.255e-01]
a-cold-wall:  27%|##7       | 810/3000 [22:46<1:06:28,  1.82s/it, lr: 1.0e-04 loss: 3.255e-01]
a-cold-wall:  27%|##7       | 811/3000 [22:46<42:18,  1.16s/it, lr: 1.0e-04 loss: 3.255e-01]  
a-cold-wall:  27%|##7       | 811/3000 [22:46<42:18,  1.16s/it, lr: 1.0e-04 loss: 3.255e-01]  
a-cold-wall:  27%|##7       | 811/3000 [22:47<42:18,  1.16s/it, lr: 1.0e-04 loss: 3.115e-01]
a-cold-wall:  27%|##7       | 811/3000 [22:47<42:18,  1.16s/it, lr: 1.0e-04 loss: 3.115e-01]
a-cold-wall:  27%|##7       | 812/3000 [22:47<44:34,  1.22s/it, lr: 1.0e-04 loss: 3.115e-01]
a-cold-wall:  27%|##7       | 812/3000 [22:47<44:34,  1.22s/it, lr: 1.0e-04 loss: 3.115e-01]
a-cold-wall:  27%|##7       | 812/3000 [22:49<44:34,  1.22s/it, lr: 1.0e-04 loss: 7.195e-01]
a-cold-wall:  27%|##7       | 812/3000 [22:49<44:34,  1.22s/it, lr: 1.0e-04 loss: 7.195e-01]
a-cold-wall:  27%|##7       | 813/3000 [22:49<46:30,  1.28s/it, lr: 1.0e-04 loss: 7.195e-01]
a-cold-wall:  27%|##7       | 813/3000 [22:49<46:30,  1.28s/it, lr: 1.0e-04 loss: 7.195e-01]
a-cold-wall:  27%|##7       | 813/3000 [22:49<46:30,  1.28s/it, lr: 1.0e-04 loss: 3.395e-01]
a-cold-wall:  27%|##7       | 813/3000 [22:49<46:30,  1.28s/it, lr: 1.0e-04 loss: 3.395e-01]
a-cold-wall:  27%|##7       | 814/3000 [22:49<41:14,  1.13s/it, lr: 1.0e-04 loss: 3.395e-01]
a-cold-wall:  27%|##7       | 814/3000 [22:49<41:14,  1.13s/it, lr: 1.0e-04 loss: 3.395e-01]
a-cold-wall:  27%|##7       | 814/3000 [22:52<41:14,  1.13s/it, lr: 1.0e-04 loss: 2.001e-01]
a-cold-wall:  27%|##7       | 814/3000 [22:52<41:14,  1.13s/it, lr: 1.0e-04 loss: 2.001e-01]
a-cold-wall:  27%|##7       | 815/3000 [22:52<58:44,  1.61s/it, lr: 1.0e-04 loss: 2.001e-01]
a-cold-wall:  27%|##7       | 815/3000 [22:52<58:44,  1.61s/it, lr: 1.0e-04 loss: 2.001e-01]
a-cold-wall:  27%|##7       | 815/3000 [22:53<58:44,  1.61s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  27%|##7       | 815/3000 [22:53<58:44,  1.61s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  27%|##7       | 816/3000 [22:53<49:30,  1.36s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  27%|##7       | 816/3000 [22:53<49:30,  1.36s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  27%|##7       | 816/3000 [22:56<49:30,  1.36s/it, lr: 1.0e-04 loss: 1.527e-01]
a-cold-wall:  27%|##7       | 816/3000 [22:56<49:30,  1.36s/it, lr: 1.0e-04 loss: 1.527e-01]
a-cold-wall:  27%|##7       | 817/3000 [22:56<1:06:13,  1.82s/it, lr: 1.0e-04 loss: 1.527e-01]
a-cold-wall:  27%|##7       | 817/3000 [22:56<1:06:13,  1.82s/it, lr: 1.0e-04 loss: 1.527e-01]
a-cold-wall:  27%|##7       | 817/3000 [22:57<1:06:13,  1.82s/it, lr: 1.0e-04 loss: 7.059e-01]
a-cold-wall:  27%|##7       | 817/3000 [22:57<1:06:13,  1.82s/it, lr: 1.0e-04 loss: 7.059e-01]
a-cold-wall:  27%|##7       | 818/3000 [22:57<54:46,  1.51s/it, lr: 1.0e-04 loss: 7.059e-01]  
a-cold-wall:  27%|##7       | 818/3000 [22:57<54:46,  1.51s/it, lr: 1.0e-04 loss: 7.059e-01]  
a-cold-wall:  27%|##7       | 818/3000 [22:58<54:46,  1.51s/it, lr: 1.0e-04 loss: 7.808e-02]
a-cold-wall:  27%|##7       | 818/3000 [22:58<54:46,  1.51s/it, lr: 1.0e-04 loss: 7.808e-02]
a-cold-wall:  27%|##7       | 819/3000 [22:58<46:37,  1.28s/it, lr: 1.0e-04 loss: 7.808e-02]
a-cold-wall:  27%|##7       | 819/3000 [22:58<46:37,  1.28s/it, lr: 1.0e-04 loss: 7.808e-02]
a-cold-wall:  27%|##7       | 819/3000 [22:59<46:37,  1.28s/it, lr: 1.0e-04 loss: 2.456e-01]
a-cold-wall:  27%|##7       | 819/3000 [22:59<46:37,  1.28s/it, lr: 1.0e-04 loss: 2.456e-01]
a-cold-wall:  27%|##7       | 820/3000 [23:00<46:36,  1.28s/it, lr: 1.0e-04 loss: 5.635e-01]
a-cold-wall:  27%|##7       | 820/3000 [23:00<46:36,  1.28s/it, lr: 1.0e-04 loss: 5.635e-01]
a-cold-wall:  27%|##7       | 821/3000 [23:00<31:25,  1.16it/s, lr: 1.0e-04 loss: 5.635e-01]
a-cold-wall:  27%|##7       | 821/3000 [23:00<31:25,  1.16it/s, lr: 1.0e-04 loss: 5.635e-01]
a-cold-wall:  27%|##7       | 821/3000 [23:01<31:25,  1.16it/s, lr: 1.0e-04 loss: 6.487e-01]
a-cold-wall:  27%|##7       | 821/3000 [23:01<31:25,  1.16it/s, lr: 1.0e-04 loss: 6.487e-01]
a-cold-wall:  27%|##7       | 822/3000 [23:01<35:58,  1.01it/s, lr: 1.0e-04 loss: 6.487e-01]
a-cold-wall:  27%|##7       | 822/3000 [23:01<35:58,  1.01it/s, lr: 1.0e-04 loss: 6.487e-01]
a-cold-wall:  27%|##7       | 822/3000 [23:02<35:58,  1.01it/s, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  27%|##7       | 822/3000 [23:02<35:58,  1.01it/s, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  27%|##7       | 823/3000 [23:02<33:39,  1.08it/s, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  27%|##7       | 823/3000 [23:02<33:39,  1.08it/s, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  27%|##7       | 823/3000 [23:03<33:39,  1.08it/s, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  27%|##7       | 823/3000 [23:03<33:39,  1.08it/s, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  27%|##7       | 824/3000 [23:03<31:52,  1.14it/s, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  27%|##7       | 824/3000 [23:03<31:52,  1.14it/s, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  27%|##7       | 824/3000 [23:03<31:52,  1.14it/s, lr: 1.0e-04 loss: 1.378e-01]
a-cold-wall:  27%|##7       | 824/3000 [23:03<31:52,  1.14it/s, lr: 1.0e-04 loss: 1.378e-01]
a-cold-wall:  28%|##7       | 825/3000 [23:03<30:29,  1.19it/s, lr: 1.0e-04 loss: 1.378e-01]
a-cold-wall:  28%|##7       | 825/3000 [23:03<30:29,  1.19it/s, lr: 1.0e-04 loss: 1.378e-01]
a-cold-wall:  28%|##7       | 825/3000 [23:06<30:29,  1.19it/s, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  28%|##7       | 825/3000 [23:06<30:29,  1.19it/s, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  28%|##7       | 826/3000 [23:06<51:33,  1.42s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  28%|##7       | 826/3000 [23:06<51:33,  1.42s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  28%|##7       | 826/3000 [23:09<51:33,  1.42s/it, lr: 1.0e-04 loss: 1.143e-01]
a-cold-wall:  28%|##7       | 826/3000 [23:09<51:33,  1.42s/it, lr: 1.0e-04 loss: 1.143e-01]
a-cold-wall:  28%|##7       | 827/3000 [23:09<1:06:27,  1.83s/it, lr: 1.0e-04 loss: 1.143e-01]
a-cold-wall:  28%|##7       | 827/3000 [23:09<1:06:27,  1.83s/it, lr: 1.0e-04 loss: 1.143e-01]
a-cold-wall:  28%|##7       | 827/3000 [23:10<1:06:27,  1.83s/it, lr: 1.0e-04 loss: 6.981e-01]
a-cold-wall:  28%|##7       | 827/3000 [23:10<1:06:27,  1.83s/it, lr: 1.0e-04 loss: 6.981e-01]
a-cold-wall:  28%|##7       | 828/3000 [23:10<54:48,  1.51s/it, lr: 1.0e-04 loss: 6.981e-01]  
a-cold-wall:  28%|##7       | 828/3000 [23:10<54:48,  1.51s/it, lr: 1.0e-04 loss: 6.981e-01]  
a-cold-wall:  28%|##7       | 828/3000 [23:13<54:48,  1.51s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  28%|##7       | 828/3000 [23:13<54:48,  1.51s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  28%|##7       | 829/3000 [23:13<1:09:22,  1.92s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  28%|##7       | 829/3000 [23:13<1:09:22,  1.92s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  28%|##7       | 829/3000 [23:15<1:09:22,  1.92s/it, lr: 1.0e-04 loss: 3.006e-01]
a-cold-wall:  28%|##7       | 829/3000 [23:15<1:09:22,  1.92s/it, lr: 1.0e-04 loss: 3.006e-01]
a-cold-wall:  28%|##7       | 830/3000 [23:17<1:09:20,  1.92s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  28%|##7       | 830/3000 [23:17<1:09:20,  1.92s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  28%|##7       | 831/3000 [23:17<47:11,  1.31s/it, lr: 1.0e-04 loss: 4.876e-01]  
a-cold-wall:  28%|##7       | 831/3000 [23:17<47:11,  1.31s/it, lr: 1.0e-04 loss: 4.876e-01]  
a-cold-wall:  28%|##7       | 831/3000 [23:18<47:11,  1.31s/it, lr: 1.0e-04 loss: 7.290e-01]
a-cold-wall:  28%|##7       | 831/3000 [23:18<47:11,  1.31s/it, lr: 1.0e-04 loss: 7.290e-01]
a-cold-wall:  28%|##7       | 832/3000 [23:18<48:08,  1.33s/it, lr: 1.0e-04 loss: 7.290e-01]
a-cold-wall:  28%|##7       | 832/3000 [23:18<48:08,  1.33s/it, lr: 1.0e-04 loss: 7.290e-01]
a-cold-wall:  28%|##7       | 832/3000 [23:19<48:08,  1.33s/it, lr: 1.0e-04 loss: 3.737e-01]
a-cold-wall:  28%|##7       | 832/3000 [23:19<48:08,  1.33s/it, lr: 1.0e-04 loss: 3.737e-01]
a-cold-wall:  28%|##7       | 833/3000 [23:19<48:59,  1.36s/it, lr: 1.0e-04 loss: 3.737e-01]
a-cold-wall:  28%|##7       | 833/3000 [23:19<48:59,  1.36s/it, lr: 1.0e-04 loss: 3.737e-01]
a-cold-wall:  28%|##7       | 833/3000 [23:20<48:59,  1.36s/it, lr: 1.0e-04 loss: 7.506e-01]
a-cold-wall:  28%|##7       | 833/3000 [23:20<48:59,  1.36s/it, lr: 1.0e-04 loss: 7.506e-01]
a-cold-wall:  28%|##7       | 834/3000 [23:20<42:56,  1.19s/it, lr: 1.0e-04 loss: 7.506e-01]
a-cold-wall:  28%|##7       | 834/3000 [23:20<42:56,  1.19s/it, lr: 1.0e-04 loss: 7.506e-01]
a-cold-wall:  28%|##7       | 834/3000 [23:23<42:56,  1.19s/it, lr: 1.0e-04 loss: 4.665e-01]
a-cold-wall:  28%|##7       | 834/3000 [23:23<42:56,  1.19s/it, lr: 1.0e-04 loss: 4.665e-01]
a-cold-wall:  28%|##7       | 835/3000 [23:23<59:30,  1.65s/it, lr: 1.0e-04 loss: 4.665e-01]
a-cold-wall:  28%|##7       | 835/3000 [23:23<59:30,  1.65s/it, lr: 1.0e-04 loss: 4.665e-01]
a-cold-wall:  28%|##7       | 835/3000 [23:24<59:30,  1.65s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  28%|##7       | 835/3000 [23:24<59:30,  1.65s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  28%|##7       | 836/3000 [23:24<50:09,  1.39s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  28%|##7       | 836/3000 [23:24<50:09,  1.39s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  28%|##7       | 836/3000 [23:27<50:09,  1.39s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  28%|##7       | 836/3000 [23:27<50:09,  1.39s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  28%|##7       | 837/3000 [23:27<1:05:18,  1.81s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  28%|##7       | 837/3000 [23:27<1:05:18,  1.81s/it, lr: 1.0e-04 loss: 7.394e-02]
a-cold-wall:  28%|##7       | 837/3000 [23:30<1:05:18,  1.81s/it, lr: 1.0e-04 loss: 3.082e-01]
a-cold-wall:  28%|##7       | 837/3000 [23:30<1:05:18,  1.81s/it, lr: 1.0e-04 loss: 3.082e-01]
a-cold-wall:  28%|##7       | 838/3000 [23:30<1:16:31,  2.12s/it, lr: 1.0e-04 loss: 3.082e-01]
a-cold-wall:  28%|##7       | 838/3000 [23:30<1:16:31,  2.12s/it, lr: 1.0e-04 loss: 3.082e-01]
a-cold-wall:  28%|##7       | 838/3000 [23:30<1:16:31,  2.12s/it, lr: 1.0e-04 loss: 8.561e-02]
a-cold-wall:  28%|##7       | 838/3000 [23:30<1:16:31,  2.12s/it, lr: 1.0e-04 loss: 8.561e-02]
a-cold-wall:  28%|##7       | 839/3000 [23:30<1:01:45,  1.71s/it, lr: 1.0e-04 loss: 8.561e-02]
a-cold-wall:  28%|##7       | 839/3000 [23:30<1:01:45,  1.71s/it, lr: 1.0e-04 loss: 8.561e-02]
a-cold-wall:  28%|##7       | 839/3000 [23:34<1:01:45,  1.71s/it, lr: 1.0e-04 loss: 7.886e-02]
a-cold-wall:  28%|##7       | 839/3000 [23:34<1:01:45,  1.71s/it, lr: 1.0e-04 loss: 7.886e-02]
a-cold-wall:  28%|##8       | 840/3000 [23:35<1:01:43,  1.71s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  28%|##8       | 840/3000 [23:35<1:01:43,  1.71s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  28%|##8       | 841/3000 [23:35<45:22,  1.26s/it, lr: 1.0e-04 loss: 1.036e-01]  
a-cold-wall:  28%|##8       | 841/3000 [23:35<45:22,  1.26s/it, lr: 1.0e-04 loss: 1.036e-01]  
a-cold-wall:  28%|##8       | 841/3000 [23:38<45:22,  1.26s/it, lr: 1.0e-04 loss: 4.714e-01]
a-cold-wall:  28%|##8       | 841/3000 [23:38<45:22,  1.26s/it, lr: 1.0e-04 loss: 4.714e-01]
a-cold-wall:  28%|##8       | 842/3000 [23:38<59:48,  1.66s/it, lr: 1.0e-04 loss: 4.714e-01]
a-cold-wall:  28%|##8       | 842/3000 [23:38<59:48,  1.66s/it, lr: 1.0e-04 loss: 4.714e-01]
a-cold-wall:  28%|##8       | 842/3000 [23:41<59:48,  1.66s/it, lr: 1.0e-04 loss: 3.281e-01]
a-cold-wall:  28%|##8       | 842/3000 [23:41<59:48,  1.66s/it, lr: 1.0e-04 loss: 3.281e-01]
a-cold-wall:  28%|##8       | 843/3000 [23:41<1:11:01,  1.98s/it, lr: 1.0e-04 loss: 3.281e-01]
a-cold-wall:  28%|##8       | 843/3000 [23:41<1:11:01,  1.98s/it, lr: 1.0e-04 loss: 3.281e-01]
a-cold-wall:  28%|##8       | 843/3000 [23:42<1:11:01,  1.98s/it, lr: 1.0e-04 loss: 4.972e-01]
a-cold-wall:  28%|##8       | 843/3000 [23:42<1:11:01,  1.98s/it, lr: 1.0e-04 loss: 4.972e-01]
a-cold-wall:  28%|##8       | 844/3000 [23:42<1:05:34,  1.82s/it, lr: 1.0e-04 loss: 4.972e-01]
a-cold-wall:  28%|##8       | 844/3000 [23:42<1:05:34,  1.82s/it, lr: 1.0e-04 loss: 4.972e-01]
a-cold-wall:  28%|##8       | 844/3000 [23:45<1:05:34,  1.82s/it, lr: 1.0e-04 loss: 7.457e-01]
a-cold-wall:  28%|##8       | 844/3000 [23:45<1:05:34,  1.82s/it, lr: 1.0e-04 loss: 7.457e-01]
a-cold-wall:  28%|##8       | 845/3000 [23:45<1:17:40,  2.16s/it, lr: 1.0e-04 loss: 7.457e-01]
a-cold-wall:  28%|##8       | 845/3000 [23:45<1:17:40,  2.16s/it, lr: 1.0e-04 loss: 7.457e-01]
a-cold-wall:  28%|##8       | 845/3000 [23:46<1:17:40,  2.16s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  28%|##8       | 845/3000 [23:46<1:17:40,  2.16s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  28%|##8       | 846/3000 [23:46<1:03:08,  1.76s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  28%|##8       | 846/3000 [23:46<1:03:08,  1.76s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  28%|##8       | 846/3000 [23:49<1:03:08,  1.76s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  28%|##8       | 846/3000 [23:49<1:03:08,  1.76s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  28%|##8       | 847/3000 [23:49<1:14:34,  2.08s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  28%|##8       | 847/3000 [23:49<1:14:34,  2.08s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  28%|##8       | 847/3000 [23:50<1:14:34,  2.08s/it, lr: 1.0e-04 loss: 3.370e-01]
a-cold-wall:  28%|##8       | 847/3000 [23:50<1:14:34,  2.08s/it, lr: 1.0e-04 loss: 3.370e-01]
a-cold-wall:  28%|##8       | 848/3000 [23:50<1:00:33,  1.69s/it, lr: 1.0e-04 loss: 3.370e-01]
a-cold-wall:  28%|##8       | 848/3000 [23:50<1:00:33,  1.69s/it, lr: 1.0e-04 loss: 3.370e-01]
a-cold-wall:  28%|##8       | 848/3000 [23:51<1:00:33,  1.69s/it, lr: 1.0e-04 loss: 4.937e-02]
a-cold-wall:  28%|##8       | 848/3000 [23:51<1:00:33,  1.69s/it, lr: 1.0e-04 loss: 4.937e-02]
a-cold-wall:  28%|##8       | 849/3000 [23:51<57:47,  1.61s/it, lr: 1.0e-04 loss: 4.937e-02]  
a-cold-wall:  28%|##8       | 849/3000 [23:51<57:47,  1.61s/it, lr: 1.0e-04 loss: 4.937e-02]  
a-cold-wall:  28%|##8       | 849/3000 [23:52<57:47,  1.61s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  28%|##8       | 849/3000 [23:52<57:47,  1.61s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  28%|##8       | 850/3000 [23:53<57:45,  1.61s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  28%|##8       | 850/3000 [23:53<57:45,  1.61s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  28%|##8       | 851/3000 [23:53<37:25,  1.04s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  28%|##8       | 851/3000 [23:53<37:25,  1.04s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  28%|##8       | 851/3000 [23:53<37:25,  1.04s/it, lr: 1.0e-04 loss: 6.368e-01]
a-cold-wall:  28%|##8       | 851/3000 [23:53<37:25,  1.04s/it, lr: 1.0e-04 loss: 6.368e-01]
a-cold-wall:  28%|##8       | 852/3000 [23:53<34:53,  1.03it/s, lr: 1.0e-04 loss: 6.368e-01]
a-cold-wall:  28%|##8       | 852/3000 [23:53<34:53,  1.03it/s, lr: 1.0e-04 loss: 6.368e-01]
a-cold-wall:  28%|##8       | 852/3000 [23:54<34:53,  1.03it/s, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  28%|##8       | 852/3000 [23:54<34:53,  1.03it/s, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  28%|##8       | 853/3000 [23:54<32:42,  1.09it/s, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  28%|##8       | 853/3000 [23:54<32:42,  1.09it/s, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  28%|##8       | 853/3000 [23:55<32:42,  1.09it/s, lr: 1.0e-04 loss: 1.390e-01]
a-cold-wall:  28%|##8       | 853/3000 [23:55<32:42,  1.09it/s, lr: 1.0e-04 loss: 1.390e-01]
a-cold-wall:  28%|##8       | 854/3000 [23:55<31:19,  1.14it/s, lr: 1.0e-04 loss: 1.390e-01]
a-cold-wall:  28%|##8       | 854/3000 [23:55<31:19,  1.14it/s, lr: 1.0e-04 loss: 1.390e-01]
a-cold-wall:  28%|##8       | 854/3000 [23:58<31:19,  1.14it/s, lr: 1.0e-04 loss: 4.128e-01]
a-cold-wall:  28%|##8       | 854/3000 [23:58<31:19,  1.14it/s, lr: 1.0e-04 loss: 4.128e-01]
a-cold-wall:  28%|##8       | 855/3000 [23:58<51:34,  1.44s/it, lr: 1.0e-04 loss: 4.128e-01]
a-cold-wall:  28%|##8       | 855/3000 [23:58<51:34,  1.44s/it, lr: 1.0e-04 loss: 4.128e-01]
a-cold-wall:  28%|##8       | 855/3000 [23:59<51:34,  1.44s/it, lr: 1.0e-04 loss: 5.084e-01]
a-cold-wall:  28%|##8       | 855/3000 [23:59<51:34,  1.44s/it, lr: 1.0e-04 loss: 5.084e-01]
a-cold-wall:  29%|##8       | 856/3000 [23:59<45:18,  1.27s/it, lr: 1.0e-04 loss: 5.084e-01]
a-cold-wall:  29%|##8       | 856/3000 [23:59<45:18,  1.27s/it, lr: 1.0e-04 loss: 5.084e-01]
a-cold-wall:  29%|##8       | 856/3000 [23:59<45:18,  1.27s/it, lr: 1.0e-04 loss: 3.453e-01]
a-cold-wall:  29%|##8       | 856/3000 [23:59<45:18,  1.27s/it, lr: 1.0e-04 loss: 3.453e-01]
a-cold-wall:  29%|##8       | 857/3000 [23:59<39:54,  1.12s/it, lr: 1.0e-04 loss: 3.453e-01]
a-cold-wall:  29%|##8       | 857/3000 [23:59<39:54,  1.12s/it, lr: 1.0e-04 loss: 3.453e-01]
a-cold-wall:  29%|##8       | 857/3000 [24:02<39:54,  1.12s/it, lr: 1.0e-04 loss: 5.649e-01]
a-cold-wall:  29%|##8       | 857/3000 [24:02<39:54,  1.12s/it, lr: 1.0e-04 loss: 5.649e-01]
a-cold-wall:  29%|##8       | 858/3000 [24:02<58:10,  1.63s/it, lr: 1.0e-04 loss: 5.649e-01]
a-cold-wall:  29%|##8       | 858/3000 [24:02<58:10,  1.63s/it, lr: 1.0e-04 loss: 5.649e-01]
a-cold-wall:  29%|##8       | 858/3000 [24:03<58:10,  1.63s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  29%|##8       | 858/3000 [24:03<58:10,  1.63s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  29%|##8       | 859/3000 [24:03<51:14,  1.44s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  29%|##8       | 859/3000 [24:03<51:14,  1.44s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  29%|##8       | 859/3000 [24:04<51:14,  1.44s/it, lr: 1.0e-04 loss: 4.130e-01]
a-cold-wall:  29%|##8       | 859/3000 [24:04<51:14,  1.44s/it, lr: 1.0e-04 loss: 4.130e-01]
a-cold-wall:  29%|##8       | 860/3000 [24:05<51:13,  1.44s/it, lr: 1.0e-04 loss: 6.464e-01]
a-cold-wall:  29%|##8       | 860/3000 [24:05<51:13,  1.44s/it, lr: 1.0e-04 loss: 6.464e-01]
a-cold-wall:  29%|##8       | 861/3000 [24:05<33:53,  1.05it/s, lr: 1.0e-04 loss: 6.464e-01]
a-cold-wall:  29%|##8       | 861/3000 [24:05<33:53,  1.05it/s, lr: 1.0e-04 loss: 6.464e-01]
a-cold-wall:  29%|##8       | 861/3000 [24:06<33:53,  1.05it/s, lr: 1.0e-04 loss: 1.501e-01]
a-cold-wall:  29%|##8       | 861/3000 [24:06<33:53,  1.05it/s, lr: 1.0e-04 loss: 1.501e-01]
a-cold-wall:  29%|##8       | 862/3000 [24:06<38:02,  1.07s/it, lr: 1.0e-04 loss: 1.501e-01]
a-cold-wall:  29%|##8       | 862/3000 [24:06<38:02,  1.07s/it, lr: 1.0e-04 loss: 1.501e-01]
a-cold-wall:  29%|##8       | 862/3000 [24:08<38:02,  1.07s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  29%|##8       | 862/3000 [24:08<38:02,  1.07s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  29%|##8       | 863/3000 [24:08<41:32,  1.17s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  29%|##8       | 863/3000 [24:08<41:32,  1.17s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  29%|##8       | 863/3000 [24:09<41:32,  1.17s/it, lr: 1.0e-04 loss: 6.029e-01]
a-cold-wall:  29%|##8       | 863/3000 [24:09<41:32,  1.17s/it, lr: 1.0e-04 loss: 6.029e-01]
a-cold-wall:  29%|##8       | 864/3000 [24:09<43:55,  1.23s/it, lr: 1.0e-04 loss: 6.029e-01]
a-cold-wall:  29%|##8       | 864/3000 [24:09<43:55,  1.23s/it, lr: 1.0e-04 loss: 6.029e-01]
a-cold-wall:  29%|##8       | 864/3000 [24:12<43:55,  1.23s/it, lr: 1.0e-04 loss: 6.740e-02]
a-cold-wall:  29%|##8       | 864/3000 [24:12<43:55,  1.23s/it, lr: 1.0e-04 loss: 6.740e-02]
a-cold-wall:  29%|##8       | 865/3000 [24:12<1:00:27,  1.70s/it, lr: 1.0e-04 loss: 6.740e-02]
a-cold-wall:  29%|##8       | 865/3000 [24:12<1:00:27,  1.70s/it, lr: 1.0e-04 loss: 6.740e-02]
a-cold-wall:  29%|##8       | 865/3000 [24:13<1:00:27,  1.70s/it, lr: 1.0e-04 loss: 1.733e-01]
a-cold-wall:  29%|##8       | 865/3000 [24:13<1:00:27,  1.70s/it, lr: 1.0e-04 loss: 1.733e-01]
a-cold-wall:  29%|##8       | 866/3000 [24:13<50:43,  1.43s/it, lr: 1.0e-04 loss: 1.733e-01]  
a-cold-wall:  29%|##8       | 866/3000 [24:13<50:43,  1.43s/it, lr: 1.0e-04 loss: 1.733e-01]  
a-cold-wall:  29%|##8       | 866/3000 [24:14<50:43,  1.43s/it, lr: 1.0e-04 loss: 5.537e-01]
a-cold-wall:  29%|##8       | 866/3000 [24:14<50:43,  1.43s/it, lr: 1.0e-04 loss: 5.537e-01]
a-cold-wall:  29%|##8       | 867/3000 [24:14<50:36,  1.42s/it, lr: 1.0e-04 loss: 5.537e-01]
a-cold-wall:  29%|##8       | 867/3000 [24:14<50:36,  1.42s/it, lr: 1.0e-04 loss: 5.537e-01]
a-cold-wall:  29%|##8       | 867/3000 [24:15<50:36,  1.42s/it, lr: 1.0e-04 loss: 6.802e-01]
a-cold-wall:  29%|##8       | 867/3000 [24:15<50:36,  1.42s/it, lr: 1.0e-04 loss: 6.802e-01]
a-cold-wall:  29%|##8       | 868/3000 [24:15<43:34,  1.23s/it, lr: 1.0e-04 loss: 6.802e-01]
a-cold-wall:  29%|##8       | 868/3000 [24:15<43:34,  1.23s/it, lr: 1.0e-04 loss: 6.802e-01]
a-cold-wall:  29%|##8       | 868/3000 [24:16<43:34,  1.23s/it, lr: 1.0e-04 loss: 2.793e-01]
a-cold-wall:  29%|##8       | 868/3000 [24:16<43:34,  1.23s/it, lr: 1.0e-04 loss: 2.793e-01]
a-cold-wall:  29%|##8       | 869/3000 [24:16<45:36,  1.28s/it, lr: 1.0e-04 loss: 2.793e-01]
a-cold-wall:  29%|##8       | 869/3000 [24:16<45:36,  1.28s/it, lr: 1.0e-04 loss: 2.793e-01]
a-cold-wall:  29%|##8       | 869/3000 [24:17<45:36,  1.28s/it, lr: 1.0e-04 loss: 1.737e-01]
a-cold-wall:  29%|##8       | 869/3000 [24:17<45:36,  1.28s/it, lr: 1.0e-04 loss: 1.737e-01]
a-cold-wall:  29%|##9       | 870/3000 [24:18<45:35,  1.28s/it, lr: 1.0e-04 loss: 6.673e-01]
a-cold-wall:  29%|##9       | 870/3000 [24:18<45:35,  1.28s/it, lr: 1.0e-04 loss: 6.673e-01]
a-cold-wall:  29%|##9       | 871/3000 [24:18<36:17,  1.02s/it, lr: 1.0e-04 loss: 6.673e-01]
a-cold-wall:  29%|##9       | 871/3000 [24:18<36:17,  1.02s/it, lr: 1.0e-04 loss: 6.673e-01]
a-cold-wall:  29%|##9       | 871/3000 [24:21<36:17,  1.02s/it, lr: 1.0e-04 loss: 2.497e-02]
a-cold-wall:  29%|##9       | 871/3000 [24:21<36:17,  1.02s/it, lr: 1.0e-04 loss: 2.497e-02]
a-cold-wall:  29%|##9       | 872/3000 [24:21<54:02,  1.52s/it, lr: 1.0e-04 loss: 2.497e-02]
a-cold-wall:  29%|##9       | 872/3000 [24:21<54:02,  1.52s/it, lr: 1.0e-04 loss: 2.497e-02]
a-cold-wall:  29%|##9       | 872/3000 [24:23<54:02,  1.52s/it, lr: 1.0e-04 loss: 3.136e-01]
a-cold-wall:  29%|##9       | 872/3000 [24:23<54:02,  1.52s/it, lr: 1.0e-04 loss: 3.136e-01]
a-cold-wall:  29%|##9       | 873/3000 [24:23<53:09,  1.50s/it, lr: 1.0e-04 loss: 3.136e-01]
a-cold-wall:  29%|##9       | 873/3000 [24:23<53:09,  1.50s/it, lr: 1.0e-04 loss: 3.136e-01]
a-cold-wall:  29%|##9       | 873/3000 [24:24<53:09,  1.50s/it, lr: 1.0e-04 loss: 2.518e-02]
a-cold-wall:  29%|##9       | 873/3000 [24:24<53:09,  1.50s/it, lr: 1.0e-04 loss: 2.518e-02]
a-cold-wall:  29%|##9       | 874/3000 [24:24<52:26,  1.48s/it, lr: 1.0e-04 loss: 2.518e-02]
a-cold-wall:  29%|##9       | 874/3000 [24:24<52:26,  1.48s/it, lr: 1.0e-04 loss: 2.518e-02]
a-cold-wall:  29%|##9       | 874/3000 [24:27<52:26,  1.48s/it, lr: 1.0e-04 loss: 4.399e-01]
a-cold-wall:  29%|##9       | 874/3000 [24:27<52:26,  1.48s/it, lr: 1.0e-04 loss: 4.399e-01]
a-cold-wall:  29%|##9       | 875/3000 [24:27<1:06:09,  1.87s/it, lr: 1.0e-04 loss: 4.399e-01]
a-cold-wall:  29%|##9       | 875/3000 [24:27<1:06:09,  1.87s/it, lr: 1.0e-04 loss: 4.399e-01]
a-cold-wall:  29%|##9       | 875/3000 [24:30<1:06:09,  1.87s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  29%|##9       | 875/3000 [24:30<1:06:09,  1.87s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  29%|##9       | 876/3000 [24:30<1:16:38,  2.17s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  29%|##9       | 876/3000 [24:30<1:16:38,  2.17s/it, lr: 1.0e-04 loss: 1.046e-01]
a-cold-wall:  29%|##9       | 876/3000 [24:33<1:16:38,  2.17s/it, lr: 1.0e-04 loss: 4.584e-01]
a-cold-wall:  29%|##9       | 876/3000 [24:33<1:16:38,  2.17s/it, lr: 1.0e-04 loss: 4.584e-01]
a-cold-wall:  29%|##9       | 877/3000 [24:33<1:23:46,  2.37s/it, lr: 1.0e-04 loss: 4.584e-01]
a-cold-wall:  29%|##9       | 877/3000 [24:33<1:23:46,  2.37s/it, lr: 1.0e-04 loss: 4.584e-01]
a-cold-wall:  29%|##9       | 877/3000 [24:34<1:23:46,  2.37s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  29%|##9       | 877/3000 [24:34<1:23:46,  2.37s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  29%|##9       | 878/3000 [24:34<1:07:01,  1.90s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  29%|##9       | 878/3000 [24:34<1:07:01,  1.90s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  29%|##9       | 878/3000 [24:34<1:07:01,  1.90s/it, lr: 1.0e-04 loss: 3.905e-01]
a-cold-wall:  29%|##9       | 878/3000 [24:34<1:07:01,  1.90s/it, lr: 1.0e-04 loss: 3.905e-01]
a-cold-wall:  29%|##9       | 879/3000 [24:34<55:03,  1.56s/it, lr: 1.0e-04 loss: 3.905e-01]  
a-cold-wall:  29%|##9       | 879/3000 [24:34<55:03,  1.56s/it, lr: 1.0e-04 loss: 3.905e-01]  
a-cold-wall:  29%|##9       | 879/3000 [24:37<55:03,  1.56s/it, lr: 1.0e-04 loss: 8.350e-02]
a-cold-wall:  29%|##9       | 879/3000 [24:37<55:03,  1.56s/it, lr: 1.0e-04 loss: 8.350e-02]
a-cold-wall:  29%|##9       | 880/3000 [24:38<55:01,  1.56s/it, lr: 1.0e-04 loss: 2.177e-01]
a-cold-wall:  29%|##9       | 880/3000 [24:38<55:01,  1.56s/it, lr: 1.0e-04 loss: 2.177e-01]
a-cold-wall:  29%|##9       | 881/3000 [24:38<35:51,  1.02s/it, lr: 1.0e-04 loss: 2.177e-01]
a-cold-wall:  29%|##9       | 881/3000 [24:38<35:51,  1.02s/it, lr: 1.0e-04 loss: 2.177e-01]
a-cold-wall:  29%|##9       | 881/3000 [24:41<35:51,  1.02s/it, lr: 1.0e-04 loss: 2.378e-01]
a-cold-wall:  29%|##9       | 881/3000 [24:41<35:51,  1.02s/it, lr: 1.0e-04 loss: 2.378e-01]
a-cold-wall:  29%|##9       | 882/3000 [24:41<52:14,  1.48s/it, lr: 1.0e-04 loss: 2.378e-01]
a-cold-wall:  29%|##9       | 882/3000 [24:41<52:14,  1.48s/it, lr: 1.0e-04 loss: 2.378e-01]
a-cold-wall:  29%|##9       | 882/3000 [24:42<52:14,  1.48s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  29%|##9       | 882/3000 [24:42<52:14,  1.48s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  29%|##9       | 883/3000 [24:42<47:31,  1.35s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  29%|##9       | 883/3000 [24:42<47:31,  1.35s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  29%|##9       | 883/3000 [24:43<47:31,  1.35s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  29%|##9       | 883/3000 [24:43<47:31,  1.35s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  29%|##9       | 884/3000 [24:43<48:12,  1.37s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  29%|##9       | 884/3000 [24:43<48:12,  1.37s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  29%|##9       | 884/3000 [24:46<48:12,  1.37s/it, lr: 1.0e-04 loss: 1.757e-01]
a-cold-wall:  29%|##9       | 884/3000 [24:46<48:12,  1.37s/it, lr: 1.0e-04 loss: 1.757e-01]
a-cold-wall:  30%|##9       | 885/3000 [24:46<1:03:21,  1.80s/it, lr: 1.0e-04 loss: 1.757e-01]
a-cold-wall:  30%|##9       | 885/3000 [24:46<1:03:21,  1.80s/it, lr: 1.0e-04 loss: 1.757e-01]
a-cold-wall:  30%|##9       | 885/3000 [24:48<1:03:21,  1.80s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  30%|##9       | 885/3000 [24:48<1:03:21,  1.80s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  30%|##9       | 886/3000 [24:48<1:01:27,  1.74s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  30%|##9       | 886/3000 [24:48<1:01:27,  1.74s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  30%|##9       | 886/3000 [24:51<1:01:27,  1.74s/it, lr: 1.0e-04 loss: 4.426e-01]
a-cold-wall:  30%|##9       | 886/3000 [24:51<1:01:27,  1.74s/it, lr: 1.0e-04 loss: 4.426e-01]
a-cold-wall:  30%|##9       | 887/3000 [24:51<1:13:19,  2.08s/it, lr: 1.0e-04 loss: 4.426e-01]
a-cold-wall:  30%|##9       | 887/3000 [24:51<1:13:19,  2.08s/it, lr: 1.0e-04 loss: 4.426e-01]
a-cold-wall:  30%|##9       | 887/3000 [24:52<1:13:19,  2.08s/it, lr: 1.0e-04 loss: 6.567e-01]
a-cold-wall:  30%|##9       | 887/3000 [24:52<1:13:19,  2.08s/it, lr: 1.0e-04 loss: 6.567e-01]
a-cold-wall:  30%|##9       | 888/3000 [24:52<59:39,  1.69s/it, lr: 1.0e-04 loss: 6.567e-01]  
a-cold-wall:  30%|##9       | 888/3000 [24:52<59:39,  1.69s/it, lr: 1.0e-04 loss: 6.567e-01]  
a-cold-wall:  30%|##9       | 888/3000 [24:54<59:39,  1.69s/it, lr: 1.0e-04 loss: 5.550e-01]
a-cold-wall:  30%|##9       | 888/3000 [24:54<59:39,  1.69s/it, lr: 1.0e-04 loss: 5.550e-01]
a-cold-wall:  30%|##9       | 889/3000 [24:54<1:12:18,  2.06s/it, lr: 1.0e-04 loss: 5.550e-01]
a-cold-wall:  30%|##9       | 889/3000 [24:54<1:12:18,  2.06s/it, lr: 1.0e-04 loss: 5.550e-01]
a-cold-wall:  30%|##9       | 889/3000 [24:55<1:12:18,  2.06s/it, lr: 1.0e-04 loss: 6.531e-01]
a-cold-wall:  30%|##9       | 889/3000 [24:55<1:12:18,  2.06s/it, lr: 1.0e-04 loss: 6.531e-01]
a-cold-wall:  30%|##9       | 890/3000 [24:57<1:12:16,  2.06s/it, lr: 1.0e-04 loss: 6.449e-01]
a-cold-wall:  30%|##9       | 890/3000 [24:57<1:12:16,  2.06s/it, lr: 1.0e-04 loss: 6.449e-01]
a-cold-wall:  30%|##9       | 891/3000 [24:57<50:42,  1.44s/it, lr: 1.0e-04 loss: 6.449e-01]  
a-cold-wall:  30%|##9       | 891/3000 [24:57<50:42,  1.44s/it, lr: 1.0e-04 loss: 6.449e-01]  
a-cold-wall:  30%|##9       | 891/3000 [24:58<50:42,  1.44s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:  30%|##9       | 891/3000 [24:58<50:42,  1.44s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:  30%|##9       | 892/3000 [24:58<50:31,  1.44s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:  30%|##9       | 892/3000 [24:58<50:31,  1.44s/it, lr: 1.0e-04 loss: 3.896e-01]
a-cold-wall:  30%|##9       | 892/3000 [24:59<50:31,  1.44s/it, lr: 1.0e-04 loss: 1.645e-01]
a-cold-wall:  30%|##9       | 892/3000 [24:59<50:31,  1.44s/it, lr: 1.0e-04 loss: 1.645e-01]
a-cold-wall:  30%|##9       | 893/3000 [24:59<44:11,  1.26s/it, lr: 1.0e-04 loss: 1.645e-01]
a-cold-wall:  30%|##9       | 893/3000 [24:59<44:11,  1.26s/it, lr: 1.0e-04 loss: 1.645e-01]
a-cold-wall:  30%|##9       | 893/3000 [25:02<44:11,  1.26s/it, lr: 1.0e-04 loss: 2.179e-01]
a-cold-wall:  30%|##9       | 893/3000 [25:02<44:11,  1.26s/it, lr: 1.0e-04 loss: 2.179e-01]
a-cold-wall:  30%|##9       | 894/3000 [25:02<59:50,  1.70s/it, lr: 1.0e-04 loss: 2.179e-01]
a-cold-wall:  30%|##9       | 894/3000 [25:02<59:50,  1.70s/it, lr: 1.0e-04 loss: 2.179e-01]
a-cold-wall:  30%|##9       | 894/3000 [25:02<59:50,  1.70s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  30%|##9       | 894/3000 [25:02<59:50,  1.70s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  30%|##9       | 895/3000 [25:02<50:25,  1.44s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  30%|##9       | 895/3000 [25:02<50:25,  1.44s/it, lr: 1.0e-04 loss: 4.638e-01]
a-cold-wall:  30%|##9       | 895/3000 [25:03<50:25,  1.44s/it, lr: 1.0e-04 loss: 4.851e-01]
a-cold-wall:  30%|##9       | 895/3000 [25:03<50:25,  1.44s/it, lr: 1.0e-04 loss: 4.851e-01]
a-cold-wall:  30%|##9       | 896/3000 [25:03<43:38,  1.24s/it, lr: 1.0e-04 loss: 4.851e-01]
a-cold-wall:  30%|##9       | 896/3000 [25:03<43:38,  1.24s/it, lr: 1.0e-04 loss: 4.851e-01]
a-cold-wall:  30%|##9       | 896/3000 [25:05<43:38,  1.24s/it, lr: 1.0e-04 loss: 6.196e-02]
a-cold-wall:  30%|##9       | 896/3000 [25:05<43:38,  1.24s/it, lr: 1.0e-04 loss: 6.196e-02]
a-cold-wall:  30%|##9       | 897/3000 [25:05<45:34,  1.30s/it, lr: 1.0e-04 loss: 6.196e-02]
a-cold-wall:  30%|##9       | 897/3000 [25:05<45:34,  1.30s/it, lr: 1.0e-04 loss: 6.196e-02]
a-cold-wall:  30%|##9       | 897/3000 [25:06<45:34,  1.30s/it, lr: 1.0e-04 loss: 5.509e-01]
a-cold-wall:  30%|##9       | 897/3000 [25:06<45:34,  1.30s/it, lr: 1.0e-04 loss: 5.509e-01]
a-cold-wall:  30%|##9       | 898/3000 [25:06<46:51,  1.34s/it, lr: 1.0e-04 loss: 5.509e-01]
a-cold-wall:  30%|##9       | 898/3000 [25:06<46:51,  1.34s/it, lr: 1.0e-04 loss: 5.509e-01]
a-cold-wall:  30%|##9       | 898/3000 [25:08<46:51,  1.34s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  30%|##9       | 898/3000 [25:08<46:51,  1.34s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  30%|##9       | 899/3000 [25:08<48:55,  1.40s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  30%|##9       | 899/3000 [25:08<48:55,  1.40s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  30%|##9       | 899/3000 [25:09<48:55,  1.40s/it, lr: 1.0e-04 loss: 4.263e-01]
a-cold-wall:  30%|##9       | 899/3000 [25:09<48:55,  1.40s/it, lr: 1.0e-04 loss: 4.263e-01]
a-cold-wall:  30%|###       | 900/3000 [25:11<48:53,  1.40s/it, lr: 1.0e-04 loss: 5.962e-01]
a-cold-wall:  30%|###       | 900/3000 [25:11<48:53,  1.40s/it, lr: 1.0e-04 loss: 5.962e-01]
a-cold-wall:  30%|###       | 901/3000 [25:11<49:35,  1.42s/it, lr: 1.0e-04 loss: 5.962e-01]
a-cold-wall:  30%|###       | 901/3000 [25:11<49:35,  1.42s/it, lr: 1.0e-04 loss: 5.962e-01]
a-cold-wall:  30%|###       | 901/3000 [25:13<49:35,  1.42s/it, lr: 1.0e-04 loss: 6.274e-01]
a-cold-wall:  30%|###       | 901/3000 [25:13<49:35,  1.42s/it, lr: 1.0e-04 loss: 6.274e-01]
a-cold-wall:  30%|###       | 902/3000 [25:13<49:38,  1.42s/it, lr: 1.0e-04 loss: 6.274e-01]
a-cold-wall:  30%|###       | 902/3000 [25:13<49:38,  1.42s/it, lr: 1.0e-04 loss: 6.274e-01]
a-cold-wall:  30%|###       | 902/3000 [25:14<49:38,  1.42s/it, lr: 1.0e-04 loss: 3.729e-01]
a-cold-wall:  30%|###       | 902/3000 [25:14<49:38,  1.42s/it, lr: 1.0e-04 loss: 3.729e-01]
a-cold-wall:  30%|###       | 903/3000 [25:14<43:26,  1.24s/it, lr: 1.0e-04 loss: 3.729e-01]
a-cold-wall:  30%|###       | 903/3000 [25:14<43:26,  1.24s/it, lr: 1.0e-04 loss: 3.729e-01]
a-cold-wall:  30%|###       | 903/3000 [25:16<43:26,  1.24s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  30%|###       | 903/3000 [25:16<43:26,  1.24s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  30%|###       | 904/3000 [25:16<58:37,  1.68s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  30%|###       | 904/3000 [25:16<58:37,  1.68s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  30%|###       | 904/3000 [25:19<58:37,  1.68s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  30%|###       | 904/3000 [25:19<58:37,  1.68s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  30%|###       | 905/3000 [25:19<1:09:58,  2.00s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  30%|###       | 905/3000 [25:19<1:09:58,  2.00s/it, lr: 1.0e-04 loss: 4.857e-01]
a-cold-wall:  30%|###       | 905/3000 [25:22<1:09:58,  2.00s/it, lr: 1.0e-04 loss: 7.333e-01]
a-cold-wall:  30%|###       | 905/3000 [25:22<1:09:58,  2.00s/it, lr: 1.0e-04 loss: 7.333e-01]
a-cold-wall:  30%|###       | 906/3000 [25:22<1:18:17,  2.24s/it, lr: 1.0e-04 loss: 7.333e-01]
a-cold-wall:  30%|###       | 906/3000 [25:22<1:18:17,  2.24s/it, lr: 1.0e-04 loss: 7.333e-01]
a-cold-wall:  30%|###       | 906/3000 [25:23<1:18:17,  2.24s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  30%|###       | 906/3000 [25:23<1:18:17,  2.24s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  30%|###       | 907/3000 [25:23<1:03:08,  1.81s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  30%|###       | 907/3000 [25:23<1:03:08,  1.81s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  30%|###       | 907/3000 [25:24<1:03:08,  1.81s/it, lr: 1.0e-04 loss: 1.905e-02]
a-cold-wall:  30%|###       | 907/3000 [25:24<1:03:08,  1.81s/it, lr: 1.0e-04 loss: 1.905e-02]
a-cold-wall:  30%|###       | 908/3000 [25:24<58:59,  1.69s/it, lr: 1.0e-04 loss: 1.905e-02]  
a-cold-wall:  30%|###       | 908/3000 [25:24<58:59,  1.69s/it, lr: 1.0e-04 loss: 1.905e-02]  
a-cold-wall:  30%|###       | 908/3000 [25:27<58:59,  1.69s/it, lr: 1.0e-04 loss: 4.177e-01]
a-cold-wall:  30%|###       | 908/3000 [25:27<58:59,  1.69s/it, lr: 1.0e-04 loss: 4.177e-01]
a-cold-wall:  30%|###       | 909/3000 [25:27<1:11:03,  2.04s/it, lr: 1.0e-04 loss: 4.177e-01]
a-cold-wall:  30%|###       | 909/3000 [25:27<1:11:03,  2.04s/it, lr: 1.0e-04 loss: 4.177e-01]
a-cold-wall:  30%|###       | 909/3000 [25:30<1:11:03,  2.04s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  30%|###       | 909/3000 [25:30<1:11:03,  2.04s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  30%|###       | 910/3000 [25:31<1:11:01,  2.04s/it, lr: 1.0e-04 loss: 2.393e-01]
a-cold-wall:  30%|###       | 910/3000 [25:31<1:11:01,  2.04s/it, lr: 1.0e-04 loss: 2.393e-01]
a-cold-wall:  30%|###       | 911/3000 [25:31<49:46,  1.43s/it, lr: 1.0e-04 loss: 2.393e-01]  
a-cold-wall:  30%|###       | 911/3000 [25:31<49:46,  1.43s/it, lr: 1.0e-04 loss: 2.393e-01]  
a-cold-wall:  30%|###       | 911/3000 [25:34<49:46,  1.43s/it, lr: 1.0e-04 loss: 5.345e-01]
a-cold-wall:  30%|###       | 911/3000 [25:34<49:46,  1.43s/it, lr: 1.0e-04 loss: 5.345e-01]
a-cold-wall:  30%|###       | 912/3000 [25:34<1:01:51,  1.78s/it, lr: 1.0e-04 loss: 5.345e-01]
a-cold-wall:  30%|###       | 912/3000 [25:34<1:01:51,  1.78s/it, lr: 1.0e-04 loss: 5.345e-01]
a-cold-wall:  30%|###       | 912/3000 [25:35<1:01:51,  1.78s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  30%|###       | 912/3000 [25:35<1:01:51,  1.78s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  30%|###       | 913/3000 [25:35<54:35,  1.57s/it, lr: 1.0e-04 loss: 1.956e-01]  
a-cold-wall:  30%|###       | 913/3000 [25:35<54:35,  1.57s/it, lr: 1.0e-04 loss: 1.956e-01]  
a-cold-wall:  30%|###       | 913/3000 [25:38<54:35,  1.57s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  30%|###       | 913/3000 [25:38<54:35,  1.57s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  30%|###       | 914/3000 [25:38<1:06:48,  1.92s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  30%|###       | 914/3000 [25:38<1:06:48,  1.92s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  30%|###       | 914/3000 [25:41<1:06:48,  1.92s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  30%|###       | 914/3000 [25:41<1:06:48,  1.92s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  30%|###       | 915/3000 [25:41<1:15:56,  2.19s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  30%|###       | 915/3000 [25:41<1:15:56,  2.19s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  30%|###       | 915/3000 [25:42<1:15:56,  2.19s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  30%|###       | 915/3000 [25:42<1:15:56,  2.19s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  31%|###       | 916/3000 [25:42<1:08:17,  1.97s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  31%|###       | 916/3000 [25:42<1:08:17,  1.97s/it, lr: 1.0e-04 loss: 5.454e-01]
a-cold-wall:  31%|###       | 916/3000 [25:45<1:08:17,  1.97s/it, lr: 1.0e-04 loss: 5.372e-01]
a-cold-wall:  31%|###       | 916/3000 [25:45<1:08:17,  1.97s/it, lr: 1.0e-04 loss: 5.372e-01]
a-cold-wall:  31%|###       | 917/3000 [25:45<1:16:58,  2.22s/it, lr: 1.0e-04 loss: 5.372e-01]
a-cold-wall:  31%|###       | 917/3000 [25:45<1:16:58,  2.22s/it, lr: 1.0e-04 loss: 5.372e-01]
a-cold-wall:  31%|###       | 917/3000 [25:47<1:16:58,  2.22s/it, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  31%|###       | 917/3000 [25:47<1:16:58,  2.22s/it, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  31%|###       | 918/3000 [25:47<1:08:48,  1.98s/it, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  31%|###       | 918/3000 [25:47<1:08:48,  1.98s/it, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  31%|###       | 918/3000 [25:48<1:08:48,  1.98s/it, lr: 1.0e-04 loss: 6.481e-01]
a-cold-wall:  31%|###       | 918/3000 [25:48<1:08:48,  1.98s/it, lr: 1.0e-04 loss: 6.481e-01]
a-cold-wall:  31%|###       | 919/3000 [25:48<1:03:09,  1.82s/it, lr: 1.0e-04 loss: 6.481e-01]
a-cold-wall:  31%|###       | 919/3000 [25:48<1:03:09,  1.82s/it, lr: 1.0e-04 loss: 6.481e-01]
a-cold-wall:  31%|###       | 919/3000 [25:50<1:03:09,  1.82s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  31%|###       | 919/3000 [25:50<1:03:09,  1.82s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  31%|###       | 920/3000 [25:51<1:03:08,  1.82s/it, lr: 1.0e-04 loss: 9.828e-02]
a-cold-wall:  31%|###       | 920/3000 [25:51<1:03:08,  1.82s/it, lr: 1.0e-04 loss: 9.828e-02]
a-cold-wall:  31%|###       | 921/3000 [25:51<45:23,  1.31s/it, lr: 1.0e-04 loss: 9.828e-02]  
a-cold-wall:  31%|###       | 921/3000 [25:51<45:23,  1.31s/it, lr: 1.0e-04 loss: 9.828e-02]  
a-cold-wall:  31%|###       | 921/3000 [25:52<45:23,  1.31s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  31%|###       | 921/3000 [25:52<45:23,  1.31s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  31%|###       | 922/3000 [25:52<40:34,  1.17s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  31%|###       | 922/3000 [25:52<40:34,  1.17s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  31%|###       | 922/3000 [25:53<40:34,  1.17s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  31%|###       | 922/3000 [25:53<40:34,  1.17s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  31%|###       | 923/3000 [25:53<42:37,  1.23s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  31%|###       | 923/3000 [25:53<42:37,  1.23s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  31%|###       | 923/3000 [25:54<42:37,  1.23s/it, lr: 1.0e-04 loss: 4.079e-01]
a-cold-wall:  31%|###       | 923/3000 [25:54<42:37,  1.23s/it, lr: 1.0e-04 loss: 4.079e-01]
a-cold-wall:  31%|###       | 924/3000 [25:54<37:58,  1.10s/it, lr: 1.0e-04 loss: 4.079e-01]
a-cold-wall:  31%|###       | 924/3000 [25:54<37:58,  1.10s/it, lr: 1.0e-04 loss: 4.079e-01]
a-cold-wall:  31%|###       | 924/3000 [25:55<37:58,  1.10s/it, lr: 1.0e-04 loss: 5.949e-01]
a-cold-wall:  31%|###       | 924/3000 [25:55<37:58,  1.10s/it, lr: 1.0e-04 loss: 5.949e-01]
a-cold-wall:  31%|###       | 925/3000 [25:55<41:02,  1.19s/it, lr: 1.0e-04 loss: 5.949e-01]
a-cold-wall:  31%|###       | 925/3000 [25:55<41:02,  1.19s/it, lr: 1.0e-04 loss: 5.949e-01]
a-cold-wall:  31%|###       | 925/3000 [25:57<41:02,  1.19s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  31%|###       | 925/3000 [25:57<41:02,  1.19s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  31%|###       | 926/3000 [25:57<44:28,  1.29s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  31%|###       | 926/3000 [25:57<44:28,  1.29s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  31%|###       | 926/3000 [25:58<44:28,  1.29s/it, lr: 1.0e-04 loss: 5.128e-01]
a-cold-wall:  31%|###       | 926/3000 [25:58<44:28,  1.29s/it, lr: 1.0e-04 loss: 5.128e-01]
a-cold-wall:  31%|###       | 927/3000 [25:58<45:39,  1.32s/it, lr: 1.0e-04 loss: 5.128e-01]
a-cold-wall:  31%|###       | 927/3000 [25:58<45:39,  1.32s/it, lr: 1.0e-04 loss: 5.128e-01]
a-cold-wall:  31%|###       | 927/3000 [25:59<45:39,  1.32s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  31%|###       | 927/3000 [25:59<45:39,  1.32s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  31%|###       | 928/3000 [25:59<39:45,  1.15s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  31%|###       | 928/3000 [25:59<39:45,  1.15s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  31%|###       | 928/3000 [26:02<39:45,  1.15s/it, lr: 1.0e-04 loss: 4.826e-01]
a-cold-wall:  31%|###       | 928/3000 [26:02<39:45,  1.15s/it, lr: 1.0e-04 loss: 4.826e-01]
a-cold-wall:  31%|###       | 929/3000 [26:02<56:52,  1.65s/it, lr: 1.0e-04 loss: 4.826e-01]
a-cold-wall:  31%|###       | 929/3000 [26:02<56:52,  1.65s/it, lr: 1.0e-04 loss: 4.826e-01]
a-cold-wall:  31%|###       | 929/3000 [26:03<56:52,  1.65s/it, lr: 1.0e-04 loss: 2.935e-01]
a-cold-wall:  31%|###       | 929/3000 [26:03<56:52,  1.65s/it, lr: 1.0e-04 loss: 2.935e-01]
a-cold-wall:  31%|###1      | 930/3000 [26:06<56:51,  1.65s/it, lr: 1.0e-04 loss: 7.968e-02]
a-cold-wall:  31%|###1      | 930/3000 [26:06<56:51,  1.65s/it, lr: 1.0e-04 loss: 7.968e-02]
a-cold-wall:  31%|###1      | 931/3000 [26:06<53:27,  1.55s/it, lr: 1.0e-04 loss: 7.968e-02]
a-cold-wall:  31%|###1      | 931/3000 [26:06<53:27,  1.55s/it, lr: 1.0e-04 loss: 7.968e-02]
a-cold-wall:  31%|###1      | 931/3000 [26:07<53:27,  1.55s/it, lr: 1.0e-04 loss: 3.678e-01]
a-cold-wall:  31%|###1      | 931/3000 [26:07<53:27,  1.55s/it, lr: 1.0e-04 loss: 3.678e-01]
a-cold-wall:  31%|###1      | 932/3000 [26:07<52:19,  1.52s/it, lr: 1.0e-04 loss: 3.678e-01]
a-cold-wall:  31%|###1      | 932/3000 [26:07<52:19,  1.52s/it, lr: 1.0e-04 loss: 3.678e-01]
a-cold-wall:  31%|###1      | 932/3000 [26:08<52:19,  1.52s/it, lr: 1.0e-04 loss: 6.601e-01]
a-cold-wall:  31%|###1      | 932/3000 [26:08<52:19,  1.52s/it, lr: 1.0e-04 loss: 6.601e-01]
a-cold-wall:  31%|###1      | 933/3000 [26:08<45:23,  1.32s/it, lr: 1.0e-04 loss: 6.601e-01]
a-cold-wall:  31%|###1      | 933/3000 [26:08<45:23,  1.32s/it, lr: 1.0e-04 loss: 6.601e-01]
a-cold-wall:  31%|###1      | 933/3000 [26:09<45:23,  1.32s/it, lr: 1.0e-04 loss: 6.592e-01]
a-cold-wall:  31%|###1      | 933/3000 [26:09<45:23,  1.32s/it, lr: 1.0e-04 loss: 6.592e-01]
a-cold-wall:  31%|###1      | 934/3000 [26:09<40:02,  1.16s/it, lr: 1.0e-04 loss: 6.592e-01]
a-cold-wall:  31%|###1      | 934/3000 [26:09<40:02,  1.16s/it, lr: 1.0e-04 loss: 6.592e-01]
a-cold-wall:  31%|###1      | 934/3000 [26:10<40:02,  1.16s/it, lr: 1.0e-04 loss: 7.391e-01]
a-cold-wall:  31%|###1      | 934/3000 [26:10<40:02,  1.16s/it, lr: 1.0e-04 loss: 7.391e-01]
a-cold-wall:  31%|###1      | 935/3000 [26:10<42:25,  1.23s/it, lr: 1.0e-04 loss: 7.391e-01]
a-cold-wall:  31%|###1      | 935/3000 [26:10<42:25,  1.23s/it, lr: 1.0e-04 loss: 7.391e-01]
a-cold-wall:  31%|###1      | 935/3000 [26:13<42:25,  1.23s/it, lr: 1.0e-04 loss: 4.881e-01]
a-cold-wall:  31%|###1      | 935/3000 [26:13<42:25,  1.23s/it, lr: 1.0e-04 loss: 4.881e-01]
a-cold-wall:  31%|###1      | 936/3000 [26:13<58:28,  1.70s/it, lr: 1.0e-04 loss: 4.881e-01]
a-cold-wall:  31%|###1      | 936/3000 [26:13<58:28,  1.70s/it, lr: 1.0e-04 loss: 4.881e-01]
a-cold-wall:  31%|###1      | 936/3000 [26:14<58:28,  1.70s/it, lr: 1.0e-04 loss: 3.676e-01]
a-cold-wall:  31%|###1      | 936/3000 [26:14<58:28,  1.70s/it, lr: 1.0e-04 loss: 3.676e-01]
a-cold-wall:  31%|###1      | 937/3000 [26:14<55:43,  1.62s/it, lr: 1.0e-04 loss: 3.676e-01]
a-cold-wall:  31%|###1      | 937/3000 [26:14<55:43,  1.62s/it, lr: 1.0e-04 loss: 3.676e-01]
a-cold-wall:  31%|###1      | 937/3000 [26:15<55:43,  1.62s/it, lr: 1.0e-04 loss: 2.660e-01]
a-cold-wall:  31%|###1      | 937/3000 [26:15<55:43,  1.62s/it, lr: 1.0e-04 loss: 2.660e-01]
a-cold-wall:  31%|###1      | 938/3000 [26:15<47:09,  1.37s/it, lr: 1.0e-04 loss: 2.660e-01]
a-cold-wall:  31%|###1      | 938/3000 [26:15<47:09,  1.37s/it, lr: 1.0e-04 loss: 2.660e-01]
a-cold-wall:  31%|###1      | 938/3000 [26:18<47:09,  1.37s/it, lr: 1.0e-04 loss: 2.459e-01]
a-cold-wall:  31%|###1      | 938/3000 [26:18<47:09,  1.37s/it, lr: 1.0e-04 loss: 2.459e-01]
a-cold-wall:  31%|###1      | 939/3000 [26:18<1:02:25,  1.82s/it, lr: 1.0e-04 loss: 2.459e-01]
a-cold-wall:  31%|###1      | 939/3000 [26:18<1:02:25,  1.82s/it, lr: 1.0e-04 loss: 2.459e-01]
a-cold-wall:  31%|###1      | 939/3000 [26:21<1:02:25,  1.82s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  31%|###1      | 939/3000 [26:21<1:02:25,  1.82s/it, lr: 1.0e-04 loss: 4.738e-01]
a-cold-wall:  31%|###1      | 940/3000 [26:22<1:02:23,  1.82s/it, lr: 1.0e-04 loss: 4.949e-01]
a-cold-wall:  31%|###1      | 940/3000 [26:22<1:02:23,  1.82s/it, lr: 1.0e-04 loss: 4.949e-01]
a-cold-wall:  31%|###1      | 941/3000 [26:22<41:33,  1.21s/it, lr: 1.0e-04 loss: 4.949e-01]  
a-cold-wall:  31%|###1      | 941/3000 [26:22<41:33,  1.21s/it, lr: 1.0e-04 loss: 4.949e-01]  
a-cold-wall:  31%|###1      | 941/3000 [26:25<41:33,  1.21s/it, lr: 1.0e-04 loss: 4.896e-01]
a-cold-wall:  31%|###1      | 941/3000 [26:25<41:33,  1.21s/it, lr: 1.0e-04 loss: 4.896e-01]
a-cold-wall:  31%|###1      | 942/3000 [26:25<55:35,  1.62s/it, lr: 1.0e-04 loss: 4.896e-01]
a-cold-wall:  31%|###1      | 942/3000 [26:25<55:35,  1.62s/it, lr: 1.0e-04 loss: 4.896e-01]
a-cold-wall:  31%|###1      | 942/3000 [26:25<55:35,  1.62s/it, lr: 1.0e-04 loss: 2.126e-01]
a-cold-wall:  31%|###1      | 942/3000 [26:25<55:35,  1.62s/it, lr: 1.0e-04 loss: 2.126e-01]
a-cold-wall:  31%|###1      | 943/3000 [26:25<47:50,  1.40s/it, lr: 1.0e-04 loss: 2.126e-01]
a-cold-wall:  31%|###1      | 943/3000 [26:25<47:50,  1.40s/it, lr: 1.0e-04 loss: 2.126e-01]
a-cold-wall:  31%|###1      | 943/3000 [26:27<47:50,  1.40s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  31%|###1      | 943/3000 [26:27<47:50,  1.40s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  31%|###1      | 944/3000 [26:27<48:15,  1.41s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  31%|###1      | 944/3000 [26:27<48:15,  1.41s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  31%|###1      | 944/3000 [26:28<48:15,  1.41s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  31%|###1      | 944/3000 [26:28<48:15,  1.41s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  32%|###1      | 945/3000 [26:28<42:35,  1.24s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  32%|###1      | 945/3000 [26:28<42:35,  1.24s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  32%|###1      | 945/3000 [26:31<42:35,  1.24s/it, lr: 1.0e-04 loss: 6.011e-01]
a-cold-wall:  32%|###1      | 945/3000 [26:31<42:35,  1.24s/it, lr: 1.0e-04 loss: 6.011e-01]
a-cold-wall:  32%|###1      | 946/3000 [26:31<58:35,  1.71s/it, lr: 1.0e-04 loss: 6.011e-01]
a-cold-wall:  32%|###1      | 946/3000 [26:31<58:35,  1.71s/it, lr: 1.0e-04 loss: 6.011e-01]
a-cold-wall:  32%|###1      | 946/3000 [26:34<58:35,  1.71s/it, lr: 1.0e-04 loss: 4.504e-01]
a-cold-wall:  32%|###1      | 946/3000 [26:34<58:35,  1.71s/it, lr: 1.0e-04 loss: 4.504e-01]
a-cold-wall:  32%|###1      | 947/3000 [26:34<1:10:10,  2.05s/it, lr: 1.0e-04 loss: 4.504e-01]
a-cold-wall:  32%|###1      | 947/3000 [26:34<1:10:10,  2.05s/it, lr: 1.0e-04 loss: 4.504e-01]
a-cold-wall:  32%|###1      | 947/3000 [26:37<1:10:10,  2.05s/it, lr: 1.0e-04 loss: 3.351e-01]
a-cold-wall:  32%|###1      | 947/3000 [26:37<1:10:10,  2.05s/it, lr: 1.0e-04 loss: 3.351e-01]
a-cold-wall:  32%|###1      | 948/3000 [26:37<1:18:31,  2.30s/it, lr: 1.0e-04 loss: 3.351e-01]
a-cold-wall:  32%|###1      | 948/3000 [26:37<1:18:31,  2.30s/it, lr: 1.0e-04 loss: 3.351e-01]
a-cold-wall:  32%|###1      | 948/3000 [26:38<1:18:31,  2.30s/it, lr: 1.0e-04 loss: 6.585e-01]
a-cold-wall:  32%|###1      | 948/3000 [26:38<1:18:31,  2.30s/it, lr: 1.0e-04 loss: 6.585e-01]
a-cold-wall:  32%|###1      | 949/3000 [26:38<1:09:43,  2.04s/it, lr: 1.0e-04 loss: 6.585e-01]
a-cold-wall:  32%|###1      | 949/3000 [26:38<1:09:43,  2.04s/it, lr: 1.0e-04 loss: 6.585e-01]
a-cold-wall:  32%|###1      | 949/3000 [26:41<1:09:43,  2.04s/it, lr: 1.0e-04 loss: 4.141e-01]
a-cold-wall:  32%|###1      | 949/3000 [26:41<1:09:43,  2.04s/it, lr: 1.0e-04 loss: 4.141e-01]
a-cold-wall:  32%|###1      | 950/3000 [26:42<1:09:41,  2.04s/it, lr: 1.0e-04 loss: 5.520e-03]
a-cold-wall:  32%|###1      | 950/3000 [26:42<1:09:41,  2.04s/it, lr: 1.0e-04 loss: 5.520e-03]
a-cold-wall:  32%|###1      | 951/3000 [26:42<43:36,  1.28s/it, lr: 1.0e-04 loss: 5.520e-03]  
a-cold-wall:  32%|###1      | 951/3000 [26:42<43:36,  1.28s/it, lr: 1.0e-04 loss: 5.520e-03]  
a-cold-wall:  32%|###1      | 951/3000 [26:43<43:36,  1.28s/it, lr: 1.0e-04 loss: 4.505e-01]
a-cold-wall:  32%|###1      | 951/3000 [26:43<43:36,  1.28s/it, lr: 1.0e-04 loss: 4.505e-01]
a-cold-wall:  32%|###1      | 952/3000 [26:43<39:09,  1.15s/it, lr: 1.0e-04 loss: 4.505e-01]
a-cold-wall:  32%|###1      | 952/3000 [26:43<39:09,  1.15s/it, lr: 1.0e-04 loss: 4.505e-01]
a-cold-wall:  32%|###1      | 952/3000 [26:43<39:09,  1.15s/it, lr: 1.0e-04 loss: 4.954e-01]
a-cold-wall:  32%|###1      | 952/3000 [26:43<39:09,  1.15s/it, lr: 1.0e-04 loss: 4.954e-01]
a-cold-wall:  32%|###1      | 953/3000 [26:43<35:34,  1.04s/it, lr: 1.0e-04 loss: 4.954e-01]
a-cold-wall:  32%|###1      | 953/3000 [26:43<35:34,  1.04s/it, lr: 1.0e-04 loss: 4.954e-01]
a-cold-wall:  32%|###1      | 953/3000 [26:45<35:34,  1.04s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  32%|###1      | 953/3000 [26:45<35:34,  1.04s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  32%|###1      | 954/3000 [26:45<39:09,  1.15s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  32%|###1      | 954/3000 [26:45<39:09,  1.15s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  32%|###1      | 954/3000 [26:46<39:09,  1.15s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  32%|###1      | 954/3000 [26:46<39:09,  1.15s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  32%|###1      | 955/3000 [26:46<38:25,  1.13s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  32%|###1      | 955/3000 [26:46<38:25,  1.13s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  32%|###1      | 955/3000 [26:47<38:25,  1.13s/it, lr: 1.0e-04 loss: 8.918e-01]
a-cold-wall:  32%|###1      | 955/3000 [26:47<38:25,  1.13s/it, lr: 1.0e-04 loss: 8.918e-01]
a-cold-wall:  32%|###1      | 956/3000 [26:47<41:32,  1.22s/it, lr: 1.0e-04 loss: 8.918e-01]
a-cold-wall:  32%|###1      | 956/3000 [26:47<41:32,  1.22s/it, lr: 1.0e-04 loss: 8.918e-01]
a-cold-wall:  32%|###1      | 956/3000 [26:50<41:32,  1.22s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  32%|###1      | 956/3000 [26:50<41:32,  1.22s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  32%|###1      | 957/3000 [26:50<57:59,  1.70s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  32%|###1      | 957/3000 [26:50<57:59,  1.70s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  32%|###1      | 957/3000 [26:53<57:59,  1.70s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  32%|###1      | 957/3000 [26:53<57:59,  1.70s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  32%|###1      | 958/3000 [26:53<1:09:59,  2.06s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  32%|###1      | 958/3000 [26:53<1:09:59,  2.06s/it, lr: 1.0e-04 loss: 3.271e-01]
a-cold-wall:  32%|###1      | 958/3000 [26:54<1:09:59,  2.06s/it, lr: 1.0e-04 loss: 5.555e-02]
a-cold-wall:  32%|###1      | 958/3000 [26:54<1:09:59,  2.06s/it, lr: 1.0e-04 loss: 5.555e-02]
a-cold-wall:  32%|###1      | 959/3000 [26:54<56:53,  1.67s/it, lr: 1.0e-04 loss: 5.555e-02]  
a-cold-wall:  32%|###1      | 959/3000 [26:54<56:53,  1.67s/it, lr: 1.0e-04 loss: 5.555e-02]  
a-cold-wall:  32%|###1      | 959/3000 [26:55<56:53,  1.67s/it, lr: 1.0e-04 loss: 3.454e-01]
a-cold-wall:  32%|###1      | 959/3000 [26:55<56:53,  1.67s/it, lr: 1.0e-04 loss: 3.454e-01]
a-cold-wall:  32%|###2      | 960/3000 [26:56<56:51,  1.67s/it, lr: 1.0e-04 loss: 1.556e-01]
a-cold-wall:  32%|###2      | 960/3000 [26:56<56:51,  1.67s/it, lr: 1.0e-04 loss: 1.556e-01]
a-cold-wall:  32%|###2      | 961/3000 [26:56<36:47,  1.08s/it, lr: 1.0e-04 loss: 1.556e-01]
a-cold-wall:  32%|###2      | 961/3000 [26:56<36:47,  1.08s/it, lr: 1.0e-04 loss: 1.556e-01]
a-cold-wall:  32%|###2      | 961/3000 [26:59<36:47,  1.08s/it, lr: 1.0e-04 loss: 4.741e-01]
a-cold-wall:  32%|###2      | 961/3000 [26:59<36:47,  1.08s/it, lr: 1.0e-04 loss: 4.741e-01]
a-cold-wall:  32%|###2      | 962/3000 [26:59<51:47,  1.52s/it, lr: 1.0e-04 loss: 4.741e-01]
a-cold-wall:  32%|###2      | 962/3000 [26:59<51:47,  1.52s/it, lr: 1.0e-04 loss: 4.741e-01]
a-cold-wall:  32%|###2      | 962/3000 [27:00<51:47,  1.52s/it, lr: 1.0e-04 loss: 6.086e-01]
a-cold-wall:  32%|###2      | 962/3000 [27:00<51:47,  1.52s/it, lr: 1.0e-04 loss: 6.086e-01]
a-cold-wall:  32%|###2      | 963/3000 [27:00<50:57,  1.50s/it, lr: 1.0e-04 loss: 6.086e-01]
a-cold-wall:  32%|###2      | 963/3000 [27:00<50:57,  1.50s/it, lr: 1.0e-04 loss: 6.086e-01]
a-cold-wall:  32%|###2      | 963/3000 [27:03<50:57,  1.50s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  32%|###2      | 963/3000 [27:03<50:57,  1.50s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  32%|###2      | 964/3000 [27:03<1:03:36,  1.87s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  32%|###2      | 964/3000 [27:03<1:03:36,  1.87s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  32%|###2      | 964/3000 [27:04<1:03:36,  1.87s/it, lr: 1.0e-04 loss: 5.560e-01]
a-cold-wall:  32%|###2      | 964/3000 [27:04<1:03:36,  1.87s/it, lr: 1.0e-04 loss: 5.560e-01]
a-cold-wall:  32%|###2      | 965/3000 [27:04<52:59,  1.56s/it, lr: 1.0e-04 loss: 5.560e-01]  
a-cold-wall:  32%|###2      | 965/3000 [27:04<52:59,  1.56s/it, lr: 1.0e-04 loss: 5.560e-01]  
a-cold-wall:  32%|###2      | 965/3000 [27:05<52:59,  1.56s/it, lr: 1.0e-04 loss: 2.890e-01]
a-cold-wall:  32%|###2      | 965/3000 [27:05<52:59,  1.56s/it, lr: 1.0e-04 loss: 2.890e-01]
a-cold-wall:  32%|###2      | 966/3000 [27:05<45:20,  1.34s/it, lr: 1.0e-04 loss: 2.890e-01]
a-cold-wall:  32%|###2      | 966/3000 [27:05<45:20,  1.34s/it, lr: 1.0e-04 loss: 2.890e-01]
a-cold-wall:  32%|###2      | 966/3000 [27:08<45:20,  1.34s/it, lr: 1.0e-04 loss: 5.358e-01]
a-cold-wall:  32%|###2      | 966/3000 [27:08<45:20,  1.34s/it, lr: 1.0e-04 loss: 5.358e-01]
a-cold-wall:  32%|###2      | 967/3000 [27:08<1:00:42,  1.79s/it, lr: 1.0e-04 loss: 5.358e-01]
a-cold-wall:  32%|###2      | 967/3000 [27:08<1:00:42,  1.79s/it, lr: 1.0e-04 loss: 5.358e-01]
a-cold-wall:  32%|###2      | 967/3000 [27:09<1:00:42,  1.79s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  32%|###2      | 967/3000 [27:09<1:00:42,  1.79s/it, lr: 1.0e-04 loss: 3.861e-01]
a-cold-wall:  32%|###2      | 968/3000 [27:09<58:39,  1.73s/it, lr: 1.0e-04 loss: 3.861e-01]  
a-cold-wall:  32%|###2      | 968/3000 [27:09<58:39,  1.73s/it, lr: 1.0e-04 loss: 3.861e-01]  
a-cold-wall:  32%|###2      | 968/3000 [27:12<58:39,  1.73s/it, lr: 1.0e-04 loss: 9.127e-02]
a-cold-wall:  32%|###2      | 968/3000 [27:12<58:39,  1.73s/it, lr: 1.0e-04 loss: 9.127e-02]
a-cold-wall:  32%|###2      | 969/3000 [27:12<1:09:57,  2.07s/it, lr: 1.0e-04 loss: 9.127e-02]
a-cold-wall:  32%|###2      | 969/3000 [27:12<1:09:57,  2.07s/it, lr: 1.0e-04 loss: 9.127e-02]
a-cold-wall:  32%|###2      | 969/3000 [27:14<1:09:57,  2.07s/it, lr: 1.0e-04 loss: 3.998e-01]
a-cold-wall:  32%|###2      | 969/3000 [27:14<1:09:57,  2.07s/it, lr: 1.0e-04 loss: 3.998e-01]
a-cold-wall:  32%|###2      | 970/3000 [27:14<1:09:54,  2.07s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  32%|###2      | 970/3000 [27:14<1:09:54,  2.07s/it, lr: 1.0e-04 loss: 1.282e-01]
a-cold-wall:  32%|###2      | 971/3000 [27:14<43:50,  1.30s/it, lr: 1.0e-04 loss: 1.282e-01]  
a-cold-wall:  32%|###2      | 971/3000 [27:14<43:50,  1.30s/it, lr: 1.0e-04 loss: 1.282e-01]  
a-cold-wall:  32%|###2      | 971/3000 [27:15<43:50,  1.30s/it, lr: 1.0e-04 loss: 3.533e-01]
a-cold-wall:  32%|###2      | 971/3000 [27:15<43:50,  1.30s/it, lr: 1.0e-04 loss: 3.533e-01]
a-cold-wall:  32%|###2      | 972/3000 [27:15<39:12,  1.16s/it, lr: 1.0e-04 loss: 3.533e-01]
a-cold-wall:  32%|###2      | 972/3000 [27:15<39:12,  1.16s/it, lr: 1.0e-04 loss: 3.533e-01]
a-cold-wall:  32%|###2      | 972/3000 [27:18<39:12,  1.16s/it, lr: 1.0e-04 loss: 1.248e-01]
a-cold-wall:  32%|###2      | 972/3000 [27:18<39:12,  1.16s/it, lr: 1.0e-04 loss: 1.248e-01]
a-cold-wall:  32%|###2      | 973/3000 [27:18<54:26,  1.61s/it, lr: 1.0e-04 loss: 1.248e-01]
a-cold-wall:  32%|###2      | 973/3000 [27:18<54:26,  1.61s/it, lr: 1.0e-04 loss: 1.248e-01]
a-cold-wall:  32%|###2      | 973/3000 [27:21<54:26,  1.61s/it, lr: 1.0e-04 loss: 4.587e-01]
a-cold-wall:  32%|###2      | 973/3000 [27:21<54:26,  1.61s/it, lr: 1.0e-04 loss: 4.587e-01]
a-cold-wall:  32%|###2      | 974/3000 [27:21<1:05:48,  1.95s/it, lr: 1.0e-04 loss: 4.587e-01]
a-cold-wall:  32%|###2      | 974/3000 [27:21<1:05:48,  1.95s/it, lr: 1.0e-04 loss: 4.587e-01]
a-cold-wall:  32%|###2      | 974/3000 [27:22<1:05:48,  1.95s/it, lr: 1.0e-04 loss: 6.204e-01]
a-cold-wall:  32%|###2      | 974/3000 [27:22<1:05:48,  1.95s/it, lr: 1.0e-04 loss: 6.204e-01]
a-cold-wall:  32%|###2      | 975/3000 [27:22<1:00:47,  1.80s/it, lr: 1.0e-04 loss: 6.204e-01]
a-cold-wall:  32%|###2      | 975/3000 [27:22<1:00:47,  1.80s/it, lr: 1.0e-04 loss: 6.204e-01]
a-cold-wall:  32%|###2      | 975/3000 [27:24<1:00:47,  1.80s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  32%|###2      | 975/3000 [27:24<1:00:47,  1.80s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  33%|###2      | 976/3000 [27:24<56:40,  1.68s/it, lr: 1.0e-04 loss: 6.904e-01]  
a-cold-wall:  33%|###2      | 976/3000 [27:24<56:40,  1.68s/it, lr: 1.0e-04 loss: 6.904e-01]  
a-cold-wall:  33%|###2      | 976/3000 [27:25<56:40,  1.68s/it, lr: 1.0e-04 loss: 3.532e-01]
a-cold-wall:  33%|###2      | 976/3000 [27:25<56:40,  1.68s/it, lr: 1.0e-04 loss: 3.532e-01]
a-cold-wall:  33%|###2      | 977/3000 [27:25<49:42,  1.47s/it, lr: 1.0e-04 loss: 3.532e-01]
a-cold-wall:  33%|###2      | 977/3000 [27:25<49:42,  1.47s/it, lr: 1.0e-04 loss: 3.532e-01]
a-cold-wall:  33%|###2      | 977/3000 [27:26<49:42,  1.47s/it, lr: 1.0e-04 loss: 4.412e-01]
a-cold-wall:  33%|###2      | 977/3000 [27:26<49:42,  1.47s/it, lr: 1.0e-04 loss: 4.412e-01]
a-cold-wall:  33%|###2      | 978/3000 [27:26<49:05,  1.46s/it, lr: 1.0e-04 loss: 4.412e-01]
a-cold-wall:  33%|###2      | 978/3000 [27:26<49:05,  1.46s/it, lr: 1.0e-04 loss: 4.412e-01]
a-cold-wall:  33%|###2      | 978/3000 [27:27<49:05,  1.46s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  33%|###2      | 978/3000 [27:27<49:05,  1.46s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  33%|###2      | 979/3000 [27:27<41:58,  1.25s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  33%|###2      | 979/3000 [27:27<41:58,  1.25s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  33%|###2      | 979/3000 [27:27<41:58,  1.25s/it, lr: 1.0e-04 loss: 2.192e-01]
a-cold-wall:  33%|###2      | 979/3000 [27:27<41:58,  1.25s/it, lr: 1.0e-04 loss: 2.192e-01]
a-cold-wall:  33%|###2      | 980/3000 [27:30<41:57,  1.25s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:  33%|###2      | 980/3000 [27:30<41:57,  1.25s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:  33%|###2      | 981/3000 [27:30<45:21,  1.35s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:  33%|###2      | 981/3000 [27:30<45:21,  1.35s/it, lr: 1.0e-04 loss: 6.478e-01]
a-cold-wall:  33%|###2      | 981/3000 [27:32<45:21,  1.35s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  33%|###2      | 981/3000 [27:32<45:21,  1.35s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  33%|###2      | 982/3000 [27:32<45:57,  1.37s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  33%|###2      | 982/3000 [27:32<45:57,  1.37s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  33%|###2      | 982/3000 [27:33<45:57,  1.37s/it, lr: 1.0e-04 loss: 5.757e-01]
a-cold-wall:  33%|###2      | 982/3000 [27:33<45:57,  1.37s/it, lr: 1.0e-04 loss: 5.757e-01]
a-cold-wall:  33%|###2      | 983/3000 [27:33<46:25,  1.38s/it, lr: 1.0e-04 loss: 5.757e-01]
a-cold-wall:  33%|###2      | 983/3000 [27:33<46:25,  1.38s/it, lr: 1.0e-04 loss: 5.757e-01]
a-cold-wall:  33%|###2      | 983/3000 [27:34<46:25,  1.38s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  33%|###2      | 983/3000 [27:34<46:25,  1.38s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  33%|###2      | 984/3000 [27:34<40:35,  1.21s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  33%|###2      | 984/3000 [27:34<40:35,  1.21s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  33%|###2      | 984/3000 [27:35<40:35,  1.21s/it, lr: 1.0e-04 loss: 3.751e-01]
a-cold-wall:  33%|###2      | 984/3000 [27:35<40:35,  1.21s/it, lr: 1.0e-04 loss: 3.751e-01]
a-cold-wall:  33%|###2      | 985/3000 [27:35<42:33,  1.27s/it, lr: 1.0e-04 loss: 3.751e-01]
a-cold-wall:  33%|###2      | 985/3000 [27:35<42:33,  1.27s/it, lr: 1.0e-04 loss: 3.751e-01]
a-cold-wall:  33%|###2      | 985/3000 [27:36<42:33,  1.27s/it, lr: 1.0e-04 loss: 5.363e-01]
a-cold-wall:  33%|###2      | 985/3000 [27:36<42:33,  1.27s/it, lr: 1.0e-04 loss: 5.363e-01]
a-cold-wall:  33%|###2      | 986/3000 [27:36<37:27,  1.12s/it, lr: 1.0e-04 loss: 5.363e-01]
a-cold-wall:  33%|###2      | 986/3000 [27:36<37:27,  1.12s/it, lr: 1.0e-04 loss: 5.363e-01]
a-cold-wall:  33%|###2      | 986/3000 [27:39<37:27,  1.12s/it, lr: 1.0e-04 loss: 4.051e-01]
a-cold-wall:  33%|###2      | 986/3000 [27:39<37:27,  1.12s/it, lr: 1.0e-04 loss: 4.051e-01]
a-cold-wall:  33%|###2      | 987/3000 [27:39<54:12,  1.62s/it, lr: 1.0e-04 loss: 4.051e-01]
a-cold-wall:  33%|###2      | 987/3000 [27:39<54:12,  1.62s/it, lr: 1.0e-04 loss: 4.051e-01]
a-cold-wall:  33%|###2      | 987/3000 [27:40<54:12,  1.62s/it, lr: 1.0e-04 loss: 7.324e-02]
a-cold-wall:  33%|###2      | 987/3000 [27:40<54:12,  1.62s/it, lr: 1.0e-04 loss: 7.324e-02]
a-cold-wall:  33%|###2      | 988/3000 [27:40<45:41,  1.36s/it, lr: 1.0e-04 loss: 7.324e-02]
a-cold-wall:  33%|###2      | 988/3000 [27:40<45:41,  1.36s/it, lr: 1.0e-04 loss: 7.324e-02]
a-cold-wall:  33%|###2      | 988/3000 [27:43<45:41,  1.36s/it, lr: 1.0e-04 loss: 5.576e-01]
a-cold-wall:  33%|###2      | 988/3000 [27:43<45:41,  1.36s/it, lr: 1.0e-04 loss: 5.576e-01]
a-cold-wall:  33%|###2      | 989/3000 [27:43<1:00:39,  1.81s/it, lr: 1.0e-04 loss: 5.576e-01]
a-cold-wall:  33%|###2      | 989/3000 [27:43<1:00:39,  1.81s/it, lr: 1.0e-04 loss: 5.576e-01]
a-cold-wall:  33%|###2      | 989/3000 [27:45<1:00:39,  1.81s/it, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  33%|###2      | 989/3000 [27:45<1:00:39,  1.81s/it, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  33%|###3      | 990/3000 [27:47<1:00:37,  1.81s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  33%|###3      | 990/3000 [27:47<1:00:37,  1.81s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  33%|###3      | 991/3000 [27:47<43:54,  1.31s/it, lr: 1.0e-04 loss: 5.284e-01]  
a-cold-wall:  33%|###3      | 991/3000 [27:47<43:54,  1.31s/it, lr: 1.0e-04 loss: 5.284e-01]  
a-cold-wall:  33%|###3      | 991/3000 [27:48<43:54,  1.31s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  33%|###3      | 991/3000 [27:48<43:54,  1.31s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  33%|###3      | 992/3000 [27:48<44:45,  1.34s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  33%|###3      | 992/3000 [27:48<44:45,  1.34s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  33%|###3      | 992/3000 [27:51<44:45,  1.34s/it, lr: 1.0e-04 loss: 1.925e-01]
a-cold-wall:  33%|###3      | 992/3000 [27:51<44:45,  1.34s/it, lr: 1.0e-04 loss: 1.925e-01]
a-cold-wall:  33%|###3      | 993/3000 [27:51<58:08,  1.74s/it, lr: 1.0e-04 loss: 1.925e-01]
a-cold-wall:  33%|###3      | 993/3000 [27:51<58:08,  1.74s/it, lr: 1.0e-04 loss: 1.925e-01]
a-cold-wall:  33%|###3      | 993/3000 [27:52<58:08,  1.74s/it, lr: 1.0e-04 loss: 9.272e-02]
a-cold-wall:  33%|###3      | 993/3000 [27:52<58:08,  1.74s/it, lr: 1.0e-04 loss: 9.272e-02]
a-cold-wall:  33%|###3      | 994/3000 [27:52<49:03,  1.47s/it, lr: 1.0e-04 loss: 9.272e-02]
a-cold-wall:  33%|###3      | 994/3000 [27:52<49:03,  1.47s/it, lr: 1.0e-04 loss: 9.272e-02]
a-cold-wall:  33%|###3      | 994/3000 [27:53<49:03,  1.47s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  33%|###3      | 994/3000 [27:53<49:03,  1.47s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  33%|###3      | 995/3000 [27:53<48:29,  1.45s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  33%|###3      | 995/3000 [27:53<48:29,  1.45s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  33%|###3      | 995/3000 [27:54<48:29,  1.45s/it, lr: 1.0e-04 loss: 1.624e-01]
a-cold-wall:  33%|###3      | 995/3000 [27:54<48:29,  1.45s/it, lr: 1.0e-04 loss: 1.624e-01]
a-cold-wall:  33%|###3      | 996/3000 [27:54<43:58,  1.32s/it, lr: 1.0e-04 loss: 1.624e-01]
a-cold-wall:  33%|###3      | 996/3000 [27:54<43:58,  1.32s/it, lr: 1.0e-04 loss: 1.624e-01]
a-cold-wall:  33%|###3      | 996/3000 [27:55<43:58,  1.32s/it, lr: 1.0e-04 loss: 7.142e-01]
a-cold-wall:  33%|###3      | 996/3000 [27:55<43:58,  1.32s/it, lr: 1.0e-04 loss: 7.142e-01]
a-cold-wall:  33%|###3      | 997/3000 [27:55<38:24,  1.15s/it, lr: 1.0e-04 loss: 7.142e-01]
a-cold-wall:  33%|###3      | 997/3000 [27:55<38:24,  1.15s/it, lr: 1.0e-04 loss: 7.142e-01]
a-cold-wall:  33%|###3      | 997/3000 [27:58<38:24,  1.15s/it, lr: 1.0e-04 loss: 5.958e-01]
a-cold-wall:  33%|###3      | 997/3000 [27:58<38:24,  1.15s/it, lr: 1.0e-04 loss: 5.958e-01]
a-cold-wall:  33%|###3      | 998/3000 [27:58<55:22,  1.66s/it, lr: 1.0e-04 loss: 5.958e-01]
a-cold-wall:  33%|###3      | 998/3000 [27:58<55:22,  1.66s/it, lr: 1.0e-04 loss: 5.958e-01]
a-cold-wall:  33%|###3      | 998/3000 [27:59<55:22,  1.66s/it, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  33%|###3      | 998/3000 [27:59<55:22,  1.66s/it, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  33%|###3      | 999/3000 [27:59<46:21,  1.39s/it, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  33%|###3      | 999/3000 [27:59<46:21,  1.39s/it, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  33%|###3      | 999/3000 [28:00<46:21,  1.39s/it, lr: 1.0e-04 loss: 9.521e-02]
a-cold-wall:  33%|###3      | 999/3000 [28:00<46:21,  1.39s/it, lr: 1.0e-04 loss: 9.521e-02]
Saving at step 1000
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000001000.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt

a-cold-wall:  33%|###3      | 1000/3000 [28:03<46:19,  1.39s/it, lr: 1.0e-04 loss: 7.748e-01]
a-cold-wall:  33%|###3      | 1000/3000 [28:03<46:19,  1.39s/it, lr: 1.0e-04 loss: 7.748e-01]
a-cold-wall:  33%|###3      | 1001/3000 [28:03<48:30,  1.46s/it, lr: 1.0e-04 loss: 7.748e-01]
a-cold-wall:  33%|###3      | 1001/3000 [28:03<48:30,  1.46s/it, lr: 1.0e-04 loss: 7.748e-01]
a-cold-wall:  33%|###3      | 1001/3000 [28:05<48:30,  1.46s/it, lr: 1.0e-04 loss: 7.614e-01]
a-cold-wall:  33%|###3      | 1001/3000 [28:05<48:30,  1.46s/it, lr: 1.0e-04 loss: 7.614e-01]
a-cold-wall:  33%|###3      | 1002/3000 [28:05<48:12,  1.45s/it, lr: 1.0e-04 loss: 7.614e-01]
a-cold-wall:  33%|###3      | 1002/3000 [28:05<48:12,  1.45s/it, lr: 1.0e-04 loss: 7.614e-01]
a-cold-wall:  33%|###3      | 1002/3000 [28:08<48:12,  1.45s/it, lr: 1.0e-04 loss: 2.672e-01]
a-cold-wall:  33%|###3      | 1002/3000 [28:08<48:12,  1.45s/it, lr: 1.0e-04 loss: 2.672e-01]
a-cold-wall:  33%|###3      | 1003/3000 [28:08<1:00:37,  1.82s/it, lr: 1.0e-04 loss: 2.672e-01]
a-cold-wall:  33%|###3      | 1003/3000 [28:08<1:00:37,  1.82s/it, lr: 1.0e-04 loss: 2.672e-01]
a-cold-wall:  33%|###3      | 1003/3000 [28:08<1:00:37,  1.82s/it, lr: 1.0e-04 loss: 4.126e-01]
a-cold-wall:  33%|###3      | 1003/3000 [28:08<1:00:37,  1.82s/it, lr: 1.0e-04 loss: 4.126e-01]
a-cold-wall:  33%|###3      | 1004/3000 [28:08<50:55,  1.53s/it, lr: 1.0e-04 loss: 4.126e-01]  
a-cold-wall:  33%|###3      | 1004/3000 [28:08<50:55,  1.53s/it, lr: 1.0e-04 loss: 4.126e-01]  
a-cold-wall:  33%|###3      | 1004/3000 [28:09<50:55,  1.53s/it, lr: 1.0e-04 loss: 2.818e-02]
a-cold-wall:  33%|###3      | 1004/3000 [28:09<50:55,  1.53s/it, lr: 1.0e-04 loss: 2.818e-02]
a-cold-wall:  34%|###3      | 1005/3000 [28:09<43:38,  1.31s/it, lr: 1.0e-04 loss: 2.818e-02]
a-cold-wall:  34%|###3      | 1005/3000 [28:09<43:38,  1.31s/it, lr: 1.0e-04 loss: 2.818e-02]
a-cold-wall:  34%|###3      | 1005/3000 [28:10<43:38,  1.31s/it, lr: 1.0e-04 loss: 7.503e-01]
a-cold-wall:  34%|###3      | 1005/3000 [28:10<43:38,  1.31s/it, lr: 1.0e-04 loss: 7.503e-01]
a-cold-wall:  34%|###3      | 1006/3000 [28:10<44:33,  1.34s/it, lr: 1.0e-04 loss: 7.503e-01]
a-cold-wall:  34%|###3      | 1006/3000 [28:10<44:33,  1.34s/it, lr: 1.0e-04 loss: 7.503e-01]
a-cold-wall:  34%|###3      | 1006/3000 [28:13<44:33,  1.34s/it, lr: 1.0e-04 loss: 6.619e-02]
a-cold-wall:  34%|###3      | 1006/3000 [28:13<44:33,  1.34s/it, lr: 1.0e-04 loss: 6.619e-02]
a-cold-wall:  34%|###3      | 1007/3000 [28:13<59:07,  1.78s/it, lr: 1.0e-04 loss: 6.619e-02]
a-cold-wall:  34%|###3      | 1007/3000 [28:13<59:07,  1.78s/it, lr: 1.0e-04 loss: 6.619e-02]
a-cold-wall:  34%|###3      | 1007/3000 [28:16<59:07,  1.78s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  34%|###3      | 1007/3000 [28:16<59:07,  1.78s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  34%|###3      | 1008/3000 [28:16<1:09:46,  2.10s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  34%|###3      | 1008/3000 [28:16<1:09:46,  2.10s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  34%|###3      | 1008/3000 [28:18<1:09:46,  2.10s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  34%|###3      | 1008/3000 [28:18<1:09:46,  2.10s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  34%|###3      | 1009/3000 [28:18<1:03:20,  1.91s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  34%|###3      | 1009/3000 [28:18<1:03:20,  1.91s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  34%|###3      | 1009/3000 [28:20<1:03:20,  1.91s/it, lr: 1.0e-04 loss: 4.670e-01]
a-cold-wall:  34%|###3      | 1009/3000 [28:20<1:03:20,  1.91s/it, lr: 1.0e-04 loss: 4.670e-01]
a-cold-wall:  34%|###3      | 1010/3000 [28:21<1:03:18,  1.91s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  34%|###3      | 1010/3000 [28:21<1:03:18,  1.91s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  34%|###3      | 1011/3000 [28:21<40:03,  1.21s/it, lr: 1.0e-04 loss: 2.075e-01]  
a-cold-wall:  34%|###3      | 1011/3000 [28:21<40:03,  1.21s/it, lr: 1.0e-04 loss: 2.075e-01]  
a-cold-wall:  34%|###3      | 1011/3000 [28:22<40:03,  1.21s/it, lr: 1.0e-04 loss: 5.248e-01]
a-cold-wall:  34%|###3      | 1011/3000 [28:22<40:03,  1.21s/it, lr: 1.0e-04 loss: 5.248e-01]
a-cold-wall:  34%|###3      | 1012/3000 [28:22<36:16,  1.09s/it, lr: 1.0e-04 loss: 5.248e-01]
a-cold-wall:  34%|###3      | 1012/3000 [28:22<36:16,  1.09s/it, lr: 1.0e-04 loss: 5.248e-01]
a-cold-wall:  34%|###3      | 1012/3000 [28:24<36:16,  1.09s/it, lr: 1.0e-04 loss: 4.702e-02]
a-cold-wall:  34%|###3      | 1012/3000 [28:24<36:16,  1.09s/it, lr: 1.0e-04 loss: 4.702e-02]
a-cold-wall:  34%|###3      | 1013/3000 [28:24<40:37,  1.23s/it, lr: 1.0e-04 loss: 4.702e-02]
a-cold-wall:  34%|###3      | 1013/3000 [28:24<40:37,  1.23s/it, lr: 1.0e-04 loss: 4.702e-02]
a-cold-wall:  34%|###3      | 1013/3000 [28:24<40:37,  1.23s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  34%|###3      | 1013/3000 [28:24<40:37,  1.23s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  34%|###3      | 1014/3000 [28:24<36:19,  1.10s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  34%|###3      | 1014/3000 [28:24<36:19,  1.10s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  34%|###3      | 1014/3000 [28:25<36:19,  1.10s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  34%|###3      | 1014/3000 [28:25<36:19,  1.10s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  34%|###3      | 1015/3000 [28:25<33:10,  1.00s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  34%|###3      | 1015/3000 [28:25<33:10,  1.00s/it, lr: 1.0e-04 loss: 3.306e-01]
a-cold-wall:  34%|###3      | 1015/3000 [28:26<33:10,  1.00s/it, lr: 1.0e-04 loss: 5.664e-01]
a-cold-wall:  34%|###3      | 1015/3000 [28:26<33:10,  1.00s/it, lr: 1.0e-04 loss: 5.664e-01]
a-cold-wall:  34%|###3      | 1016/3000 [28:26<30:46,  1.07it/s, lr: 1.0e-04 loss: 5.664e-01]
a-cold-wall:  34%|###3      | 1016/3000 [28:26<30:46,  1.07it/s, lr: 1.0e-04 loss: 5.664e-01]
a-cold-wall:  34%|###3      | 1016/3000 [28:29<30:46,  1.07it/s, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  34%|###3      | 1016/3000 [28:29<30:46,  1.07it/s, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  34%|###3      | 1017/3000 [28:29<49:22,  1.49s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  34%|###3      | 1017/3000 [28:29<49:22,  1.49s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  34%|###3      | 1017/3000 [28:30<49:22,  1.49s/it, lr: 1.0e-04 loss: 3.955e-01]
a-cold-wall:  34%|###3      | 1017/3000 [28:30<49:22,  1.49s/it, lr: 1.0e-04 loss: 3.955e-01]
a-cold-wall:  34%|###3      | 1018/3000 [28:30<48:46,  1.48s/it, lr: 1.0e-04 loss: 3.955e-01]
a-cold-wall:  34%|###3      | 1018/3000 [28:30<48:46,  1.48s/it, lr: 1.0e-04 loss: 3.955e-01]
a-cold-wall:  34%|###3      | 1018/3000 [28:32<48:46,  1.48s/it, lr: 1.0e-04 loss: 9.812e-02]
a-cold-wall:  34%|###3      | 1018/3000 [28:32<48:46,  1.48s/it, lr: 1.0e-04 loss: 9.812e-02]
a-cold-wall:  34%|###3      | 1019/3000 [28:32<47:55,  1.45s/it, lr: 1.0e-04 loss: 9.812e-02]
a-cold-wall:  34%|###3      | 1019/3000 [28:32<47:55,  1.45s/it, lr: 1.0e-04 loss: 9.812e-02]
a-cold-wall:  34%|###3      | 1019/3000 [28:34<47:55,  1.45s/it, lr: 1.0e-04 loss: 2.981e-01]
a-cold-wall:  34%|###3      | 1019/3000 [28:34<47:55,  1.45s/it, lr: 1.0e-04 loss: 2.981e-01]
a-cold-wall:  34%|###4      | 1020/3000 [28:35<47:54,  1.45s/it, lr: 1.0e-04 loss: 1.668e-01]
a-cold-wall:  34%|###4      | 1020/3000 [28:35<47:54,  1.45s/it, lr: 1.0e-04 loss: 1.668e-01]
a-cold-wall:  34%|###4      | 1021/3000 [28:35<31:47,  1.04it/s, lr: 1.0e-04 loss: 1.668e-01]
a-cold-wall:  34%|###4      | 1021/3000 [28:35<31:47,  1.04it/s, lr: 1.0e-04 loss: 1.668e-01]
a-cold-wall:  34%|###4      | 1021/3000 [28:37<31:47,  1.04it/s, lr: 1.0e-04 loss: 4.945e-01]
a-cold-wall:  34%|###4      | 1021/3000 [28:37<31:47,  1.04it/s, lr: 1.0e-04 loss: 4.945e-01]
a-cold-wall:  34%|###4      | 1022/3000 [28:37<35:33,  1.08s/it, lr: 1.0e-04 loss: 4.945e-01]
a-cold-wall:  34%|###4      | 1022/3000 [28:37<35:33,  1.08s/it, lr: 1.0e-04 loss: 4.945e-01]
a-cold-wall:  34%|###4      | 1022/3000 [28:38<35:33,  1.08s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  34%|###4      | 1022/3000 [28:38<35:33,  1.08s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  34%|###4      | 1023/3000 [28:38<34:43,  1.05s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  34%|###4      | 1023/3000 [28:38<34:43,  1.05s/it, lr: 1.0e-04 loss: 5.880e-01]
a-cold-wall:  34%|###4      | 1023/3000 [28:39<34:43,  1.05s/it, lr: 1.0e-04 loss: 1.126e-01]
a-cold-wall:  34%|###4      | 1023/3000 [28:39<34:43,  1.05s/it, lr: 1.0e-04 loss: 1.126e-01]
a-cold-wall:  34%|###4      | 1024/3000 [28:39<38:13,  1.16s/it, lr: 1.0e-04 loss: 1.126e-01]
a-cold-wall:  34%|###4      | 1024/3000 [28:39<38:13,  1.16s/it, lr: 1.0e-04 loss: 1.126e-01]
a-cold-wall:  34%|###4      | 1024/3000 [28:42<38:13,  1.16s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:  34%|###4      | 1024/3000 [28:42<38:13,  1.16s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:  34%|###4      | 1025/3000 [28:42<54:29,  1.66s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:  34%|###4      | 1025/3000 [28:42<54:29,  1.66s/it, lr: 1.0e-04 loss: 2.310e-01]
a-cold-wall:  34%|###4      | 1025/3000 [28:43<54:29,  1.66s/it, lr: 1.0e-04 loss: 1.731e-01]
a-cold-wall:  34%|###4      | 1025/3000 [28:43<54:29,  1.66s/it, lr: 1.0e-04 loss: 1.731e-01]
a-cold-wall:  34%|###4      | 1026/3000 [28:43<45:52,  1.39s/it, lr: 1.0e-04 loss: 1.731e-01]
a-cold-wall:  34%|###4      | 1026/3000 [28:43<45:52,  1.39s/it, lr: 1.0e-04 loss: 1.731e-01]
a-cold-wall:  34%|###4      | 1026/3000 [28:44<45:52,  1.39s/it, lr: 1.0e-04 loss: 2.326e-01]
a-cold-wall:  34%|###4      | 1026/3000 [28:44<45:52,  1.39s/it, lr: 1.0e-04 loss: 2.326e-01]
a-cold-wall:  34%|###4      | 1027/3000 [28:44<41:59,  1.28s/it, lr: 1.0e-04 loss: 2.326e-01]
a-cold-wall:  34%|###4      | 1027/3000 [28:44<41:59,  1.28s/it, lr: 1.0e-04 loss: 2.326e-01]
a-cold-wall:  34%|###4      | 1027/3000 [28:44<41:59,  1.28s/it, lr: 1.0e-04 loss: 6.032e-01]
a-cold-wall:  34%|###4      | 1027/3000 [28:44<41:59,  1.28s/it, lr: 1.0e-04 loss: 6.032e-01]
a-cold-wall:  34%|###4      | 1028/3000 [28:44<36:48,  1.12s/it, lr: 1.0e-04 loss: 6.032e-01]
a-cold-wall:  34%|###4      | 1028/3000 [28:44<36:48,  1.12s/it, lr: 1.0e-04 loss: 6.032e-01]
a-cold-wall:  34%|###4      | 1028/3000 [28:47<36:48,  1.12s/it, lr: 1.0e-04 loss: 7.744e-01]
a-cold-wall:  34%|###4      | 1028/3000 [28:47<36:48,  1.12s/it, lr: 1.0e-04 loss: 7.744e-01]
a-cold-wall:  34%|###4      | 1029/3000 [28:47<54:12,  1.65s/it, lr: 1.0e-04 loss: 7.744e-01]
a-cold-wall:  34%|###4      | 1029/3000 [28:47<54:12,  1.65s/it, lr: 1.0e-04 loss: 7.744e-01]
a-cold-wall:  34%|###4      | 1029/3000 [28:49<54:12,  1.65s/it, lr: 1.0e-04 loss: 3.557e-01]
a-cold-wall:  34%|###4      | 1029/3000 [28:49<54:12,  1.65s/it, lr: 1.0e-04 loss: 3.557e-01]
a-cold-wall:  34%|###4      | 1030/3000 [28:52<54:10,  1.65s/it, lr: 1.0e-04 loss: 6.714e-01]
a-cold-wall:  34%|###4      | 1030/3000 [28:52<54:10,  1.65s/it, lr: 1.0e-04 loss: 6.714e-01]
a-cold-wall:  34%|###4      | 1031/3000 [28:52<51:08,  1.56s/it, lr: 1.0e-04 loss: 6.714e-01]
a-cold-wall:  34%|###4      | 1031/3000 [28:52<51:08,  1.56s/it, lr: 1.0e-04 loss: 6.714e-01]
a-cold-wall:  34%|###4      | 1031/3000 [28:53<51:08,  1.56s/it, lr: 1.0e-04 loss: 6.657e-01]
a-cold-wall:  34%|###4      | 1031/3000 [28:53<51:08,  1.56s/it, lr: 1.0e-04 loss: 6.657e-01]
a-cold-wall:  34%|###4      | 1032/3000 [28:53<50:08,  1.53s/it, lr: 1.0e-04 loss: 6.657e-01]
a-cold-wall:  34%|###4      | 1032/3000 [28:53<50:08,  1.53s/it, lr: 1.0e-04 loss: 6.657e-01]
a-cold-wall:  34%|###4      | 1032/3000 [28:55<50:08,  1.53s/it, lr: 1.0e-04 loss: 3.043e-01]
a-cold-wall:  34%|###4      | 1032/3000 [28:55<50:08,  1.53s/it, lr: 1.0e-04 loss: 3.043e-01]
a-cold-wall:  34%|###4      | 1033/3000 [28:55<49:08,  1.50s/it, lr: 1.0e-04 loss: 3.043e-01]
a-cold-wall:  34%|###4      | 1033/3000 [28:55<49:08,  1.50s/it, lr: 1.0e-04 loss: 3.043e-01]
a-cold-wall:  34%|###4      | 1033/3000 [28:57<49:08,  1.50s/it, lr: 1.0e-04 loss: 6.151e-01]
a-cold-wall:  34%|###4      | 1033/3000 [28:57<49:08,  1.50s/it, lr: 1.0e-04 loss: 6.151e-01]
a-cold-wall:  34%|###4      | 1034/3000 [28:57<1:01:07,  1.87s/it, lr: 1.0e-04 loss: 6.151e-01]
a-cold-wall:  34%|###4      | 1034/3000 [28:57<1:01:07,  1.87s/it, lr: 1.0e-04 loss: 6.151e-01]
a-cold-wall:  34%|###4      | 1034/3000 [29:00<1:01:07,  1.87s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  34%|###4      | 1034/3000 [29:00<1:01:07,  1.87s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  34%|###4      | 1035/3000 [29:00<1:10:47,  2.16s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  34%|###4      | 1035/3000 [29:00<1:10:47,  2.16s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  34%|###4      | 1035/3000 [29:03<1:10:47,  2.16s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  34%|###4      | 1035/3000 [29:03<1:10:47,  2.16s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  35%|###4      | 1036/3000 [29:03<1:17:23,  2.36s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  35%|###4      | 1036/3000 [29:03<1:17:23,  2.36s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  35%|###4      | 1036/3000 [29:06<1:17:23,  2.36s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  35%|###4      | 1036/3000 [29:06<1:17:23,  2.36s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  35%|###4      | 1037/3000 [29:06<1:21:51,  2.50s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  35%|###4      | 1037/3000 [29:06<1:21:51,  2.50s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  35%|###4      | 1037/3000 [29:07<1:21:51,  2.50s/it, lr: 1.0e-04 loss: 5.763e-01]
a-cold-wall:  35%|###4      | 1037/3000 [29:07<1:21:51,  2.50s/it, lr: 1.0e-04 loss: 5.763e-01]
a-cold-wall:  35%|###4      | 1038/3000 [29:07<1:11:28,  2.19s/it, lr: 1.0e-04 loss: 5.763e-01]
a-cold-wall:  35%|###4      | 1038/3000 [29:07<1:11:28,  2.19s/it, lr: 1.0e-04 loss: 5.763e-01]
a-cold-wall:  35%|###4      | 1038/3000 [29:08<1:11:28,  2.19s/it, lr: 1.0e-04 loss: 7.119e-01]
a-cold-wall:  35%|###4      | 1038/3000 [29:08<1:11:28,  2.19s/it, lr: 1.0e-04 loss: 7.119e-01]
a-cold-wall:  35%|###4      | 1039/3000 [29:08<57:28,  1.76s/it, lr: 1.0e-04 loss: 7.119e-01]  
a-cold-wall:  35%|###4      | 1039/3000 [29:08<57:28,  1.76s/it, lr: 1.0e-04 loss: 7.119e-01]  
a-cold-wall:  35%|###4      | 1039/3000 [29:10<57:28,  1.76s/it, lr: 1.0e-04 loss: 5.021e-01]
a-cold-wall:  35%|###4      | 1039/3000 [29:10<57:28,  1.76s/it, lr: 1.0e-04 loss: 5.021e-01]
a-cold-wall:  35%|###4      | 1040/3000 [29:11<57:26,  1.76s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:  35%|###4      | 1040/3000 [29:11<57:26,  1.76s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:  35%|###4      | 1041/3000 [29:11<38:27,  1.18s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:  35%|###4      | 1041/3000 [29:11<38:27,  1.18s/it, lr: 1.0e-04 loss: 6.825e-01]
a-cold-wall:  35%|###4      | 1041/3000 [29:11<38:27,  1.18s/it, lr: 1.0e-04 loss: 5.009e-01]
a-cold-wall:  35%|###4      | 1041/3000 [29:11<38:27,  1.18s/it, lr: 1.0e-04 loss: 5.009e-01]
a-cold-wall:  35%|###4      | 1042/3000 [29:11<35:35,  1.09s/it, lr: 1.0e-04 loss: 5.009e-01]
a-cold-wall:  35%|###4      | 1042/3000 [29:11<35:35,  1.09s/it, lr: 1.0e-04 loss: 5.009e-01]
a-cold-wall:  35%|###4      | 1042/3000 [29:13<35:35,  1.09s/it, lr: 1.0e-04 loss: 1.837e-01]
a-cold-wall:  35%|###4      | 1042/3000 [29:13<35:35,  1.09s/it, lr: 1.0e-04 loss: 1.837e-01]
a-cold-wall:  35%|###4      | 1043/3000 [29:13<37:56,  1.16s/it, lr: 1.0e-04 loss: 1.837e-01]
a-cold-wall:  35%|###4      | 1043/3000 [29:13<37:56,  1.16s/it, lr: 1.0e-04 loss: 1.837e-01]
a-cold-wall:  35%|###4      | 1043/3000 [29:16<37:56,  1.16s/it, lr: 1.0e-04 loss: 8.021e-01]
a-cold-wall:  35%|###4      | 1043/3000 [29:16<37:56,  1.16s/it, lr: 1.0e-04 loss: 8.021e-01]
a-cold-wall:  35%|###4      | 1044/3000 [29:16<52:59,  1.63s/it, lr: 1.0e-04 loss: 8.021e-01]
a-cold-wall:  35%|###4      | 1044/3000 [29:16<52:59,  1.63s/it, lr: 1.0e-04 loss: 8.021e-01]
a-cold-wall:  35%|###4      | 1044/3000 [29:17<52:59,  1.63s/it, lr: 1.0e-04 loss: 1.590e-01]
a-cold-wall:  35%|###4      | 1044/3000 [29:17<52:59,  1.63s/it, lr: 1.0e-04 loss: 1.590e-01]
a-cold-wall:  35%|###4      | 1045/3000 [29:17<51:05,  1.57s/it, lr: 1.0e-04 loss: 1.590e-01]
a-cold-wall:  35%|###4      | 1045/3000 [29:17<51:05,  1.57s/it, lr: 1.0e-04 loss: 1.590e-01]
a-cold-wall:  35%|###4      | 1045/3000 [29:19<51:05,  1.57s/it, lr: 1.0e-04 loss: 3.623e-01]
a-cold-wall:  35%|###4      | 1045/3000 [29:19<51:05,  1.57s/it, lr: 1.0e-04 loss: 3.623e-01]
a-cold-wall:  35%|###4      | 1046/3000 [29:19<50:36,  1.55s/it, lr: 1.0e-04 loss: 3.623e-01]
a-cold-wall:  35%|###4      | 1046/3000 [29:19<50:36,  1.55s/it, lr: 1.0e-04 loss: 3.623e-01]
a-cold-wall:  35%|###4      | 1046/3000 [29:21<50:36,  1.55s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  35%|###4      | 1046/3000 [29:21<50:36,  1.55s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  35%|###4      | 1047/3000 [29:21<1:02:34,  1.92s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  35%|###4      | 1047/3000 [29:21<1:02:34,  1.92s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  35%|###4      | 1047/3000 [29:23<1:02:34,  1.92s/it, lr: 1.0e-04 loss: 5.237e-01]
a-cold-wall:  35%|###4      | 1047/3000 [29:23<1:02:34,  1.92s/it, lr: 1.0e-04 loss: 5.237e-01]
a-cold-wall:  35%|###4      | 1048/3000 [29:23<57:35,  1.77s/it, lr: 1.0e-04 loss: 5.237e-01]  
a-cold-wall:  35%|###4      | 1048/3000 [29:23<57:35,  1.77s/it, lr: 1.0e-04 loss: 5.237e-01]  
a-cold-wall:  35%|###4      | 1048/3000 [29:24<57:35,  1.77s/it, lr: 1.0e-04 loss: 2.296e-01]
a-cold-wall:  35%|###4      | 1048/3000 [29:24<57:35,  1.77s/it, lr: 1.0e-04 loss: 2.296e-01]
a-cold-wall:  35%|###4      | 1049/3000 [29:24<47:42,  1.47s/it, lr: 1.0e-04 loss: 2.296e-01]
a-cold-wall:  35%|###4      | 1049/3000 [29:24<47:42,  1.47s/it, lr: 1.0e-04 loss: 2.296e-01]
a-cold-wall:  35%|###4      | 1049/3000 [29:25<47:42,  1.47s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  35%|###4      | 1049/3000 [29:25<47:42,  1.47s/it, lr: 1.0e-04 loss: 5.978e-01]
a-cold-wall:  35%|###5      | 1050/3000 [29:27<47:41,  1.47s/it, lr: 1.0e-04 loss: 3.397e-01]
a-cold-wall:  35%|###5      | 1050/3000 [29:27<47:41,  1.47s/it, lr: 1.0e-04 loss: 3.397e-01]
a-cold-wall:  35%|###5      | 1051/3000 [29:27<36:17,  1.12s/it, lr: 1.0e-04 loss: 3.397e-01]
a-cold-wall:  35%|###5      | 1051/3000 [29:27<36:17,  1.12s/it, lr: 1.0e-04 loss: 3.397e-01]
a-cold-wall:  35%|###5      | 1051/3000 [29:28<36:17,  1.12s/it, lr: 1.0e-04 loss: 6.378e-01]
a-cold-wall:  35%|###5      | 1051/3000 [29:28<36:17,  1.12s/it, lr: 1.0e-04 loss: 6.378e-01]
a-cold-wall:  35%|###5      | 1052/3000 [29:28<33:23,  1.03s/it, lr: 1.0e-04 loss: 6.378e-01]
a-cold-wall:  35%|###5      | 1052/3000 [29:28<33:23,  1.03s/it, lr: 1.0e-04 loss: 6.378e-01]
a-cold-wall:  35%|###5      | 1052/3000 [29:29<33:23,  1.03s/it, lr: 1.0e-04 loss: 3.448e-01]
a-cold-wall:  35%|###5      | 1052/3000 [29:29<33:23,  1.03s/it, lr: 1.0e-04 loss: 3.448e-01]
a-cold-wall:  35%|###5      | 1053/3000 [29:29<36:30,  1.13s/it, lr: 1.0e-04 loss: 3.448e-01]
a-cold-wall:  35%|###5      | 1053/3000 [29:29<36:30,  1.13s/it, lr: 1.0e-04 loss: 3.448e-01]
a-cold-wall:  35%|###5      | 1053/3000 [29:32<36:30,  1.13s/it, lr: 1.0e-04 loss: 5.006e-01]
a-cold-wall:  35%|###5      | 1053/3000 [29:32<36:30,  1.13s/it, lr: 1.0e-04 loss: 5.006e-01]
a-cold-wall:  35%|###5      | 1054/3000 [29:32<52:56,  1.63s/it, lr: 1.0e-04 loss: 5.006e-01]
a-cold-wall:  35%|###5      | 1054/3000 [29:32<52:56,  1.63s/it, lr: 1.0e-04 loss: 5.006e-01]
a-cold-wall:  35%|###5      | 1054/3000 [29:33<52:56,  1.63s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  35%|###5      | 1054/3000 [29:33<52:56,  1.63s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  35%|###5      | 1055/3000 [29:33<44:53,  1.38s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  35%|###5      | 1055/3000 [29:33<44:53,  1.38s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  35%|###5      | 1055/3000 [29:36<44:53,  1.38s/it, lr: 1.0e-04 loss: 4.941e-01]
a-cold-wall:  35%|###5      | 1055/3000 [29:36<44:53,  1.38s/it, lr: 1.0e-04 loss: 4.941e-01]
a-cold-wall:  35%|###5      | 1056/3000 [29:36<58:10,  1.80s/it, lr: 1.0e-04 loss: 4.941e-01]
a-cold-wall:  35%|###5      | 1056/3000 [29:36<58:10,  1.80s/it, lr: 1.0e-04 loss: 4.941e-01]
a-cold-wall:  35%|###5      | 1056/3000 [29:36<58:10,  1.80s/it, lr: 1.0e-04 loss: 4.323e-01]
a-cold-wall:  35%|###5      | 1056/3000 [29:36<58:10,  1.80s/it, lr: 1.0e-04 loss: 4.323e-01]
a-cold-wall:  35%|###5      | 1057/3000 [29:36<48:16,  1.49s/it, lr: 1.0e-04 loss: 4.323e-01]
a-cold-wall:  35%|###5      | 1057/3000 [29:36<48:16,  1.49s/it, lr: 1.0e-04 loss: 4.323e-01]
a-cold-wall:  35%|###5      | 1057/3000 [29:37<48:16,  1.49s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  35%|###5      | 1057/3000 [29:37<48:16,  1.49s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  35%|###5      | 1058/3000 [29:37<41:11,  1.27s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  35%|###5      | 1058/3000 [29:37<41:11,  1.27s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  35%|###5      | 1058/3000 [29:39<41:11,  1.27s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  35%|###5      | 1058/3000 [29:39<41:11,  1.27s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  35%|###5      | 1059/3000 [29:39<42:34,  1.32s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  35%|###5      | 1059/3000 [29:39<42:34,  1.32s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  35%|###5      | 1059/3000 [29:40<42:34,  1.32s/it, lr: 1.0e-04 loss: 8.743e-02]
a-cold-wall:  35%|###5      | 1059/3000 [29:40<42:34,  1.32s/it, lr: 1.0e-04 loss: 8.743e-02]
a-cold-wall:  35%|###5      | 1060/3000 [29:43<42:33,  1.32s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  35%|###5      | 1060/3000 [29:43<42:33,  1.32s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  35%|###5      | 1061/3000 [29:43<44:09,  1.37s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  35%|###5      | 1061/3000 [29:43<44:09,  1.37s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  35%|###5      | 1061/3000 [29:44<44:09,  1.37s/it, lr: 1.0e-04 loss: 6.479e-01]
a-cold-wall:  35%|###5      | 1061/3000 [29:44<44:09,  1.37s/it, lr: 1.0e-04 loss: 6.479e-01]
a-cold-wall:  35%|###5      | 1062/3000 [29:44<44:23,  1.37s/it, lr: 1.0e-04 loss: 6.479e-01]
a-cold-wall:  35%|###5      | 1062/3000 [29:44<44:23,  1.37s/it, lr: 1.0e-04 loss: 6.479e-01]
a-cold-wall:  35%|###5      | 1062/3000 [29:45<44:23,  1.37s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  35%|###5      | 1062/3000 [29:45<44:23,  1.37s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  35%|###5      | 1063/3000 [29:45<39:11,  1.21s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  35%|###5      | 1063/3000 [29:45<39:11,  1.21s/it, lr: 1.0e-04 loss: 3.361e-01]
a-cold-wall:  35%|###5      | 1063/3000 [29:48<39:11,  1.21s/it, lr: 1.0e-04 loss: 5.768e-01]
a-cold-wall:  35%|###5      | 1063/3000 [29:48<39:11,  1.21s/it, lr: 1.0e-04 loss: 5.768e-01]
a-cold-wall:  35%|###5      | 1064/3000 [29:48<53:13,  1.65s/it, lr: 1.0e-04 loss: 5.768e-01]
a-cold-wall:  35%|###5      | 1064/3000 [29:48<53:13,  1.65s/it, lr: 1.0e-04 loss: 5.768e-01]
a-cold-wall:  35%|###5      | 1064/3000 [29:49<53:13,  1.65s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  35%|###5      | 1064/3000 [29:49<53:13,  1.65s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  36%|###5      | 1065/3000 [29:49<45:00,  1.40s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  36%|###5      | 1065/3000 [29:49<45:00,  1.40s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  36%|###5      | 1065/3000 [29:49<45:00,  1.40s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:  36%|###5      | 1065/3000 [29:49<45:00,  1.40s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:  36%|###5      | 1066/3000 [29:49<38:54,  1.21s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:  36%|###5      | 1066/3000 [29:49<38:54,  1.21s/it, lr: 1.0e-04 loss: 5.503e-01]
a-cold-wall:  36%|###5      | 1066/3000 [29:51<38:54,  1.21s/it, lr: 1.0e-04 loss: 6.315e-01]
a-cold-wall:  36%|###5      | 1066/3000 [29:51<38:54,  1.21s/it, lr: 1.0e-04 loss: 6.315e-01]
a-cold-wall:  36%|###5      | 1067/3000 [29:51<42:20,  1.31s/it, lr: 1.0e-04 loss: 6.315e-01]
a-cold-wall:  36%|###5      | 1067/3000 [29:51<42:20,  1.31s/it, lr: 1.0e-04 loss: 6.315e-01]
a-cold-wall:  36%|###5      | 1067/3000 [29:52<42:20,  1.31s/it, lr: 1.0e-04 loss: 7.012e-01]
a-cold-wall:  36%|###5      | 1067/3000 [29:52<42:20,  1.31s/it, lr: 1.0e-04 loss: 7.012e-01]
a-cold-wall:  36%|###5      | 1068/3000 [29:52<36:54,  1.15s/it, lr: 1.0e-04 loss: 7.012e-01]
a-cold-wall:  36%|###5      | 1068/3000 [29:52<36:54,  1.15s/it, lr: 1.0e-04 loss: 7.012e-01]
a-cold-wall:  36%|###5      | 1068/3000 [29:52<36:54,  1.15s/it, lr: 1.0e-04 loss: 5.974e-01]
a-cold-wall:  36%|###5      | 1068/3000 [29:52<36:54,  1.15s/it, lr: 1.0e-04 loss: 5.974e-01]
a-cold-wall:  36%|###5      | 1069/3000 [29:52<32:54,  1.02s/it, lr: 1.0e-04 loss: 5.974e-01]
a-cold-wall:  36%|###5      | 1069/3000 [29:52<32:54,  1.02s/it, lr: 1.0e-04 loss: 5.974e-01]
a-cold-wall:  36%|###5      | 1069/3000 [29:55<32:54,  1.02s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  36%|###5      | 1069/3000 [29:55<32:54,  1.02s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  36%|###5      | 1070/3000 [29:58<32:53,  1.02s/it, lr: 1.0e-04 loss: 5.318e-02]
a-cold-wall:  36%|###5      | 1070/3000 [29:58<32:53,  1.02s/it, lr: 1.0e-04 loss: 5.318e-02]
a-cold-wall:  36%|###5      | 1071/3000 [29:58<38:34,  1.20s/it, lr: 1.0e-04 loss: 5.318e-02]
a-cold-wall:  36%|###5      | 1071/3000 [29:58<38:34,  1.20s/it, lr: 1.0e-04 loss: 5.318e-02]
a-cold-wall:  36%|###5      | 1071/3000 [29:59<38:34,  1.20s/it, lr: 1.0e-04 loss: 1.470e-01]
a-cold-wall:  36%|###5      | 1071/3000 [29:59<38:34,  1.20s/it, lr: 1.0e-04 loss: 1.470e-01]
a-cold-wall:  36%|###5      | 1072/3000 [29:59<40:13,  1.25s/it, lr: 1.0e-04 loss: 1.470e-01]
a-cold-wall:  36%|###5      | 1072/3000 [29:59<40:13,  1.25s/it, lr: 1.0e-04 loss: 1.470e-01]
a-cold-wall:  36%|###5      | 1072/3000 [30:00<40:13,  1.25s/it, lr: 1.0e-04 loss: 5.019e-01]
a-cold-wall:  36%|###5      | 1072/3000 [30:00<40:13,  1.25s/it, lr: 1.0e-04 loss: 5.019e-01]
a-cold-wall:  36%|###5      | 1073/3000 [30:00<35:57,  1.12s/it, lr: 1.0e-04 loss: 5.019e-01]
a-cold-wall:  36%|###5      | 1073/3000 [30:00<35:57,  1.12s/it, lr: 1.0e-04 loss: 5.019e-01]
a-cold-wall:  36%|###5      | 1073/3000 [30:02<35:57,  1.12s/it, lr: 1.0e-04 loss: 4.213e-01]
a-cold-wall:  36%|###5      | 1073/3000 [30:02<35:57,  1.12s/it, lr: 1.0e-04 loss: 4.213e-01]
a-cold-wall:  36%|###5      | 1074/3000 [30:02<38:28,  1.20s/it, lr: 1.0e-04 loss: 4.213e-01]
a-cold-wall:  36%|###5      | 1074/3000 [30:02<38:28,  1.20s/it, lr: 1.0e-04 loss: 4.213e-01]
a-cold-wall:  36%|###5      | 1074/3000 [30:04<38:28,  1.20s/it, lr: 1.0e-04 loss: 8.248e-02]
a-cold-wall:  36%|###5      | 1074/3000 [30:04<38:28,  1.20s/it, lr: 1.0e-04 loss: 8.248e-02]
a-cold-wall:  36%|###5      | 1075/3000 [30:04<52:52,  1.65s/it, lr: 1.0e-04 loss: 8.248e-02]
a-cold-wall:  36%|###5      | 1075/3000 [30:04<52:52,  1.65s/it, lr: 1.0e-04 loss: 8.248e-02]
a-cold-wall:  36%|###5      | 1075/3000 [30:06<52:52,  1.65s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  36%|###5      | 1075/3000 [30:06<52:52,  1.65s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  36%|###5      | 1076/3000 [30:06<50:32,  1.58s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  36%|###5      | 1076/3000 [30:06<50:32,  1.58s/it, lr: 1.0e-04 loss: 5.382e-01]
a-cold-wall:  36%|###5      | 1076/3000 [30:06<50:32,  1.58s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  36%|###5      | 1076/3000 [30:06<50:32,  1.58s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  36%|###5      | 1077/3000 [30:06<42:41,  1.33s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  36%|###5      | 1077/3000 [30:06<42:41,  1.33s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  36%|###5      | 1077/3000 [30:07<42:41,  1.33s/it, lr: 1.0e-04 loss: 5.080e-01]
a-cold-wall:  36%|###5      | 1077/3000 [30:07<42:41,  1.33s/it, lr: 1.0e-04 loss: 5.080e-01]
a-cold-wall:  36%|###5      | 1078/3000 [30:07<37:06,  1.16s/it, lr: 1.0e-04 loss: 5.080e-01]
a-cold-wall:  36%|###5      | 1078/3000 [30:07<37:06,  1.16s/it, lr: 1.0e-04 loss: 5.080e-01]
a-cold-wall:  36%|###5      | 1078/3000 [30:09<37:06,  1.16s/it, lr: 1.0e-04 loss: 4.958e-01]
a-cold-wall:  36%|###5      | 1078/3000 [30:09<37:06,  1.16s/it, lr: 1.0e-04 loss: 4.958e-01]
a-cold-wall:  36%|###5      | 1079/3000 [30:09<39:02,  1.22s/it, lr: 1.0e-04 loss: 4.958e-01]
a-cold-wall:  36%|###5      | 1079/3000 [30:09<39:02,  1.22s/it, lr: 1.0e-04 loss: 4.958e-01]
a-cold-wall:  36%|###5      | 1079/3000 [30:10<39:02,  1.22s/it, lr: 1.0e-04 loss: 8.401e-01]
a-cold-wall:  36%|###5      | 1079/3000 [30:10<39:02,  1.22s/it, lr: 1.0e-04 loss: 8.401e-01]
a-cold-wall:  36%|###6      | 1080/3000 [30:11<39:01,  1.22s/it, lr: 1.0e-04 loss: 5.139e-01]
a-cold-wall:  36%|###6      | 1080/3000 [30:11<39:01,  1.22s/it, lr: 1.0e-04 loss: 5.139e-01]
a-cold-wall:  36%|###6      | 1081/3000 [30:11<31:08,  1.03it/s, lr: 1.0e-04 loss: 5.139e-01]
a-cold-wall:  36%|###6      | 1081/3000 [30:11<31:08,  1.03it/s, lr: 1.0e-04 loss: 5.139e-01]
a-cold-wall:  36%|###6      | 1081/3000 [30:14<31:08,  1.03it/s, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  36%|###6      | 1081/3000 [30:14<31:08,  1.03it/s, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  36%|###6      | 1082/3000 [30:14<45:58,  1.44s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  36%|###6      | 1082/3000 [30:14<45:58,  1.44s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  36%|###6      | 1082/3000 [30:15<45:58,  1.44s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  36%|###6      | 1082/3000 [30:15<45:58,  1.44s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  36%|###6      | 1083/3000 [30:15<40:09,  1.26s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  36%|###6      | 1083/3000 [30:15<40:09,  1.26s/it, lr: 1.0e-04 loss: 2.735e-01]
a-cold-wall:  36%|###6      | 1083/3000 [30:16<40:09,  1.26s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:  36%|###6      | 1083/3000 [30:16<40:09,  1.26s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:  36%|###6      | 1084/3000 [30:16<41:30,  1.30s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:  36%|###6      | 1084/3000 [30:16<41:30,  1.30s/it, lr: 1.0e-04 loss: 2.991e-01]
a-cold-wall:  36%|###6      | 1084/3000 [30:17<41:30,  1.30s/it, lr: 1.0e-04 loss: 6.799e-01]
a-cold-wall:  36%|###6      | 1084/3000 [30:17<41:30,  1.30s/it, lr: 1.0e-04 loss: 6.799e-01]
a-cold-wall:  36%|###6      | 1085/3000 [30:17<36:37,  1.15s/it, lr: 1.0e-04 loss: 6.799e-01]
a-cold-wall:  36%|###6      | 1085/3000 [30:17<36:37,  1.15s/it, lr: 1.0e-04 loss: 6.799e-01]
a-cold-wall:  36%|###6      | 1085/3000 [30:17<36:37,  1.15s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  36%|###6      | 1085/3000 [30:17<36:37,  1.15s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  36%|###6      | 1086/3000 [30:17<32:55,  1.03s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  36%|###6      | 1086/3000 [30:17<32:55,  1.03s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  36%|###6      | 1086/3000 [30:20<32:55,  1.03s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  36%|###6      | 1086/3000 [30:20<32:55,  1.03s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  36%|###6      | 1087/3000 [30:20<49:24,  1.55s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  36%|###6      | 1087/3000 [30:20<49:24,  1.55s/it, lr: 1.0e-04 loss: 6.302e-01]
a-cold-wall:  36%|###6      | 1087/3000 [30:23<49:24,  1.55s/it, lr: 1.0e-04 loss: 1.400e-01]
a-cold-wall:  36%|###6      | 1087/3000 [30:23<49:24,  1.55s/it, lr: 1.0e-04 loss: 1.400e-01]
a-cold-wall:  36%|###6      | 1088/3000 [30:23<1:01:31,  1.93s/it, lr: 1.0e-04 loss: 1.400e-01]
a-cold-wall:  36%|###6      | 1088/3000 [30:23<1:01:31,  1.93s/it, lr: 1.0e-04 loss: 1.400e-01]
a-cold-wall:  36%|###6      | 1088/3000 [30:26<1:01:31,  1.93s/it, lr: 1.0e-04 loss: 2.598e-01]
a-cold-wall:  36%|###6      | 1088/3000 [30:26<1:01:31,  1.93s/it, lr: 1.0e-04 loss: 2.598e-01]
a-cold-wall:  36%|###6      | 1089/3000 [30:26<1:10:09,  2.20s/it, lr: 1.0e-04 loss: 2.598e-01]
a-cold-wall:  36%|###6      | 1089/3000 [30:26<1:10:09,  2.20s/it, lr: 1.0e-04 loss: 2.598e-01]
a-cold-wall:  36%|###6      | 1089/3000 [30:29<1:10:09,  2.20s/it, lr: 1.0e-04 loss: 4.560e-01]
a-cold-wall:  36%|###6      | 1089/3000 [30:29<1:10:09,  2.20s/it, lr: 1.0e-04 loss: 4.560e-01]
a-cold-wall:  36%|###6      | 1090/3000 [30:32<1:10:07,  2.20s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  36%|###6      | 1090/3000 [30:32<1:10:07,  2.20s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  36%|###6      | 1091/3000 [30:32<58:47,  1.85s/it, lr: 1.0e-04 loss: 1.261e-01]  
a-cold-wall:  36%|###6      | 1091/3000 [30:32<58:47,  1.85s/it, lr: 1.0e-04 loss: 1.261e-01]  
a-cold-wall:  36%|###6      | 1091/3000 [30:33<58:47,  1.85s/it, lr: 1.0e-04 loss: 3.300e-02]
a-cold-wall:  36%|###6      | 1091/3000 [30:33<58:47,  1.85s/it, lr: 1.0e-04 loss: 3.300e-02]
a-cold-wall:  36%|###6      | 1092/3000 [30:33<55:23,  1.74s/it, lr: 1.0e-04 loss: 3.300e-02]
a-cold-wall:  36%|###6      | 1092/3000 [30:33<55:23,  1.74s/it, lr: 1.0e-04 loss: 3.300e-02]
a-cold-wall:  36%|###6      | 1092/3000 [30:36<55:23,  1.74s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  36%|###6      | 1092/3000 [30:36<55:23,  1.74s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  36%|###6      | 1093/3000 [30:36<1:04:14,  2.02s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  36%|###6      | 1093/3000 [30:36<1:04:14,  2.02s/it, lr: 1.0e-04 loss: 8.324e-01]
a-cold-wall:  36%|###6      | 1093/3000 [30:37<1:04:14,  2.02s/it, lr: 1.0e-04 loss: 6.739e-02]
a-cold-wall:  36%|###6      | 1093/3000 [30:37<1:04:14,  2.02s/it, lr: 1.0e-04 loss: 6.739e-02]
a-cold-wall:  36%|###6      | 1094/3000 [30:37<53:10,  1.67s/it, lr: 1.0e-04 loss: 6.739e-02]  
a-cold-wall:  36%|###6      | 1094/3000 [30:37<53:10,  1.67s/it, lr: 1.0e-04 loss: 6.739e-02]  
a-cold-wall:  36%|###6      | 1094/3000 [30:38<53:10,  1.67s/it, lr: 1.0e-04 loss: 6.076e-01]
a-cold-wall:  36%|###6      | 1094/3000 [30:38<53:10,  1.67s/it, lr: 1.0e-04 loss: 6.076e-01]
a-cold-wall:  36%|###6      | 1095/3000 [30:38<46:57,  1.48s/it, lr: 1.0e-04 loss: 6.076e-01]
a-cold-wall:  36%|###6      | 1095/3000 [30:38<46:57,  1.48s/it, lr: 1.0e-04 loss: 6.076e-01]
a-cold-wall:  36%|###6      | 1095/3000 [30:38<46:57,  1.48s/it, lr: 1.0e-04 loss: 2.811e-01]
a-cold-wall:  36%|###6      | 1095/3000 [30:38<46:57,  1.48s/it, lr: 1.0e-04 loss: 2.811e-01]
a-cold-wall:  37%|###6      | 1096/3000 [30:38<40:11,  1.27s/it, lr: 1.0e-04 loss: 2.811e-01]
a-cold-wall:  37%|###6      | 1096/3000 [30:38<40:11,  1.27s/it, lr: 1.0e-04 loss: 2.811e-01]
a-cold-wall:  37%|###6      | 1096/3000 [30:40<40:11,  1.27s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  37%|###6      | 1096/3000 [30:40<40:11,  1.27s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  37%|###6      | 1097/3000 [30:40<42:30,  1.34s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  37%|###6      | 1097/3000 [30:40<42:30,  1.34s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  37%|###6      | 1097/3000 [30:41<42:30,  1.34s/it, lr: 1.0e-04 loss: 4.868e-02]
a-cold-wall:  37%|###6      | 1097/3000 [30:41<42:30,  1.34s/it, lr: 1.0e-04 loss: 4.868e-02]
a-cold-wall:  37%|###6      | 1098/3000 [30:41<43:20,  1.37s/it, lr: 1.0e-04 loss: 4.868e-02]
a-cold-wall:  37%|###6      | 1098/3000 [30:41<43:20,  1.37s/it, lr: 1.0e-04 loss: 4.868e-02]
a-cold-wall:  37%|###6      | 1098/3000 [30:42<43:20,  1.37s/it, lr: 1.0e-04 loss: 6.915e-01]
a-cold-wall:  37%|###6      | 1098/3000 [30:42<43:20,  1.37s/it, lr: 1.0e-04 loss: 6.915e-01]
a-cold-wall:  37%|###6      | 1099/3000 [30:42<37:29,  1.18s/it, lr: 1.0e-04 loss: 6.915e-01]
a-cold-wall:  37%|###6      | 1099/3000 [30:42<37:29,  1.18s/it, lr: 1.0e-04 loss: 6.915e-01]
a-cold-wall:  37%|###6      | 1099/3000 [30:43<37:29,  1.18s/it, lr: 1.0e-04 loss: 5.513e-01]
a-cold-wall:  37%|###6      | 1099/3000 [30:43<37:29,  1.18s/it, lr: 1.0e-04 loss: 5.513e-01]
a-cold-wall:  37%|###6      | 1100/3000 [30:45<37:28,  1.18s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  37%|###6      | 1100/3000 [30:45<37:28,  1.18s/it, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  37%|###6      | 1101/3000 [30:45<30:28,  1.04it/s, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  37%|###6      | 1101/3000 [30:45<30:28,  1.04it/s, lr: 1.0e-04 loss: 4.898e-01]
a-cold-wall:  37%|###6      | 1101/3000 [30:48<30:28,  1.04it/s, lr: 1.0e-04 loss: 7.924e-01]
a-cold-wall:  37%|###6      | 1101/3000 [30:48<30:28,  1.04it/s, lr: 1.0e-04 loss: 7.924e-01]
a-cold-wall:  37%|###6      | 1102/3000 [30:48<44:56,  1.42s/it, lr: 1.0e-04 loss: 7.924e-01]
a-cold-wall:  37%|###6      | 1102/3000 [30:48<44:56,  1.42s/it, lr: 1.0e-04 loss: 7.924e-01]
a-cold-wall:  37%|###6      | 1102/3000 [30:49<44:56,  1.42s/it, lr: 1.0e-04 loss: 4.393e-01]
a-cold-wall:  37%|###6      | 1102/3000 [30:49<44:56,  1.42s/it, lr: 1.0e-04 loss: 4.393e-01]
a-cold-wall:  37%|###6      | 1103/3000 [30:49<41:08,  1.30s/it, lr: 1.0e-04 loss: 4.393e-01]
a-cold-wall:  37%|###6      | 1103/3000 [30:49<41:08,  1.30s/it, lr: 1.0e-04 loss: 4.393e-01]
a-cold-wall:  37%|###6      | 1103/3000 [30:49<41:08,  1.30s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  37%|###6      | 1103/3000 [30:49<41:08,  1.30s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  37%|###6      | 1104/3000 [30:49<36:20,  1.15s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  37%|###6      | 1104/3000 [30:49<36:20,  1.15s/it, lr: 1.0e-04 loss: 2.863e-01]
a-cold-wall:  37%|###6      | 1104/3000 [30:52<36:20,  1.15s/it, lr: 1.0e-04 loss: 1.239e-01]
a-cold-wall:  37%|###6      | 1104/3000 [30:52<36:20,  1.15s/it, lr: 1.0e-04 loss: 1.239e-01]
a-cold-wall:  37%|###6      | 1105/3000 [30:52<51:20,  1.63s/it, lr: 1.0e-04 loss: 1.239e-01]
a-cold-wall:  37%|###6      | 1105/3000 [30:52<51:20,  1.63s/it, lr: 1.0e-04 loss: 1.239e-01]
a-cold-wall:  37%|###6      | 1105/3000 [30:54<51:20,  1.63s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  37%|###6      | 1105/3000 [30:54<51:20,  1.63s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  37%|###6      | 1106/3000 [30:54<49:15,  1.56s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  37%|###6      | 1106/3000 [30:54<49:15,  1.56s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  37%|###6      | 1106/3000 [30:54<49:15,  1.56s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:  37%|###6      | 1106/3000 [30:54<49:15,  1.56s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:  37%|###6      | 1107/3000 [30:54<41:46,  1.32s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:  37%|###6      | 1107/3000 [30:54<41:46,  1.32s/it, lr: 1.0e-04 loss: 6.406e-01]
a-cold-wall:  37%|###6      | 1107/3000 [30:57<41:46,  1.32s/it, lr: 1.0e-04 loss: 1.394e-01]
a-cold-wall:  37%|###6      | 1107/3000 [30:57<41:46,  1.32s/it, lr: 1.0e-04 loss: 1.394e-01]
a-cold-wall:  37%|###6      | 1108/3000 [30:57<55:30,  1.76s/it, lr: 1.0e-04 loss: 1.394e-01]
a-cold-wall:  37%|###6      | 1108/3000 [30:57<55:30,  1.76s/it, lr: 1.0e-04 loss: 1.394e-01]
a-cold-wall:  37%|###6      | 1108/3000 [30:58<55:30,  1.76s/it, lr: 1.0e-04 loss: 4.568e-01]
a-cold-wall:  37%|###6      | 1108/3000 [30:58<55:30,  1.76s/it, lr: 1.0e-04 loss: 4.568e-01]
a-cold-wall:  37%|###6      | 1109/3000 [30:58<48:10,  1.53s/it, lr: 1.0e-04 loss: 4.568e-01]
a-cold-wall:  37%|###6      | 1109/3000 [30:58<48:10,  1.53s/it, lr: 1.0e-04 loss: 4.568e-01]
a-cold-wall:  37%|###6      | 1109/3000 [31:00<48:10,  1.53s/it, lr: 1.0e-04 loss: 5.770e-01]
a-cold-wall:  37%|###6      | 1109/3000 [31:00<48:10,  1.53s/it, lr: 1.0e-04 loss: 5.770e-01]
a-cold-wall:  37%|###7      | 1110/3000 [31:02<48:09,  1.53s/it, lr: 1.0e-04 loss: 7.369e-01]
a-cold-wall:  37%|###7      | 1110/3000 [31:02<48:09,  1.53s/it, lr: 1.0e-04 loss: 7.369e-01]
a-cold-wall:  37%|###7      | 1111/3000 [31:02<46:31,  1.48s/it, lr: 1.0e-04 loss: 7.369e-01]
a-cold-wall:  37%|###7      | 1111/3000 [31:02<46:31,  1.48s/it, lr: 1.0e-04 loss: 7.369e-01]
a-cold-wall:  37%|###7      | 1111/3000 [31:03<46:31,  1.48s/it, lr: 1.0e-04 loss: 5.435e-01]
a-cold-wall:  37%|###7      | 1111/3000 [31:03<46:31,  1.48s/it, lr: 1.0e-04 loss: 5.435e-01]
a-cold-wall:  37%|###7      | 1112/3000 [31:03<40:49,  1.30s/it, lr: 1.0e-04 loss: 5.435e-01]
a-cold-wall:  37%|###7      | 1112/3000 [31:03<40:49,  1.30s/it, lr: 1.0e-04 loss: 5.435e-01]
a-cold-wall:  37%|###7      | 1112/3000 [31:06<40:49,  1.30s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  37%|###7      | 1112/3000 [31:06<40:49,  1.30s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  37%|###7      | 1113/3000 [31:06<53:37,  1.70s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  37%|###7      | 1113/3000 [31:06<53:37,  1.70s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  37%|###7      | 1113/3000 [31:09<53:37,  1.70s/it, lr: 1.0e-04 loss: 7.795e-01]
a-cold-wall:  37%|###7      | 1113/3000 [31:09<53:37,  1.70s/it, lr: 1.0e-04 loss: 7.795e-01]
a-cold-wall:  37%|###7      | 1114/3000 [31:09<1:03:32,  2.02s/it, lr: 1.0e-04 loss: 7.795e-01]
a-cold-wall:  37%|###7      | 1114/3000 [31:09<1:03:32,  2.02s/it, lr: 1.0e-04 loss: 7.795e-01]
a-cold-wall:  37%|###7      | 1114/3000 [31:10<1:03:32,  2.02s/it, lr: 1.0e-04 loss: 5.830e-01]
a-cold-wall:  37%|###7      | 1114/3000 [31:10<1:03:32,  2.02s/it, lr: 1.0e-04 loss: 5.830e-01]
a-cold-wall:  37%|###7      | 1115/3000 [31:10<58:13,  1.85s/it, lr: 1.0e-04 loss: 5.830e-01]  
a-cold-wall:  37%|###7      | 1115/3000 [31:10<58:13,  1.85s/it, lr: 1.0e-04 loss: 5.830e-01]  
a-cold-wall:  37%|###7      | 1115/3000 [31:12<58:13,  1.85s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  37%|###7      | 1115/3000 [31:12<58:13,  1.85s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  37%|###7      | 1116/3000 [31:12<54:29,  1.74s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  37%|###7      | 1116/3000 [31:12<54:29,  1.74s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  37%|###7      | 1116/3000 [31:15<54:29,  1.74s/it, lr: 1.0e-04 loss: 1.699e-01]
a-cold-wall:  37%|###7      | 1116/3000 [31:15<54:29,  1.74s/it, lr: 1.0e-04 loss: 1.699e-01]
a-cold-wall:  37%|###7      | 1117/3000 [31:15<1:04:29,  2.06s/it, lr: 1.0e-04 loss: 1.699e-01]
a-cold-wall:  37%|###7      | 1117/3000 [31:15<1:04:29,  2.06s/it, lr: 1.0e-04 loss: 1.699e-01]
a-cold-wall:  37%|###7      | 1117/3000 [31:17<1:04:29,  2.06s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  37%|###7      | 1117/3000 [31:17<1:04:29,  2.06s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  37%|###7      | 1118/3000 [31:17<1:12:00,  2.30s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  37%|###7      | 1118/3000 [31:17<1:12:00,  2.30s/it, lr: 1.0e-04 loss: 2.228e-01]
a-cold-wall:  37%|###7      | 1118/3000 [31:18<1:12:00,  2.30s/it, lr: 1.0e-04 loss: 3.234e-01]
a-cold-wall:  37%|###7      | 1118/3000 [31:18<1:12:00,  2.30s/it, lr: 1.0e-04 loss: 3.234e-01]
a-cold-wall:  37%|###7      | 1119/3000 [31:18<57:50,  1.84s/it, lr: 1.0e-04 loss: 3.234e-01]  
a-cold-wall:  37%|###7      | 1119/3000 [31:18<57:50,  1.84s/it, lr: 1.0e-04 loss: 3.234e-01]  
a-cold-wall:  37%|###7      | 1119/3000 [31:19<57:50,  1.84s/it, lr: 1.0e-04 loss: 2.686e-01]
a-cold-wall:  37%|###7      | 1119/3000 [31:19<57:50,  1.84s/it, lr: 1.0e-04 loss: 2.686e-01]
a-cold-wall:  37%|###7      | 1120/3000 [31:20<57:48,  1.84s/it, lr: 1.0e-04 loss: 3.474e-01]
a-cold-wall:  37%|###7      | 1120/3000 [31:20<57:48,  1.84s/it, lr: 1.0e-04 loss: 3.474e-01]
a-cold-wall:  37%|###7      | 1121/3000 [31:20<36:43,  1.17s/it, lr: 1.0e-04 loss: 3.474e-01]
a-cold-wall:  37%|###7      | 1121/3000 [31:20<36:43,  1.17s/it, lr: 1.0e-04 loss: 3.474e-01]
a-cold-wall:  37%|###7      | 1121/3000 [31:21<36:43,  1.17s/it, lr: 1.0e-04 loss: 4.085e-01]
a-cold-wall:  37%|###7      | 1121/3000 [31:21<36:43,  1.17s/it, lr: 1.0e-04 loss: 4.085e-01]
a-cold-wall:  37%|###7      | 1122/3000 [31:21<35:50,  1.15s/it, lr: 1.0e-04 loss: 4.085e-01]
a-cold-wall:  37%|###7      | 1122/3000 [31:21<35:50,  1.15s/it, lr: 1.0e-04 loss: 4.085e-01]
a-cold-wall:  37%|###7      | 1122/3000 [31:22<35:50,  1.15s/it, lr: 1.0e-04 loss: 3.997e-01]
a-cold-wall:  37%|###7      | 1122/3000 [31:22<35:50,  1.15s/it, lr: 1.0e-04 loss: 3.997e-01]
a-cold-wall:  37%|###7      | 1123/3000 [31:22<38:04,  1.22s/it, lr: 1.0e-04 loss: 3.997e-01]
a-cold-wall:  37%|###7      | 1123/3000 [31:22<38:04,  1.22s/it, lr: 1.0e-04 loss: 3.997e-01]
a-cold-wall:  37%|###7      | 1123/3000 [31:24<38:04,  1.22s/it, lr: 1.0e-04 loss: 8.589e-02]
a-cold-wall:  37%|###7      | 1123/3000 [31:24<38:04,  1.22s/it, lr: 1.0e-04 loss: 8.589e-02]
a-cold-wall:  37%|###7      | 1124/3000 [31:24<39:42,  1.27s/it, lr: 1.0e-04 loss: 8.589e-02]
a-cold-wall:  37%|###7      | 1124/3000 [31:24<39:42,  1.27s/it, lr: 1.0e-04 loss: 8.589e-02]
a-cold-wall:  37%|###7      | 1124/3000 [31:24<39:42,  1.27s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  37%|###7      | 1124/3000 [31:24<39:42,  1.27s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  38%|###7      | 1125/3000 [31:24<35:09,  1.12s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  38%|###7      | 1125/3000 [31:24<35:09,  1.12s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  38%|###7      | 1125/3000 [31:27<35:09,  1.12s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  38%|###7      | 1125/3000 [31:27<35:09,  1.12s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  38%|###7      | 1126/3000 [31:27<50:45,  1.63s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  38%|###7      | 1126/3000 [31:27<50:45,  1.63s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  38%|###7      | 1126/3000 [31:30<50:45,  1.63s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  38%|###7      | 1126/3000 [31:30<50:45,  1.63s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  38%|###7      | 1127/3000 [31:30<1:02:12,  1.99s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  38%|###7      | 1127/3000 [31:30<1:02:12,  1.99s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  38%|###7      | 1127/3000 [31:32<1:02:12,  1.99s/it, lr: 1.0e-04 loss: 1.791e-01]
a-cold-wall:  38%|###7      | 1127/3000 [31:32<1:02:12,  1.99s/it, lr: 1.0e-04 loss: 1.791e-01]
a-cold-wall:  38%|###7      | 1128/3000 [31:32<56:58,  1.83s/it, lr: 1.0e-04 loss: 1.791e-01]  
a-cold-wall:  38%|###7      | 1128/3000 [31:32<56:58,  1.83s/it, lr: 1.0e-04 loss: 1.791e-01]  
a-cold-wall:  38%|###7      | 1128/3000 [31:32<56:58,  1.83s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  38%|###7      | 1128/3000 [31:32<56:58,  1.83s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  38%|###7      | 1129/3000 [31:32<47:06,  1.51s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  38%|###7      | 1129/3000 [31:32<47:06,  1.51s/it, lr: 1.0e-04 loss: 6.739e-01]
a-cold-wall:  38%|###7      | 1129/3000 [31:33<47:06,  1.51s/it, lr: 1.0e-04 loss: 3.026e-01]
a-cold-wall:  38%|###7      | 1129/3000 [31:33<47:06,  1.51s/it, lr: 1.0e-04 loss: 3.026e-01]
a-cold-wall:  38%|###7      | 1130/3000 [31:35<47:05,  1.51s/it, lr: 1.0e-04 loss: 2.832e-01]
a-cold-wall:  38%|###7      | 1130/3000 [31:35<47:05,  1.51s/it, lr: 1.0e-04 loss: 2.832e-01]
a-cold-wall:  38%|###7      | 1131/3000 [31:35<35:44,  1.15s/it, lr: 1.0e-04 loss: 2.832e-01]
a-cold-wall:  38%|###7      | 1131/3000 [31:35<35:44,  1.15s/it, lr: 1.0e-04 loss: 2.832e-01]
a-cold-wall:  38%|###7      | 1131/3000 [31:37<35:44,  1.15s/it, lr: 1.0e-04 loss: 7.282e-01]
a-cold-wall:  38%|###7      | 1131/3000 [31:37<35:44,  1.15s/it, lr: 1.0e-04 loss: 7.282e-01]
a-cold-wall:  38%|###7      | 1132/3000 [31:37<48:54,  1.57s/it, lr: 1.0e-04 loss: 7.282e-01]
a-cold-wall:  38%|###7      | 1132/3000 [31:37<48:54,  1.57s/it, lr: 1.0e-04 loss: 7.282e-01]
a-cold-wall:  38%|###7      | 1132/3000 [31:39<48:54,  1.57s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  38%|###7      | 1132/3000 [31:39<48:54,  1.57s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  38%|###7      | 1133/3000 [31:39<47:46,  1.54s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  38%|###7      | 1133/3000 [31:39<47:46,  1.54s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  38%|###7      | 1133/3000 [31:42<47:46,  1.54s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  38%|###7      | 1133/3000 [31:42<47:46,  1.54s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  38%|###7      | 1134/3000 [31:42<59:02,  1.90s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  38%|###7      | 1134/3000 [31:42<59:02,  1.90s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  38%|###7      | 1134/3000 [31:45<59:02,  1.90s/it, lr: 1.0e-04 loss: 3.430e-01]
a-cold-wall:  38%|###7      | 1134/3000 [31:45<59:02,  1.90s/it, lr: 1.0e-04 loss: 3.430e-01]
a-cold-wall:  38%|###7      | 1135/3000 [31:45<1:08:26,  2.20s/it, lr: 1.0e-04 loss: 3.430e-01]
a-cold-wall:  38%|###7      | 1135/3000 [31:45<1:08:26,  2.20s/it, lr: 1.0e-04 loss: 3.430e-01]
a-cold-wall:  38%|###7      | 1135/3000 [31:46<1:08:26,  2.20s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  38%|###7      | 1135/3000 [31:46<1:08:26,  2.20s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  38%|###7      | 1136/3000 [31:46<1:01:12,  1.97s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  38%|###7      | 1136/3000 [31:46<1:01:12,  1.97s/it, lr: 1.0e-04 loss: 2.576e-01]
a-cold-wall:  38%|###7      | 1136/3000 [31:49<1:01:12,  1.97s/it, lr: 1.0e-04 loss: 2.093e-01]
a-cold-wall:  38%|###7      | 1136/3000 [31:49<1:01:12,  1.97s/it, lr: 1.0e-04 loss: 2.093e-01]
a-cold-wall:  38%|###7      | 1137/3000 [31:49<1:09:35,  2.24s/it, lr: 1.0e-04 loss: 2.093e-01]
a-cold-wall:  38%|###7      | 1137/3000 [31:49<1:09:35,  2.24s/it, lr: 1.0e-04 loss: 2.093e-01]
a-cold-wall:  38%|###7      | 1137/3000 [31:50<1:09:35,  2.24s/it, lr: 1.0e-04 loss: 4.890e-01]
a-cold-wall:  38%|###7      | 1137/3000 [31:50<1:09:35,  2.24s/it, lr: 1.0e-04 loss: 4.890e-01]
a-cold-wall:  38%|###7      | 1138/3000 [31:50<1:02:14,  2.01s/it, lr: 1.0e-04 loss: 4.890e-01]
a-cold-wall:  38%|###7      | 1138/3000 [31:50<1:02:14,  2.01s/it, lr: 1.0e-04 loss: 4.890e-01]
a-cold-wall:  38%|###7      | 1138/3000 [31:51<1:02:14,  2.01s/it, lr: 1.0e-04 loss: 4.220e-01]
a-cold-wall:  38%|###7      | 1138/3000 [31:51<1:02:14,  2.01s/it, lr: 1.0e-04 loss: 4.220e-01]
a-cold-wall:  38%|###7      | 1139/3000 [31:51<50:42,  1.63s/it, lr: 1.0e-04 loss: 4.220e-01]  
a-cold-wall:  38%|###7      | 1139/3000 [31:51<50:42,  1.63s/it, lr: 1.0e-04 loss: 4.220e-01]  
a-cold-wall:  38%|###7      | 1139/3000 [31:52<50:42,  1.63s/it, lr: 1.0e-04 loss: 2.066e-01]
a-cold-wall:  38%|###7      | 1139/3000 [31:52<50:42,  1.63s/it, lr: 1.0e-04 loss: 2.066e-01]
a-cold-wall:  38%|###8      | 1140/3000 [31:55<50:40,  1.63s/it, lr: 1.0e-04 loss: 9.090e-02]
a-cold-wall:  38%|###8      | 1140/3000 [31:55<50:40,  1.63s/it, lr: 1.0e-04 loss: 9.090e-02]
a-cold-wall:  38%|###8      | 1141/3000 [31:55<48:07,  1.55s/it, lr: 1.0e-04 loss: 9.090e-02]
a-cold-wall:  38%|###8      | 1141/3000 [31:55<48:07,  1.55s/it, lr: 1.0e-04 loss: 9.090e-02]
a-cold-wall:  38%|###8      | 1141/3000 [31:56<48:07,  1.55s/it, lr: 1.0e-04 loss: 6.562e-02]
a-cold-wall:  38%|###8      | 1141/3000 [31:56<48:07,  1.55s/it, lr: 1.0e-04 loss: 6.562e-02]
a-cold-wall:  38%|###8      | 1142/3000 [31:56<42:02,  1.36s/it, lr: 1.0e-04 loss: 6.562e-02]
a-cold-wall:  38%|###8      | 1142/3000 [31:56<42:02,  1.36s/it, lr: 1.0e-04 loss: 6.562e-02]
a-cold-wall:  38%|###8      | 1142/3000 [31:59<42:02,  1.36s/it, lr: 1.0e-04 loss: 5.062e-02]
a-cold-wall:  38%|###8      | 1142/3000 [31:59<42:02,  1.36s/it, lr: 1.0e-04 loss: 5.062e-02]
a-cold-wall:  38%|###8      | 1143/3000 [31:59<54:20,  1.76s/it, lr: 1.0e-04 loss: 5.062e-02]
a-cold-wall:  38%|###8      | 1143/3000 [31:59<54:20,  1.76s/it, lr: 1.0e-04 loss: 5.062e-02]
a-cold-wall:  38%|###8      | 1143/3000 [32:02<54:20,  1.76s/it, lr: 1.0e-04 loss: 2.315e-02]
a-cold-wall:  38%|###8      | 1143/3000 [32:02<54:20,  1.76s/it, lr: 1.0e-04 loss: 2.315e-02]
a-cold-wall:  38%|###8      | 1144/3000 [32:02<1:03:44,  2.06s/it, lr: 1.0e-04 loss: 2.315e-02]
a-cold-wall:  38%|###8      | 1144/3000 [32:02<1:03:44,  2.06s/it, lr: 1.0e-04 loss: 2.315e-02]
a-cold-wall:  38%|###8      | 1144/3000 [32:04<1:03:44,  2.06s/it, lr: 1.0e-04 loss: 7.632e-02]
a-cold-wall:  38%|###8      | 1144/3000 [32:04<1:03:44,  2.06s/it, lr: 1.0e-04 loss: 7.632e-02]
a-cold-wall:  38%|###8      | 1145/3000 [32:04<1:11:00,  2.30s/it, lr: 1.0e-04 loss: 7.632e-02]
a-cold-wall:  38%|###8      | 1145/3000 [32:04<1:11:00,  2.30s/it, lr: 1.0e-04 loss: 7.632e-02]
a-cold-wall:  38%|###8      | 1145/3000 [32:06<1:11:00,  2.30s/it, lr: 1.0e-04 loss: 1.462e-01]
a-cold-wall:  38%|###8      | 1145/3000 [32:06<1:11:00,  2.30s/it, lr: 1.0e-04 loss: 1.462e-01]
a-cold-wall:  38%|###8      | 1146/3000 [32:06<1:03:25,  2.05s/it, lr: 1.0e-04 loss: 1.462e-01]
a-cold-wall:  38%|###8      | 1146/3000 [32:06<1:03:25,  2.05s/it, lr: 1.0e-04 loss: 1.462e-01]
a-cold-wall:  38%|###8      | 1146/3000 [32:07<1:03:25,  2.05s/it, lr: 1.0e-04 loss: 6.541e-01]
a-cold-wall:  38%|###8      | 1146/3000 [32:07<1:03:25,  2.05s/it, lr: 1.0e-04 loss: 6.541e-01]
a-cold-wall:  38%|###8      | 1147/3000 [32:07<51:46,  1.68s/it, lr: 1.0e-04 loss: 6.541e-01]  
a-cold-wall:  38%|###8      | 1147/3000 [32:07<51:46,  1.68s/it, lr: 1.0e-04 loss: 6.541e-01]  
a-cold-wall:  38%|###8      | 1147/3000 [32:10<51:46,  1.68s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  38%|###8      | 1147/3000 [32:10<51:46,  1.68s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  38%|###8      | 1148/3000 [32:10<1:02:50,  2.04s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  38%|###8      | 1148/3000 [32:10<1:02:50,  2.04s/it, lr: 1.0e-04 loss: 6.733e-01]
a-cold-wall:  38%|###8      | 1148/3000 [32:11<1:02:50,  2.04s/it, lr: 1.0e-04 loss: 1.326e-01]
a-cold-wall:  38%|###8      | 1148/3000 [32:11<1:02:50,  2.04s/it, lr: 1.0e-04 loss: 1.326e-01]
a-cold-wall:  38%|###8      | 1149/3000 [32:11<53:18,  1.73s/it, lr: 1.0e-04 loss: 1.326e-01]  
a-cold-wall:  38%|###8      | 1149/3000 [32:11<53:18,  1.73s/it, lr: 1.0e-04 loss: 1.326e-01]  
a-cold-wall:  38%|###8      | 1149/3000 [32:12<53:18,  1.73s/it, lr: 1.0e-04 loss: 5.919e-02]
a-cold-wall:  38%|###8      | 1149/3000 [32:12<53:18,  1.73s/it, lr: 1.0e-04 loss: 5.919e-02]
a-cold-wall:  38%|###8      | 1150/3000 [32:15<53:16,  1.73s/it, lr: 1.0e-04 loss: 3.193e-01]
a-cold-wall:  38%|###8      | 1150/3000 [32:15<53:16,  1.73s/it, lr: 1.0e-04 loss: 3.193e-01]
a-cold-wall:  38%|###8      | 1151/3000 [32:15<49:22,  1.60s/it, lr: 1.0e-04 loss: 3.193e-01]
a-cold-wall:  38%|###8      | 1151/3000 [32:15<49:22,  1.60s/it, lr: 1.0e-04 loss: 3.193e-01]
a-cold-wall:  38%|###8      | 1151/3000 [32:16<49:22,  1.60s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  38%|###8      | 1151/3000 [32:16<49:22,  1.60s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  38%|###8      | 1152/3000 [32:16<48:05,  1.56s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  38%|###8      | 1152/3000 [32:16<48:05,  1.56s/it, lr: 1.0e-04 loss: 2.662e-01]
a-cold-wall:  38%|###8      | 1152/3000 [32:18<48:05,  1.56s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  38%|###8      | 1152/3000 [32:18<48:05,  1.56s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  38%|###8      | 1153/3000 [32:18<47:03,  1.53s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  38%|###8      | 1153/3000 [32:18<47:03,  1.53s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  38%|###8      | 1153/3000 [32:19<47:03,  1.53s/it, lr: 1.0e-04 loss: 1.511e-01]
a-cold-wall:  38%|###8      | 1153/3000 [32:19<47:03,  1.53s/it, lr: 1.0e-04 loss: 1.511e-01]
a-cold-wall:  38%|###8      | 1154/3000 [32:19<46:14,  1.50s/it, lr: 1.0e-04 loss: 1.511e-01]
a-cold-wall:  38%|###8      | 1154/3000 [32:19<46:14,  1.50s/it, lr: 1.0e-04 loss: 1.511e-01]
a-cold-wall:  38%|###8      | 1154/3000 [32:20<46:14,  1.50s/it, lr: 1.0e-04 loss: 1.563e-01]
a-cold-wall:  38%|###8      | 1154/3000 [32:20<46:14,  1.50s/it, lr: 1.0e-04 loss: 1.563e-01]
a-cold-wall:  38%|###8      | 1155/3000 [32:20<40:28,  1.32s/it, lr: 1.0e-04 loss: 1.563e-01]
a-cold-wall:  38%|###8      | 1155/3000 [32:20<40:28,  1.32s/it, lr: 1.0e-04 loss: 1.563e-01]
a-cold-wall:  38%|###8      | 1155/3000 [32:22<40:28,  1.32s/it, lr: 1.0e-04 loss: 4.997e-01]
a-cold-wall:  38%|###8      | 1155/3000 [32:22<40:28,  1.32s/it, lr: 1.0e-04 loss: 4.997e-01]
a-cold-wall:  39%|###8      | 1156/3000 [32:22<41:23,  1.35s/it, lr: 1.0e-04 loss: 4.997e-01]
a-cold-wall:  39%|###8      | 1156/3000 [32:22<41:23,  1.35s/it, lr: 1.0e-04 loss: 4.997e-01]
a-cold-wall:  39%|###8      | 1156/3000 [32:25<41:23,  1.35s/it, lr: 1.0e-04 loss: 6.685e-01]
a-cold-wall:  39%|###8      | 1156/3000 [32:25<41:23,  1.35s/it, lr: 1.0e-04 loss: 6.685e-01]
a-cold-wall:  39%|###8      | 1157/3000 [32:25<54:58,  1.79s/it, lr: 1.0e-04 loss: 6.685e-01]
a-cold-wall:  39%|###8      | 1157/3000 [32:25<54:58,  1.79s/it, lr: 1.0e-04 loss: 6.685e-01]
a-cold-wall:  39%|###8      | 1157/3000 [32:26<54:58,  1.79s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  39%|###8      | 1157/3000 [32:26<54:58,  1.79s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  39%|###8      | 1158/3000 [32:26<45:37,  1.49s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  39%|###8      | 1158/3000 [32:26<45:37,  1.49s/it, lr: 1.0e-04 loss: 3.037e-01]
a-cold-wall:  39%|###8      | 1158/3000 [32:28<45:37,  1.49s/it, lr: 1.0e-04 loss: 4.369e-01]
a-cold-wall:  39%|###8      | 1158/3000 [32:28<45:37,  1.49s/it, lr: 1.0e-04 loss: 4.369e-01]
a-cold-wall:  39%|###8      | 1159/3000 [32:28<58:08,  1.89s/it, lr: 1.0e-04 loss: 4.369e-01]
a-cold-wall:  39%|###8      | 1159/3000 [32:28<58:08,  1.89s/it, lr: 1.0e-04 loss: 4.369e-01]
a-cold-wall:  39%|###8      | 1159/3000 [32:29<58:08,  1.89s/it, lr: 1.0e-04 loss: 7.222e-02]
a-cold-wall:  39%|###8      | 1159/3000 [32:29<58:08,  1.89s/it, lr: 1.0e-04 loss: 7.222e-02]
a-cold-wall:  39%|###8      | 1160/3000 [32:30<58:06,  1.89s/it, lr: 1.0e-04 loss: 4.324e-01]
a-cold-wall:  39%|###8      | 1160/3000 [32:30<58:06,  1.89s/it, lr: 1.0e-04 loss: 4.324e-01]
a-cold-wall:  39%|###8      | 1161/3000 [32:30<37:22,  1.22s/it, lr: 1.0e-04 loss: 4.324e-01]
a-cold-wall:  39%|###8      | 1161/3000 [32:30<37:22,  1.22s/it, lr: 1.0e-04 loss: 4.324e-01]
a-cold-wall:  39%|###8      | 1161/3000 [32:31<37:22,  1.22s/it, lr: 1.0e-04 loss: 3.505e-01]
a-cold-wall:  39%|###8      | 1161/3000 [32:31<37:22,  1.22s/it, lr: 1.0e-04 loss: 3.505e-01]
a-cold-wall:  39%|###8      | 1162/3000 [32:31<33:41,  1.10s/it, lr: 1.0e-04 loss: 3.505e-01]
a-cold-wall:  39%|###8      | 1162/3000 [32:31<33:41,  1.10s/it, lr: 1.0e-04 loss: 3.505e-01]
a-cold-wall:  39%|###8      | 1162/3000 [32:32<33:41,  1.10s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  39%|###8      | 1162/3000 [32:32<33:41,  1.10s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  39%|###8      | 1163/3000 [32:32<38:15,  1.25s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  39%|###8      | 1163/3000 [32:32<38:15,  1.25s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  39%|###8      | 1163/3000 [32:34<38:15,  1.25s/it, lr: 1.0e-04 loss: 2.557e-01]
a-cold-wall:  39%|###8      | 1163/3000 [32:34<38:15,  1.25s/it, lr: 1.0e-04 loss: 2.557e-01]
a-cold-wall:  39%|###8      | 1164/3000 [32:34<39:48,  1.30s/it, lr: 1.0e-04 loss: 2.557e-01]
a-cold-wall:  39%|###8      | 1164/3000 [32:34<39:48,  1.30s/it, lr: 1.0e-04 loss: 2.557e-01]
a-cold-wall:  39%|###8      | 1164/3000 [32:35<39:48,  1.30s/it, lr: 1.0e-04 loss: 2.430e-01]
a-cold-wall:  39%|###8      | 1164/3000 [32:35<39:48,  1.30s/it, lr: 1.0e-04 loss: 2.430e-01]
a-cold-wall:  39%|###8      | 1165/3000 [32:35<35:04,  1.15s/it, lr: 1.0e-04 loss: 2.430e-01]
a-cold-wall:  39%|###8      | 1165/3000 [32:35<35:04,  1.15s/it, lr: 1.0e-04 loss: 2.430e-01]
a-cold-wall:  39%|###8      | 1165/3000 [32:36<35:04,  1.15s/it, lr: 1.0e-04 loss: 7.496e-02]
a-cold-wall:  39%|###8      | 1165/3000 [32:36<35:04,  1.15s/it, lr: 1.0e-04 loss: 7.496e-02]
a-cold-wall:  39%|###8      | 1166/3000 [32:36<37:30,  1.23s/it, lr: 1.0e-04 loss: 7.496e-02]
a-cold-wall:  39%|###8      | 1166/3000 [32:36<37:30,  1.23s/it, lr: 1.0e-04 loss: 7.496e-02]
a-cold-wall:  39%|###8      | 1166/3000 [32:39<37:30,  1.23s/it, lr: 1.0e-04 loss: 2.560e-01]
a-cold-wall:  39%|###8      | 1166/3000 [32:39<37:30,  1.23s/it, lr: 1.0e-04 loss: 2.560e-01]
a-cold-wall:  39%|###8      | 1167/3000 [32:39<52:22,  1.71s/it, lr: 1.0e-04 loss: 2.560e-01]
a-cold-wall:  39%|###8      | 1167/3000 [32:39<52:22,  1.71s/it, lr: 1.0e-04 loss: 2.560e-01]
a-cold-wall:  39%|###8      | 1167/3000 [32:40<52:22,  1.71s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall:  39%|###8      | 1167/3000 [32:40<52:22,  1.71s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall:  39%|###8      | 1168/3000 [32:40<50:03,  1.64s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall:  39%|###8      | 1168/3000 [32:40<50:03,  1.64s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall:  39%|###8      | 1168/3000 [32:41<50:03,  1.64s/it, lr: 1.0e-04 loss: 2.162e-01]
a-cold-wall:  39%|###8      | 1168/3000 [32:41<50:03,  1.64s/it, lr: 1.0e-04 loss: 2.162e-01]
a-cold-wall:  39%|###8      | 1169/3000 [32:41<42:12,  1.38s/it, lr: 1.0e-04 loss: 2.162e-01]
a-cold-wall:  39%|###8      | 1169/3000 [32:41<42:12,  1.38s/it, lr: 1.0e-04 loss: 2.162e-01]
a-cold-wall:  39%|###8      | 1169/3000 [32:42<42:12,  1.38s/it, lr: 1.0e-04 loss: 4.579e-01]
a-cold-wall:  39%|###8      | 1169/3000 [32:42<42:12,  1.38s/it, lr: 1.0e-04 loss: 4.579e-01]
a-cold-wall:  39%|###9      | 1170/3000 [32:45<42:10,  1.38s/it, lr: 1.0e-04 loss: 8.598e-01]
a-cold-wall:  39%|###9      | 1170/3000 [32:45<42:10,  1.38s/it, lr: 1.0e-04 loss: 8.598e-01]
a-cold-wall:  39%|###9      | 1171/3000 [32:45<43:13,  1.42s/it, lr: 1.0e-04 loss: 8.598e-01]
a-cold-wall:  39%|###9      | 1171/3000 [32:45<43:13,  1.42s/it, lr: 1.0e-04 loss: 8.598e-01]
a-cold-wall:  39%|###9      | 1171/3000 [32:48<43:13,  1.42s/it, lr: 1.0e-04 loss: 3.437e-02]
a-cold-wall:  39%|###9      | 1171/3000 [32:48<43:13,  1.42s/it, lr: 1.0e-04 loss: 3.437e-02]
a-cold-wall:  39%|###9      | 1172/3000 [32:48<54:27,  1.79s/it, lr: 1.0e-04 loss: 3.437e-02]
a-cold-wall:  39%|###9      | 1172/3000 [32:48<54:27,  1.79s/it, lr: 1.0e-04 loss: 3.437e-02]
a-cold-wall:  39%|###9      | 1172/3000 [32:51<54:27,  1.79s/it, lr: 1.0e-04 loss: 8.616e-02]
a-cold-wall:  39%|###9      | 1172/3000 [32:51<54:27,  1.79s/it, lr: 1.0e-04 loss: 8.616e-02]
a-cold-wall:  39%|###9      | 1173/3000 [32:51<1:03:20,  2.08s/it, lr: 1.0e-04 loss: 8.616e-02]
a-cold-wall:  39%|###9      | 1173/3000 [32:51<1:03:20,  2.08s/it, lr: 1.0e-04 loss: 8.616e-02]
a-cold-wall:  39%|###9      | 1173/3000 [32:51<1:03:20,  2.08s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  39%|###9      | 1173/3000 [32:51<1:03:20,  2.08s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  39%|###9      | 1174/3000 [32:51<52:23,  1.72s/it, lr: 1.0e-04 loss: 1.514e-01]  
a-cold-wall:  39%|###9      | 1174/3000 [32:51<52:23,  1.72s/it, lr: 1.0e-04 loss: 1.514e-01]  
a-cold-wall:  39%|###9      | 1174/3000 [32:54<52:23,  1.72s/it, lr: 1.0e-04 loss: 4.611e-01]
a-cold-wall:  39%|###9      | 1174/3000 [32:54<52:23,  1.72s/it, lr: 1.0e-04 loss: 4.611e-01]
a-cold-wall:  39%|###9      | 1175/3000 [32:54<1:02:10,  2.04s/it, lr: 1.0e-04 loss: 4.611e-01]
a-cold-wall:  39%|###9      | 1175/3000 [32:54<1:02:10,  2.04s/it, lr: 1.0e-04 loss: 4.611e-01]
a-cold-wall:  39%|###9      | 1175/3000 [32:57<1:02:10,  2.04s/it, lr: 1.0e-04 loss: 8.654e-01]
a-cold-wall:  39%|###9      | 1175/3000 [32:57<1:02:10,  2.04s/it, lr: 1.0e-04 loss: 8.654e-01]
a-cold-wall:  39%|###9      | 1176/3000 [32:57<1:10:18,  2.31s/it, lr: 1.0e-04 loss: 8.654e-01]
a-cold-wall:  39%|###9      | 1176/3000 [32:57<1:10:18,  2.31s/it, lr: 1.0e-04 loss: 8.654e-01]
a-cold-wall:  39%|###9      | 1176/3000 [32:58<1:10:18,  2.31s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  39%|###9      | 1176/3000 [32:58<1:10:18,  2.31s/it, lr: 1.0e-04 loss: 5.104e-01]
a-cold-wall:  39%|###9      | 1177/3000 [32:58<56:35,  1.86s/it, lr: 1.0e-04 loss: 5.104e-01]  
a-cold-wall:  39%|###9      | 1177/3000 [32:58<56:35,  1.86s/it, lr: 1.0e-04 loss: 5.104e-01]  
a-cold-wall:  39%|###9      | 1177/3000 [32:59<56:35,  1.86s/it, lr: 1.0e-04 loss: 3.649e-01]
a-cold-wall:  39%|###9      | 1177/3000 [32:59<56:35,  1.86s/it, lr: 1.0e-04 loss: 3.649e-01]
a-cold-wall:  39%|###9      | 1178/3000 [32:59<48:38,  1.60s/it, lr: 1.0e-04 loss: 3.649e-01]
a-cold-wall:  39%|###9      | 1178/3000 [32:59<48:38,  1.60s/it, lr: 1.0e-04 loss: 3.649e-01]
a-cold-wall:  39%|###9      | 1178/3000 [33:00<48:38,  1.60s/it, lr: 1.0e-04 loss: 8.406e-01]
a-cold-wall:  39%|###9      | 1178/3000 [33:00<48:38,  1.60s/it, lr: 1.0e-04 loss: 8.406e-01]
a-cold-wall:  39%|###9      | 1179/3000 [33:00<41:07,  1.35s/it, lr: 1.0e-04 loss: 8.406e-01]
a-cold-wall:  39%|###9      | 1179/3000 [33:00<41:07,  1.35s/it, lr: 1.0e-04 loss: 8.406e-01]
a-cold-wall:  39%|###9      | 1179/3000 [33:01<41:07,  1.35s/it, lr: 1.0e-04 loss: 6.270e-01]
a-cold-wall:  39%|###9      | 1179/3000 [33:01<41:07,  1.35s/it, lr: 1.0e-04 loss: 6.270e-01]
a-cold-wall:  39%|###9      | 1180/3000 [33:04<41:05,  1.35s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  39%|###9      | 1180/3000 [33:04<41:05,  1.35s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  39%|###9      | 1181/3000 [33:04<42:22,  1.40s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  39%|###9      | 1181/3000 [33:04<42:22,  1.40s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  39%|###9      | 1181/3000 [33:05<42:22,  1.40s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  39%|###9      | 1181/3000 [33:05<42:22,  1.40s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  39%|###9      | 1182/3000 [33:05<39:10,  1.29s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  39%|###9      | 1182/3000 [33:05<39:10,  1.29s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  39%|###9      | 1182/3000 [33:07<39:10,  1.29s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:  39%|###9      | 1182/3000 [33:07<39:10,  1.29s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:  39%|###9      | 1183/3000 [33:07<40:06,  1.32s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:  39%|###9      | 1183/3000 [33:07<40:06,  1.32s/it, lr: 1.0e-04 loss: 6.211e-01]
a-cold-wall:  39%|###9      | 1183/3000 [33:07<40:06,  1.32s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  39%|###9      | 1183/3000 [33:07<40:06,  1.32s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  39%|###9      | 1184/3000 [33:07<35:22,  1.17s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  39%|###9      | 1184/3000 [33:07<35:22,  1.17s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  39%|###9      | 1184/3000 [33:10<35:22,  1.17s/it, lr: 1.0e-04 loss: 3.903e-01]
a-cold-wall:  39%|###9      | 1184/3000 [33:10<35:22,  1.17s/it, lr: 1.0e-04 loss: 3.903e-01]
a-cold-wall:  40%|###9      | 1185/3000 [33:10<50:17,  1.66s/it, lr: 1.0e-04 loss: 3.903e-01]
a-cold-wall:  40%|###9      | 1185/3000 [33:10<50:17,  1.66s/it, lr: 1.0e-04 loss: 3.903e-01]
a-cold-wall:  40%|###9      | 1185/3000 [33:12<50:17,  1.66s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  40%|###9      | 1185/3000 [33:12<50:17,  1.66s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  40%|###9      | 1186/3000 [33:12<48:13,  1.60s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  40%|###9      | 1186/3000 [33:12<48:13,  1.60s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  40%|###9      | 1186/3000 [33:12<48:13,  1.60s/it, lr: 1.0e-04 loss: 7.257e-01]
a-cold-wall:  40%|###9      | 1186/3000 [33:12<48:13,  1.60s/it, lr: 1.0e-04 loss: 7.257e-01]
a-cold-wall:  40%|###9      | 1187/3000 [33:12<40:48,  1.35s/it, lr: 1.0e-04 loss: 7.257e-01]
a-cold-wall:  40%|###9      | 1187/3000 [33:12<40:48,  1.35s/it, lr: 1.0e-04 loss: 7.257e-01]
a-cold-wall:  40%|###9      | 1187/3000 [33:14<40:48,  1.35s/it, lr: 1.0e-04 loss: 2.152e-01]
a-cold-wall:  40%|###9      | 1187/3000 [33:14<40:48,  1.35s/it, lr: 1.0e-04 loss: 2.152e-01]
a-cold-wall:  40%|###9      | 1188/3000 [33:14<41:36,  1.38s/it, lr: 1.0e-04 loss: 2.152e-01]
a-cold-wall:  40%|###9      | 1188/3000 [33:14<41:36,  1.38s/it, lr: 1.0e-04 loss: 2.152e-01]
a-cold-wall:  40%|###9      | 1188/3000 [33:15<41:36,  1.38s/it, lr: 1.0e-04 loss: 1.758e-01]
a-cold-wall:  40%|###9      | 1188/3000 [33:15<41:36,  1.38s/it, lr: 1.0e-04 loss: 1.758e-01]
a-cold-wall:  40%|###9      | 1189/3000 [33:15<43:18,  1.43s/it, lr: 1.0e-04 loss: 1.758e-01]
a-cold-wall:  40%|###9      | 1189/3000 [33:15<43:18,  1.43s/it, lr: 1.0e-04 loss: 1.758e-01]
a-cold-wall:  40%|###9      | 1189/3000 [33:17<43:18,  1.43s/it, lr: 1.0e-04 loss: 9.665e-02]
a-cold-wall:  40%|###9      | 1189/3000 [33:17<43:18,  1.43s/it, lr: 1.0e-04 loss: 9.665e-02]
a-cold-wall:  40%|###9      | 1190/3000 [33:18<43:16,  1.43s/it, lr: 1.0e-04 loss: 3.331e-01]
a-cold-wall:  40%|###9      | 1190/3000 [33:18<43:16,  1.43s/it, lr: 1.0e-04 loss: 3.331e-01]
a-cold-wall:  40%|###9      | 1191/3000 [33:18<28:36,  1.05it/s, lr: 1.0e-04 loss: 3.331e-01]
a-cold-wall:  40%|###9      | 1191/3000 [33:18<28:36,  1.05it/s, lr: 1.0e-04 loss: 3.331e-01]
a-cold-wall:  40%|###9      | 1191/3000 [33:18<28:36,  1.05it/s, lr: 1.0e-04 loss: 3.798e-01]
a-cold-wall:  40%|###9      | 1191/3000 [33:18<28:36,  1.05it/s, lr: 1.0e-04 loss: 3.798e-01]
a-cold-wall:  40%|###9      | 1192/3000 [33:18<27:07,  1.11it/s, lr: 1.0e-04 loss: 3.798e-01]
a-cold-wall:  40%|###9      | 1192/3000 [33:18<27:07,  1.11it/s, lr: 1.0e-04 loss: 3.798e-01]
a-cold-wall:  40%|###9      | 1192/3000 [33:20<27:07,  1.11it/s, lr: 1.0e-04 loss: 1.792e-01]
a-cold-wall:  40%|###9      | 1192/3000 [33:20<27:07,  1.11it/s, lr: 1.0e-04 loss: 1.792e-01]
a-cold-wall:  40%|###9      | 1193/3000 [33:20<31:12,  1.04s/it, lr: 1.0e-04 loss: 1.792e-01]
a-cold-wall:  40%|###9      | 1193/3000 [33:20<31:12,  1.04s/it, lr: 1.0e-04 loss: 1.792e-01]
a-cold-wall:  40%|###9      | 1193/3000 [33:20<31:12,  1.04s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  40%|###9      | 1193/3000 [33:20<31:12,  1.04s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  40%|###9      | 1194/3000 [33:20<28:47,  1.05it/s, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  40%|###9      | 1194/3000 [33:20<28:47,  1.05it/s, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  40%|###9      | 1194/3000 [33:22<28:47,  1.05it/s, lr: 1.0e-04 loss: 3.173e-01]
a-cold-wall:  40%|###9      | 1194/3000 [33:22<28:47,  1.05it/s, lr: 1.0e-04 loss: 3.173e-01]
a-cold-wall:  40%|###9      | 1195/3000 [33:22<32:41,  1.09s/it, lr: 1.0e-04 loss: 3.173e-01]
a-cold-wall:  40%|###9      | 1195/3000 [33:22<32:41,  1.09s/it, lr: 1.0e-04 loss: 3.173e-01]
a-cold-wall:  40%|###9      | 1195/3000 [33:25<32:41,  1.09s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  40%|###9      | 1195/3000 [33:25<32:41,  1.09s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  40%|###9      | 1196/3000 [33:25<48:01,  1.60s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  40%|###9      | 1196/3000 [33:25<48:01,  1.60s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  40%|###9      | 1196/3000 [33:26<48:01,  1.60s/it, lr: 1.0e-04 loss: 3.424e-01]
a-cold-wall:  40%|###9      | 1196/3000 [33:26<48:01,  1.60s/it, lr: 1.0e-04 loss: 3.424e-01]
a-cold-wall:  40%|###9      | 1197/3000 [33:26<46:28,  1.55s/it, lr: 1.0e-04 loss: 3.424e-01]
a-cold-wall:  40%|###9      | 1197/3000 [33:26<46:28,  1.55s/it, lr: 1.0e-04 loss: 3.424e-01]
a-cold-wall:  40%|###9      | 1197/3000 [33:29<46:28,  1.55s/it, lr: 1.0e-04 loss: 3.838e-01]
a-cold-wall:  40%|###9      | 1197/3000 [33:29<46:28,  1.55s/it, lr: 1.0e-04 loss: 3.838e-01]
a-cold-wall:  40%|###9      | 1198/3000 [33:29<57:53,  1.93s/it, lr: 1.0e-04 loss: 3.838e-01]
a-cold-wall:  40%|###9      | 1198/3000 [33:29<57:53,  1.93s/it, lr: 1.0e-04 loss: 3.838e-01]
a-cold-wall:  40%|###9      | 1198/3000 [33:30<57:53,  1.93s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:  40%|###9      | 1198/3000 [33:30<57:53,  1.93s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:  40%|###9      | 1199/3000 [33:30<53:22,  1.78s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:  40%|###9      | 1199/3000 [33:30<53:22,  1.78s/it, lr: 1.0e-04 loss: 2.275e-01]
a-cold-wall:  40%|###9      | 1199/3000 [33:33<53:22,  1.78s/it, lr: 1.0e-04 loss: 2.764e-01]
a-cold-wall:  40%|###9      | 1199/3000 [33:33<53:22,  1.78s/it, lr: 1.0e-04 loss: 2.764e-01]
a-cold-wall:  40%|####      | 1200/3000 [33:36<53:20,  1.78s/it, lr: 1.0e-04 loss: 1.338e-01]
a-cold-wall:  40%|####      | 1200/3000 [33:36<53:20,  1.78s/it, lr: 1.0e-04 loss: 1.338e-01]
a-cold-wall:  40%|####      | 1201/3000 [33:36<48:28,  1.62s/it, lr: 1.0e-04 loss: 1.338e-01]
a-cold-wall:  40%|####      | 1201/3000 [33:36<48:28,  1.62s/it, lr: 1.0e-04 loss: 1.338e-01]
a-cold-wall:  40%|####      | 1201/3000 [33:37<48:28,  1.62s/it, lr: 1.0e-04 loss: 2.962e-01]
a-cold-wall:  40%|####      | 1201/3000 [33:37<48:28,  1.62s/it, lr: 1.0e-04 loss: 2.962e-01]
a-cold-wall:  40%|####      | 1202/3000 [33:37<43:42,  1.46s/it, lr: 1.0e-04 loss: 2.962e-01]
a-cold-wall:  40%|####      | 1202/3000 [33:37<43:42,  1.46s/it, lr: 1.0e-04 loss: 2.962e-01]
a-cold-wall:  40%|####      | 1202/3000 [33:40<43:42,  1.46s/it, lr: 1.0e-04 loss: 5.275e-01]
a-cold-wall:  40%|####      | 1202/3000 [33:40<43:42,  1.46s/it, lr: 1.0e-04 loss: 5.275e-01]
a-cold-wall:  40%|####      | 1203/3000 [33:40<54:29,  1.82s/it, lr: 1.0e-04 loss: 5.275e-01]
a-cold-wall:  40%|####      | 1203/3000 [33:40<54:29,  1.82s/it, lr: 1.0e-04 loss: 5.275e-01]
a-cold-wall:  40%|####      | 1203/3000 [33:43<54:29,  1.82s/it, lr: 1.0e-04 loss: 2.874e-01]
a-cold-wall:  40%|####      | 1203/3000 [33:43<54:29,  1.82s/it, lr: 1.0e-04 loss: 2.874e-01]
a-cold-wall:  40%|####      | 1204/3000 [33:43<1:02:46,  2.10s/it, lr: 1.0e-04 loss: 2.874e-01]
a-cold-wall:  40%|####      | 1204/3000 [33:43<1:02:46,  2.10s/it, lr: 1.0e-04 loss: 2.874e-01]
a-cold-wall:  40%|####      | 1204/3000 [33:44<1:02:46,  2.10s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  40%|####      | 1204/3000 [33:44<1:02:46,  2.10s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  40%|####      | 1205/3000 [33:44<57:06,  1.91s/it, lr: 1.0e-04 loss: 2.492e-01]  
a-cold-wall:  40%|####      | 1205/3000 [33:44<57:06,  1.91s/it, lr: 1.0e-04 loss: 2.492e-01]  
a-cold-wall:  40%|####      | 1205/3000 [33:45<57:06,  1.91s/it, lr: 1.0e-04 loss: 1.548e-02]
a-cold-wall:  40%|####      | 1205/3000 [33:45<57:06,  1.91s/it, lr: 1.0e-04 loss: 1.548e-02]
a-cold-wall:  40%|####      | 1206/3000 [33:45<47:06,  1.58s/it, lr: 1.0e-04 loss: 1.548e-02]
a-cold-wall:  40%|####      | 1206/3000 [33:45<47:06,  1.58s/it, lr: 1.0e-04 loss: 1.548e-02]
a-cold-wall:  40%|####      | 1206/3000 [33:46<47:06,  1.58s/it, lr: 1.0e-04 loss: 4.395e-01]
a-cold-wall:  40%|####      | 1206/3000 [33:46<47:06,  1.58s/it, lr: 1.0e-04 loss: 4.395e-01]
a-cold-wall:  40%|####      | 1207/3000 [33:46<39:56,  1.34s/it, lr: 1.0e-04 loss: 4.395e-01]
a-cold-wall:  40%|####      | 1207/3000 [33:46<39:56,  1.34s/it, lr: 1.0e-04 loss: 4.395e-01]
a-cold-wall:  40%|####      | 1207/3000 [33:47<39:56,  1.34s/it, lr: 1.0e-04 loss: 5.932e-01]
a-cold-wall:  40%|####      | 1207/3000 [33:47<39:56,  1.34s/it, lr: 1.0e-04 loss: 5.932e-01]
a-cold-wall:  40%|####      | 1208/3000 [33:47<34:41,  1.16s/it, lr: 1.0e-04 loss: 5.932e-01]
a-cold-wall:  40%|####      | 1208/3000 [33:47<34:41,  1.16s/it, lr: 1.0e-04 loss: 5.932e-01]
a-cold-wall:  40%|####      | 1208/3000 [33:49<34:41,  1.16s/it, lr: 1.0e-04 loss: 3.519e-01]
a-cold-wall:  40%|####      | 1208/3000 [33:49<34:41,  1.16s/it, lr: 1.0e-04 loss: 3.519e-01]
a-cold-wall:  40%|####      | 1209/3000 [33:49<49:46,  1.67s/it, lr: 1.0e-04 loss: 3.519e-01]
a-cold-wall:  40%|####      | 1209/3000 [33:49<49:46,  1.67s/it, lr: 1.0e-04 loss: 3.519e-01]
a-cold-wall:  40%|####      | 1209/3000 [33:50<49:46,  1.67s/it, lr: 1.0e-04 loss: 5.863e-01]
a-cold-wall:  40%|####      | 1209/3000 [33:50<49:46,  1.67s/it, lr: 1.0e-04 loss: 5.863e-01]
a-cold-wall:  40%|####      | 1210/3000 [33:52<49:44,  1.67s/it, lr: 1.0e-04 loss: 7.397e-01]
a-cold-wall:  40%|####      | 1210/3000 [33:52<49:44,  1.67s/it, lr: 1.0e-04 loss: 7.397e-01]
a-cold-wall:  40%|####      | 1211/3000 [33:52<36:48,  1.23s/it, lr: 1.0e-04 loss: 7.397e-01]
a-cold-wall:  40%|####      | 1211/3000 [33:52<36:48,  1.23s/it, lr: 1.0e-04 loss: 7.397e-01]
a-cold-wall:  40%|####      | 1211/3000 [33:53<36:48,  1.23s/it, lr: 1.0e-04 loss: 8.834e-02]
a-cold-wall:  40%|####      | 1211/3000 [33:53<36:48,  1.23s/it, lr: 1.0e-04 loss: 8.834e-02]
a-cold-wall:  40%|####      | 1212/3000 [33:53<38:05,  1.28s/it, lr: 1.0e-04 loss: 8.834e-02]
a-cold-wall:  40%|####      | 1212/3000 [33:53<38:05,  1.28s/it, lr: 1.0e-04 loss: 8.834e-02]
a-cold-wall:  40%|####      | 1212/3000 [33:54<38:05,  1.28s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  40%|####      | 1212/3000 [33:54<38:05,  1.28s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  40%|####      | 1213/3000 [33:54<39:11,  1.32s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  40%|####      | 1213/3000 [33:54<39:11,  1.32s/it, lr: 1.0e-04 loss: 4.293e-01]
a-cold-wall:  40%|####      | 1213/3000 [33:56<39:11,  1.32s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  40%|####      | 1213/3000 [33:56<39:11,  1.32s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  40%|####      | 1214/3000 [33:56<40:03,  1.35s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  40%|####      | 1214/3000 [33:56<40:03,  1.35s/it, lr: 1.0e-04 loss: 5.526e-01]
a-cold-wall:  40%|####      | 1214/3000 [33:57<40:03,  1.35s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  40%|####      | 1214/3000 [33:57<40:03,  1.35s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  40%|####      | 1215/3000 [33:57<40:18,  1.35s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  40%|####      | 1215/3000 [33:57<40:18,  1.35s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  40%|####      | 1215/3000 [33:59<40:18,  1.35s/it, lr: 1.0e-04 loss: 6.852e-01]
a-cold-wall:  40%|####      | 1215/3000 [33:59<40:18,  1.35s/it, lr: 1.0e-04 loss: 6.852e-01]
a-cold-wall:  41%|####      | 1216/3000 [33:59<40:51,  1.37s/it, lr: 1.0e-04 loss: 6.852e-01]
a-cold-wall:  41%|####      | 1216/3000 [33:59<40:51,  1.37s/it, lr: 1.0e-04 loss: 6.852e-01]
a-cold-wall:  41%|####      | 1216/3000 [34:00<40:51,  1.37s/it, lr: 1.0e-04 loss: 6.596e-01]
a-cold-wall:  41%|####      | 1216/3000 [34:00<40:51,  1.37s/it, lr: 1.0e-04 loss: 6.596e-01]
a-cold-wall:  41%|####      | 1217/3000 [34:00<42:44,  1.44s/it, lr: 1.0e-04 loss: 6.596e-01]
a-cold-wall:  41%|####      | 1217/3000 [34:00<42:44,  1.44s/it, lr: 1.0e-04 loss: 6.596e-01]
a-cold-wall:  41%|####      | 1217/3000 [34:03<42:44,  1.44s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:  41%|####      | 1217/3000 [34:03<42:44,  1.44s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:  41%|####      | 1218/3000 [34:03<55:17,  1.86s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:  41%|####      | 1218/3000 [34:03<55:17,  1.86s/it, lr: 1.0e-04 loss: 1.591e-01]
a-cold-wall:  41%|####      | 1218/3000 [34:05<55:17,  1.86s/it, lr: 1.0e-04 loss: 4.148e-01]
a-cold-wall:  41%|####      | 1218/3000 [34:05<55:17,  1.86s/it, lr: 1.0e-04 loss: 4.148e-01]
a-cold-wall:  41%|####      | 1219/3000 [34:05<51:22,  1.73s/it, lr: 1.0e-04 loss: 4.148e-01]
a-cold-wall:  41%|####      | 1219/3000 [34:05<51:22,  1.73s/it, lr: 1.0e-04 loss: 4.148e-01]
a-cold-wall:  41%|####      | 1219/3000 [34:07<51:22,  1.73s/it, lr: 1.0e-04 loss: 7.387e-01]
a-cold-wall:  41%|####      | 1219/3000 [34:07<51:22,  1.73s/it, lr: 1.0e-04 loss: 7.387e-01]
a-cold-wall:  41%|####      | 1220/3000 [34:10<51:20,  1.73s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  41%|####      | 1220/3000 [34:10<51:20,  1.73s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  41%|####      | 1221/3000 [34:10<47:30,  1.60s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  41%|####      | 1221/3000 [34:10<47:30,  1.60s/it, lr: 1.0e-04 loss: 1.261e-01]
a-cold-wall:  41%|####      | 1221/3000 [34:13<47:30,  1.60s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  41%|####      | 1221/3000 [34:13<47:30,  1.60s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  41%|####      | 1222/3000 [34:13<56:54,  1.92s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  41%|####      | 1222/3000 [34:13<56:54,  1.92s/it, lr: 1.0e-04 loss: 2.946e-01]
a-cold-wall:  41%|####      | 1222/3000 [34:15<56:54,  1.92s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  41%|####      | 1222/3000 [34:15<56:54,  1.92s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  41%|####      | 1223/3000 [34:15<53:00,  1.79s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  41%|####      | 1223/3000 [34:15<53:00,  1.79s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  41%|####      | 1223/3000 [34:16<53:00,  1.79s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:  41%|####      | 1223/3000 [34:16<53:00,  1.79s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:  41%|####      | 1224/3000 [34:16<50:07,  1.69s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:  41%|####      | 1224/3000 [34:16<50:07,  1.69s/it, lr: 1.0e-04 loss: 6.093e-01]
a-cold-wall:  41%|####      | 1224/3000 [34:17<50:07,  1.69s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  41%|####      | 1224/3000 [34:17<50:07,  1.69s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  41%|####      | 1225/3000 [34:17<47:55,  1.62s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  41%|####      | 1225/3000 [34:17<47:55,  1.62s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  41%|####      | 1225/3000 [34:18<47:55,  1.62s/it, lr: 1.0e-04 loss: 6.047e-02]
a-cold-wall:  41%|####      | 1225/3000 [34:18<47:55,  1.62s/it, lr: 1.0e-04 loss: 6.047e-02]
a-cold-wall:  41%|####      | 1226/3000 [34:18<40:25,  1.37s/it, lr: 1.0e-04 loss: 6.047e-02]
a-cold-wall:  41%|####      | 1226/3000 [34:18<40:25,  1.37s/it, lr: 1.0e-04 loss: 6.047e-02]
a-cold-wall:  41%|####      | 1226/3000 [34:19<40:25,  1.37s/it, lr: 1.0e-04 loss: 5.461e-01]
a-cold-wall:  41%|####      | 1226/3000 [34:19<40:25,  1.37s/it, lr: 1.0e-04 loss: 5.461e-01]
a-cold-wall:  41%|####      | 1227/3000 [34:19<35:06,  1.19s/it, lr: 1.0e-04 loss: 5.461e-01]
a-cold-wall:  41%|####      | 1227/3000 [34:19<35:06,  1.19s/it, lr: 1.0e-04 loss: 5.461e-01]
a-cold-wall:  41%|####      | 1227/3000 [34:20<35:06,  1.19s/it, lr: 1.0e-04 loss: 6.079e-01]
a-cold-wall:  41%|####      | 1227/3000 [34:20<35:06,  1.19s/it, lr: 1.0e-04 loss: 6.079e-01]
a-cold-wall:  41%|####      | 1228/3000 [34:20<31:21,  1.06s/it, lr: 1.0e-04 loss: 6.079e-01]
a-cold-wall:  41%|####      | 1228/3000 [34:20<31:21,  1.06s/it, lr: 1.0e-04 loss: 6.079e-01]
a-cold-wall:  41%|####      | 1228/3000 [34:23<31:21,  1.06s/it, lr: 1.0e-04 loss: 6.057e-01]
a-cold-wall:  41%|####      | 1228/3000 [34:23<31:21,  1.06s/it, lr: 1.0e-04 loss: 6.057e-01]
a-cold-wall:  41%|####      | 1229/3000 [34:23<47:24,  1.61s/it, lr: 1.0e-04 loss: 6.057e-01]
a-cold-wall:  41%|####      | 1229/3000 [34:23<47:24,  1.61s/it, lr: 1.0e-04 loss: 6.057e-01]
a-cold-wall:  41%|####      | 1229/3000 [34:23<47:24,  1.61s/it, lr: 1.0e-04 loss: 4.120e-01]
a-cold-wall:  41%|####      | 1229/3000 [34:23<47:24,  1.61s/it, lr: 1.0e-04 loss: 4.120e-01]
a-cold-wall:  41%|####1     | 1230/3000 [34:24<47:22,  1.61s/it, lr: 1.0e-04 loss: 2.956e-01]
a-cold-wall:  41%|####1     | 1230/3000 [34:24<47:22,  1.61s/it, lr: 1.0e-04 loss: 2.956e-01]
a-cold-wall:  41%|####1     | 1231/3000 [34:24<32:17,  1.10s/it, lr: 1.0e-04 loss: 2.956e-01]
a-cold-wall:  41%|####1     | 1231/3000 [34:24<32:17,  1.10s/it, lr: 1.0e-04 loss: 2.956e-01]
a-cold-wall:  41%|####1     | 1231/3000 [34:27<32:17,  1.10s/it, lr: 1.0e-04 loss: 1.829e-01]
a-cold-wall:  41%|####1     | 1231/3000 [34:27<32:17,  1.10s/it, lr: 1.0e-04 loss: 1.829e-01]
a-cold-wall:  41%|####1     | 1232/3000 [34:27<45:26,  1.54s/it, lr: 1.0e-04 loss: 1.829e-01]
a-cold-wall:  41%|####1     | 1232/3000 [34:27<45:26,  1.54s/it, lr: 1.0e-04 loss: 1.829e-01]
a-cold-wall:  41%|####1     | 1232/3000 [34:29<45:26,  1.54s/it, lr: 1.0e-04 loss: 7.121e-01]
a-cold-wall:  41%|####1     | 1232/3000 [34:29<45:26,  1.54s/it, lr: 1.0e-04 loss: 7.121e-01]
a-cold-wall:  41%|####1     | 1233/3000 [34:29<44:38,  1.52s/it, lr: 1.0e-04 loss: 7.121e-01]
a-cold-wall:  41%|####1     | 1233/3000 [34:29<44:38,  1.52s/it, lr: 1.0e-04 loss: 7.121e-01]
a-cold-wall:  41%|####1     | 1233/3000 [34:32<44:38,  1.52s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  41%|####1     | 1233/3000 [34:32<44:38,  1.52s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  41%|####1     | 1234/3000 [34:32<55:51,  1.90s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  41%|####1     | 1234/3000 [34:32<55:51,  1.90s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  41%|####1     | 1234/3000 [34:35<55:51,  1.90s/it, lr: 1.0e-04 loss: 1.163e-01]
a-cold-wall:  41%|####1     | 1234/3000 [34:35<55:51,  1.90s/it, lr: 1.0e-04 loss: 1.163e-01]
a-cold-wall:  41%|####1     | 1235/3000 [34:35<1:04:02,  2.18s/it, lr: 1.0e-04 loss: 1.163e-01]
a-cold-wall:  41%|####1     | 1235/3000 [34:35<1:04:02,  2.18s/it, lr: 1.0e-04 loss: 1.163e-01]
a-cold-wall:  41%|####1     | 1235/3000 [34:37<1:04:02,  2.18s/it, lr: 1.0e-04 loss: 3.974e-01]
a-cold-wall:  41%|####1     | 1235/3000 [34:37<1:04:02,  2.18s/it, lr: 1.0e-04 loss: 3.974e-01]
a-cold-wall:  41%|####1     | 1236/3000 [34:37<1:10:03,  2.38s/it, lr: 1.0e-04 loss: 3.974e-01]
a-cold-wall:  41%|####1     | 1236/3000 [34:37<1:10:03,  2.38s/it, lr: 1.0e-04 loss: 3.974e-01]
a-cold-wall:  41%|####1     | 1236/3000 [34:39<1:10:03,  2.38s/it, lr: 1.0e-04 loss: 5.074e-01]
a-cold-wall:  41%|####1     | 1236/3000 [34:39<1:10:03,  2.38s/it, lr: 1.0e-04 loss: 5.074e-01]
a-cold-wall:  41%|####1     | 1237/3000 [34:39<1:02:59,  2.14s/it, lr: 1.0e-04 loss: 5.074e-01]
a-cold-wall:  41%|####1     | 1237/3000 [34:39<1:02:59,  2.14s/it, lr: 1.0e-04 loss: 5.074e-01]
a-cold-wall:  41%|####1     | 1237/3000 [34:42<1:02:59,  2.14s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  41%|####1     | 1237/3000 [34:42<1:02:59,  2.14s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  41%|####1     | 1238/3000 [34:42<1:09:18,  2.36s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  41%|####1     | 1238/3000 [34:42<1:09:18,  2.36s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  41%|####1     | 1238/3000 [34:43<1:09:18,  2.36s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  41%|####1     | 1238/3000 [34:43<1:09:18,  2.36s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  41%|####1     | 1239/3000 [34:43<55:22,  1.89s/it, lr: 1.0e-04 loss: 6.844e-01]  
a-cold-wall:  41%|####1     | 1239/3000 [34:43<55:22,  1.89s/it, lr: 1.0e-04 loss: 6.844e-01]  
a-cold-wall:  41%|####1     | 1239/3000 [34:43<55:22,  1.89s/it, lr: 1.0e-04 loss: 1.435e-01]
a-cold-wall:  41%|####1     | 1239/3000 [34:43<55:22,  1.89s/it, lr: 1.0e-04 loss: 1.435e-01]
a-cold-wall:  41%|####1     | 1240/3000 [34:46<55:20,  1.89s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  41%|####1     | 1240/3000 [34:46<55:20,  1.89s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  41%|####1     | 1241/3000 [34:46<49:31,  1.69s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  41%|####1     | 1241/3000 [34:46<49:31,  1.69s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  41%|####1     | 1241/3000 [34:49<49:31,  1.69s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  41%|####1     | 1241/3000 [34:49<49:31,  1.69s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  41%|####1     | 1242/3000 [34:49<58:13,  1.99s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  41%|####1     | 1242/3000 [34:49<58:13,  1.99s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  41%|####1     | 1242/3000 [34:50<58:13,  1.99s/it, lr: 1.0e-04 loss: 4.933e-01]
a-cold-wall:  41%|####1     | 1242/3000 [34:50<58:13,  1.99s/it, lr: 1.0e-04 loss: 4.933e-01]
a-cold-wall:  41%|####1     | 1243/3000 [34:50<48:43,  1.66s/it, lr: 1.0e-04 loss: 4.933e-01]
a-cold-wall:  41%|####1     | 1243/3000 [34:50<48:43,  1.66s/it, lr: 1.0e-04 loss: 4.933e-01]
a-cold-wall:  41%|####1     | 1243/3000 [34:51<48:43,  1.66s/it, lr: 1.0e-04 loss: 1.738e-01]
a-cold-wall:  41%|####1     | 1243/3000 [34:51<48:43,  1.66s/it, lr: 1.0e-04 loss: 1.738e-01]
a-cold-wall:  41%|####1     | 1244/3000 [34:51<43:19,  1.48s/it, lr: 1.0e-04 loss: 1.738e-01]
a-cold-wall:  41%|####1     | 1244/3000 [34:51<43:19,  1.48s/it, lr: 1.0e-04 loss: 1.738e-01]
a-cold-wall:  41%|####1     | 1244/3000 [34:54<43:19,  1.48s/it, lr: 1.0e-04 loss: 5.819e-01]
a-cold-wall:  41%|####1     | 1244/3000 [34:54<43:19,  1.48s/it, lr: 1.0e-04 loss: 5.819e-01]
a-cold-wall:  42%|####1     | 1245/3000 [34:54<54:52,  1.88s/it, lr: 1.0e-04 loss: 5.819e-01]
a-cold-wall:  42%|####1     | 1245/3000 [34:54<54:52,  1.88s/it, lr: 1.0e-04 loss: 5.819e-01]
a-cold-wall:  42%|####1     | 1245/3000 [34:55<54:52,  1.88s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  42%|####1     | 1245/3000 [34:55<54:52,  1.88s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  42%|####1     | 1246/3000 [34:55<51:05,  1.75s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  42%|####1     | 1246/3000 [34:55<51:05,  1.75s/it, lr: 1.0e-04 loss: 2.305e-01]
a-cold-wall:  42%|####1     | 1246/3000 [34:57<51:05,  1.75s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  42%|####1     | 1246/3000 [34:57<51:05,  1.75s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  42%|####1     | 1247/3000 [34:57<48:16,  1.65s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  42%|####1     | 1247/3000 [34:57<48:16,  1.65s/it, lr: 1.0e-04 loss: 2.651e-01]
a-cold-wall:  42%|####1     | 1247/3000 [35:00<48:16,  1.65s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  42%|####1     | 1247/3000 [35:00<48:16,  1.65s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  42%|####1     | 1248/3000 [35:00<58:36,  2.01s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  42%|####1     | 1248/3000 [35:00<58:36,  2.01s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  42%|####1     | 1248/3000 [35:01<58:36,  2.01s/it, lr: 1.0e-04 loss: 3.332e-01]
a-cold-wall:  42%|####1     | 1248/3000 [35:01<58:36,  2.01s/it, lr: 1.0e-04 loss: 3.332e-01]
a-cold-wall:  42%|####1     | 1249/3000 [35:01<53:45,  1.84s/it, lr: 1.0e-04 loss: 3.332e-01]
a-cold-wall:  42%|####1     | 1249/3000 [35:01<53:45,  1.84s/it, lr: 1.0e-04 loss: 3.332e-01]
a-cold-wall:  42%|####1     | 1249/3000 [35:02<53:45,  1.84s/it, lr: 1.0e-04 loss: 3.076e-01]
a-cold-wall:  42%|####1     | 1249/3000 [35:02<53:45,  1.84s/it, lr: 1.0e-04 loss: 3.076e-01]
Saving at step 1250
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000001250.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000000250.safetensors

a-cold-wall:  42%|####1     | 1250/3000 [35:03<53:43,  1.84s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  42%|####1     | 1250/3000 [35:03<53:43,  1.84s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  42%|####1     | 1251/3000 [35:03<35:34,  1.22s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  42%|####1     | 1251/3000 [35:03<35:34,  1.22s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  42%|####1     | 1251/3000 [35:06<35:34,  1.22s/it, lr: 1.0e-04 loss: 4.842e-01]
a-cold-wall:  42%|####1     | 1251/3000 [35:06<35:34,  1.22s/it, lr: 1.0e-04 loss: 4.842e-01]
a-cold-wall:  42%|####1     | 1252/3000 [35:06<47:24,  1.63s/it, lr: 1.0e-04 loss: 4.842e-01]
a-cold-wall:  42%|####1     | 1252/3000 [35:06<47:24,  1.63s/it, lr: 1.0e-04 loss: 4.842e-01]
a-cold-wall:  42%|####1     | 1252/3000 [35:07<47:24,  1.63s/it, lr: 1.0e-04 loss: 4.510e-01]
a-cold-wall:  42%|####1     | 1252/3000 [35:07<47:24,  1.63s/it, lr: 1.0e-04 loss: 4.510e-01]
a-cold-wall:  42%|####1     | 1253/3000 [35:07<45:44,  1.57s/it, lr: 1.0e-04 loss: 4.510e-01]
a-cold-wall:  42%|####1     | 1253/3000 [35:07<45:44,  1.57s/it, lr: 1.0e-04 loss: 4.510e-01]
a-cold-wall:  42%|####1     | 1253/3000 [35:08<45:44,  1.57s/it, lr: 1.0e-04 loss: 1.111e-01]
a-cold-wall:  42%|####1     | 1253/3000 [35:08<45:44,  1.57s/it, lr: 1.0e-04 loss: 1.111e-01]
a-cold-wall:  42%|####1     | 1254/3000 [35:08<44:08,  1.52s/it, lr: 1.0e-04 loss: 1.111e-01]
a-cold-wall:  42%|####1     | 1254/3000 [35:08<44:08,  1.52s/it, lr: 1.0e-04 loss: 1.111e-01]
a-cold-wall:  42%|####1     | 1254/3000 [35:11<44:08,  1.52s/it, lr: 1.0e-04 loss: 2.480e-01]
a-cold-wall:  42%|####1     | 1254/3000 [35:11<44:08,  1.52s/it, lr: 1.0e-04 loss: 2.480e-01]
a-cold-wall:  42%|####1     | 1255/3000 [35:11<54:58,  1.89s/it, lr: 1.0e-04 loss: 2.480e-01]
a-cold-wall:  42%|####1     | 1255/3000 [35:11<54:58,  1.89s/it, lr: 1.0e-04 loss: 2.480e-01]
a-cold-wall:  42%|####1     | 1255/3000 [35:12<54:58,  1.89s/it, lr: 1.0e-04 loss: 1.754e-01]
a-cold-wall:  42%|####1     | 1255/3000 [35:12<54:58,  1.89s/it, lr: 1.0e-04 loss: 1.754e-01]
a-cold-wall:  42%|####1     | 1256/3000 [35:12<45:26,  1.56s/it, lr: 1.0e-04 loss: 1.754e-01]
a-cold-wall:  42%|####1     | 1256/3000 [35:12<45:26,  1.56s/it, lr: 1.0e-04 loss: 1.754e-01]
a-cold-wall:  42%|####1     | 1256/3000 [35:13<45:26,  1.56s/it, lr: 1.0e-04 loss: 3.765e-01]
a-cold-wall:  42%|####1     | 1256/3000 [35:13<45:26,  1.56s/it, lr: 1.0e-04 loss: 3.765e-01]
a-cold-wall:  42%|####1     | 1257/3000 [35:13<38:38,  1.33s/it, lr: 1.0e-04 loss: 3.765e-01]
a-cold-wall:  42%|####1     | 1257/3000 [35:13<38:38,  1.33s/it, lr: 1.0e-04 loss: 3.765e-01]
a-cold-wall:  42%|####1     | 1257/3000 [35:13<38:38,  1.33s/it, lr: 1.0e-04 loss: 4.765e-01]
a-cold-wall:  42%|####1     | 1257/3000 [35:13<38:38,  1.33s/it, lr: 1.0e-04 loss: 4.765e-01]
a-cold-wall:  42%|####1     | 1258/3000 [35:13<33:46,  1.16s/it, lr: 1.0e-04 loss: 4.765e-01]
a-cold-wall:  42%|####1     | 1258/3000 [35:13<33:46,  1.16s/it, lr: 1.0e-04 loss: 4.765e-01]
a-cold-wall:  42%|####1     | 1258/3000 [35:16<33:46,  1.16s/it, lr: 1.0e-04 loss: 7.912e-02]
a-cold-wall:  42%|####1     | 1258/3000 [35:16<33:46,  1.16s/it, lr: 1.0e-04 loss: 7.912e-02]
a-cold-wall:  42%|####1     | 1259/3000 [35:16<48:22,  1.67s/it, lr: 1.0e-04 loss: 7.912e-02]
a-cold-wall:  42%|####1     | 1259/3000 [35:16<48:22,  1.67s/it, lr: 1.0e-04 loss: 7.912e-02]
a-cold-wall:  42%|####1     | 1259/3000 [35:18<48:22,  1.67s/it, lr: 1.0e-04 loss: 6.465e-01]
a-cold-wall:  42%|####1     | 1259/3000 [35:18<48:22,  1.67s/it, lr: 1.0e-04 loss: 6.465e-01]
a-cold-wall:  42%|####2     | 1260/3000 [35:18<48:21,  1.67s/it, lr: 1.0e-04 loss: 1.799e-01]
a-cold-wall:  42%|####2     | 1260/3000 [35:18<48:21,  1.67s/it, lr: 1.0e-04 loss: 1.799e-01]
a-cold-wall:  42%|####2     | 1261/3000 [35:18<31:10,  1.08s/it, lr: 1.0e-04 loss: 1.799e-01]
a-cold-wall:  42%|####2     | 1261/3000 [35:18<31:10,  1.08s/it, lr: 1.0e-04 loss: 1.799e-01]
a-cold-wall:  42%|####2     | 1261/3000 [35:20<31:10,  1.08s/it, lr: 1.0e-04 loss: 3.146e-01]
a-cold-wall:  42%|####2     | 1261/3000 [35:20<31:10,  1.08s/it, lr: 1.0e-04 loss: 3.146e-01]
a-cold-wall:  42%|####2     | 1262/3000 [35:20<33:33,  1.16s/it, lr: 1.0e-04 loss: 3.146e-01]
a-cold-wall:  42%|####2     | 1262/3000 [35:20<33:33,  1.16s/it, lr: 1.0e-04 loss: 3.146e-01]
a-cold-wall:  42%|####2     | 1262/3000 [35:21<33:33,  1.16s/it, lr: 1.0e-04 loss: 3.294e-01]
a-cold-wall:  42%|####2     | 1262/3000 [35:21<33:33,  1.16s/it, lr: 1.0e-04 loss: 3.294e-01]
a-cold-wall:  42%|####2     | 1263/3000 [35:21<37:18,  1.29s/it, lr: 1.0e-04 loss: 3.294e-01]
a-cold-wall:  42%|####2     | 1263/3000 [35:21<37:18,  1.29s/it, lr: 1.0e-04 loss: 3.294e-01]
a-cold-wall:  42%|####2     | 1263/3000 [35:22<37:18,  1.29s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  42%|####2     | 1263/3000 [35:22<37:18,  1.29s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  42%|####2     | 1264/3000 [35:22<33:08,  1.15s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  42%|####2     | 1264/3000 [35:22<33:08,  1.15s/it, lr: 1.0e-04 loss: 1.036e-01]
a-cold-wall:  42%|####2     | 1264/3000 [35:23<33:08,  1.15s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  42%|####2     | 1264/3000 [35:23<33:08,  1.15s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  42%|####2     | 1265/3000 [35:23<29:53,  1.03s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  42%|####2     | 1265/3000 [35:23<29:53,  1.03s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  42%|####2     | 1265/3000 [35:26<29:53,  1.03s/it, lr: 1.0e-04 loss: 4.311e-01]
a-cold-wall:  42%|####2     | 1265/3000 [35:26<29:53,  1.03s/it, lr: 1.0e-04 loss: 4.311e-01]
a-cold-wall:  42%|####2     | 1266/3000 [35:26<45:02,  1.56s/it, lr: 1.0e-04 loss: 4.311e-01]
a-cold-wall:  42%|####2     | 1266/3000 [35:26<45:02,  1.56s/it, lr: 1.0e-04 loss: 4.311e-01]
a-cold-wall:  42%|####2     | 1266/3000 [35:27<45:02,  1.56s/it, lr: 1.0e-04 loss: 2.982e-01]
a-cold-wall:  42%|####2     | 1266/3000 [35:27<45:02,  1.56s/it, lr: 1.0e-04 loss: 2.982e-01]
a-cold-wall:  42%|####2     | 1267/3000 [35:27<43:49,  1.52s/it, lr: 1.0e-04 loss: 2.982e-01]
a-cold-wall:  42%|####2     | 1267/3000 [35:27<43:49,  1.52s/it, lr: 1.0e-04 loss: 2.982e-01]
a-cold-wall:  42%|####2     | 1267/3000 [35:28<43:49,  1.52s/it, lr: 1.0e-04 loss: 5.182e-01]
a-cold-wall:  42%|####2     | 1267/3000 [35:28<43:49,  1.52s/it, lr: 1.0e-04 loss: 5.182e-01]
a-cold-wall:  42%|####2     | 1268/3000 [35:28<37:15,  1.29s/it, lr: 1.0e-04 loss: 5.182e-01]
a-cold-wall:  42%|####2     | 1268/3000 [35:28<37:15,  1.29s/it, lr: 1.0e-04 loss: 5.182e-01]
a-cold-wall:  42%|####2     | 1268/3000 [35:31<37:15,  1.29s/it, lr: 1.0e-04 loss: 1.348e-01]
a-cold-wall:  42%|####2     | 1268/3000 [35:31<37:15,  1.29s/it, lr: 1.0e-04 loss: 1.348e-01]
a-cold-wall:  42%|####2     | 1269/3000 [35:31<50:24,  1.75s/it, lr: 1.0e-04 loss: 1.348e-01]
a-cold-wall:  42%|####2     | 1269/3000 [35:31<50:24,  1.75s/it, lr: 1.0e-04 loss: 1.348e-01]
a-cold-wall:  42%|####2     | 1269/3000 [35:32<50:24,  1.75s/it, lr: 1.0e-04 loss: 3.534e-01]
a-cold-wall:  42%|####2     | 1269/3000 [35:32<50:24,  1.75s/it, lr: 1.0e-04 loss: 3.534e-01]
a-cold-wall:  42%|####2     | 1270/3000 [35:34<50:23,  1.75s/it, lr: 1.0e-04 loss: 4.299e-01]
a-cold-wall:  42%|####2     | 1270/3000 [35:34<50:23,  1.75s/it, lr: 1.0e-04 loss: 4.299e-01]
a-cold-wall:  42%|####2     | 1271/3000 [35:34<36:41,  1.27s/it, lr: 1.0e-04 loss: 4.299e-01]
a-cold-wall:  42%|####2     | 1271/3000 [35:34<36:41,  1.27s/it, lr: 1.0e-04 loss: 4.299e-01]
a-cold-wall:  42%|####2     | 1271/3000 [35:36<36:41,  1.27s/it, lr: 1.0e-04 loss: 5.113e-01]
a-cold-wall:  42%|####2     | 1271/3000 [35:36<36:41,  1.27s/it, lr: 1.0e-04 loss: 5.113e-01]
a-cold-wall:  42%|####2     | 1272/3000 [35:36<47:48,  1.66s/it, lr: 1.0e-04 loss: 5.113e-01]
a-cold-wall:  42%|####2     | 1272/3000 [35:36<47:48,  1.66s/it, lr: 1.0e-04 loss: 5.113e-01]
a-cold-wall:  42%|####2     | 1272/3000 [35:39<47:48,  1.66s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  42%|####2     | 1272/3000 [35:39<47:48,  1.66s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  42%|####2     | 1273/3000 [35:39<56:51,  1.98s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  42%|####2     | 1273/3000 [35:39<56:51,  1.98s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  42%|####2     | 1273/3000 [35:40<56:51,  1.98s/it, lr: 1.0e-04 loss: 3.898e-01]
a-cold-wall:  42%|####2     | 1273/3000 [35:40<56:51,  1.98s/it, lr: 1.0e-04 loss: 3.898e-01]
a-cold-wall:  42%|####2     | 1274/3000 [35:40<47:21,  1.65s/it, lr: 1.0e-04 loss: 3.898e-01]
a-cold-wall:  42%|####2     | 1274/3000 [35:40<47:21,  1.65s/it, lr: 1.0e-04 loss: 3.898e-01]
a-cold-wall:  42%|####2     | 1274/3000 [35:43<47:21,  1.65s/it, lr: 1.0e-04 loss: 1.030e-01]
a-cold-wall:  42%|####2     | 1274/3000 [35:43<47:21,  1.65s/it, lr: 1.0e-04 loss: 1.030e-01]
a-cold-wall:  42%|####2     | 1275/3000 [35:43<57:35,  2.00s/it, lr: 1.0e-04 loss: 1.030e-01]
a-cold-wall:  42%|####2     | 1275/3000 [35:43<57:35,  2.00s/it, lr: 1.0e-04 loss: 1.030e-01]
a-cold-wall:  42%|####2     | 1275/3000 [35:44<57:35,  2.00s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:  42%|####2     | 1275/3000 [35:44<57:35,  2.00s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:  43%|####2     | 1276/3000 [35:44<47:15,  1.64s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:  43%|####2     | 1276/3000 [35:44<47:15,  1.64s/it, lr: 1.0e-04 loss: 3.276e-01]
a-cold-wall:  43%|####2     | 1276/3000 [35:45<47:15,  1.64s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  43%|####2     | 1276/3000 [35:45<47:15,  1.64s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  43%|####2     | 1277/3000 [35:45<46:52,  1.63s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  43%|####2     | 1277/3000 [35:45<46:52,  1.63s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  43%|####2     | 1277/3000 [35:48<46:52,  1.63s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  43%|####2     | 1277/3000 [35:48<46:52,  1.63s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  43%|####2     | 1278/3000 [35:48<57:21,  2.00s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  43%|####2     | 1278/3000 [35:48<57:21,  2.00s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  43%|####2     | 1278/3000 [35:49<57:21,  2.00s/it, lr: 1.0e-04 loss: 2.284e-01]
a-cold-wall:  43%|####2     | 1278/3000 [35:49<57:21,  2.00s/it, lr: 1.0e-04 loss: 2.284e-01]
a-cold-wall:  43%|####2     | 1279/3000 [35:49<46:46,  1.63s/it, lr: 1.0e-04 loss: 2.284e-01]
a-cold-wall:  43%|####2     | 1279/3000 [35:49<46:46,  1.63s/it, lr: 1.0e-04 loss: 2.284e-01]
a-cold-wall:  43%|####2     | 1279/3000 [35:52<46:46,  1.63s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  43%|####2     | 1279/3000 [35:52<46:46,  1.63s/it, lr: 1.0e-04 loss: 4.862e-01]
a-cold-wall:  43%|####2     | 1280/3000 [35:53<46:44,  1.63s/it, lr: 1.0e-04 loss: 3.510e-01]
a-cold-wall:  43%|####2     | 1280/3000 [35:53<46:44,  1.63s/it, lr: 1.0e-04 loss: 3.510e-01]
a-cold-wall:  43%|####2     | 1281/3000 [35:53<34:42,  1.21s/it, lr: 1.0e-04 loss: 3.510e-01]
a-cold-wall:  43%|####2     | 1281/3000 [35:53<34:42,  1.21s/it, lr: 1.0e-04 loss: 3.510e-01]
a-cold-wall:  43%|####2     | 1281/3000 [35:55<34:42,  1.21s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:  43%|####2     | 1281/3000 [35:55<34:42,  1.21s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:  43%|####2     | 1282/3000 [35:55<36:07,  1.26s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:  43%|####2     | 1282/3000 [35:55<36:07,  1.26s/it, lr: 1.0e-04 loss: 3.436e-01]
a-cold-wall:  43%|####2     | 1282/3000 [35:58<36:07,  1.26s/it, lr: 1.0e-04 loss: 1.286e-01]
a-cold-wall:  43%|####2     | 1282/3000 [35:58<36:07,  1.26s/it, lr: 1.0e-04 loss: 1.286e-01]
a-cold-wall:  43%|####2     | 1283/3000 [35:58<48:00,  1.68s/it, lr: 1.0e-04 loss: 1.286e-01]
a-cold-wall:  43%|####2     | 1283/3000 [35:58<48:00,  1.68s/it, lr: 1.0e-04 loss: 1.286e-01]
a-cold-wall:  43%|####2     | 1283/3000 [35:58<48:00,  1.68s/it, lr: 1.0e-04 loss: 1.712e-01]
a-cold-wall:  43%|####2     | 1283/3000 [35:58<48:00,  1.68s/it, lr: 1.0e-04 loss: 1.712e-01]
a-cold-wall:  43%|####2     | 1284/3000 [35:58<40:46,  1.43s/it, lr: 1.0e-04 loss: 1.712e-01]
a-cold-wall:  43%|####2     | 1284/3000 [35:58<40:46,  1.43s/it, lr: 1.0e-04 loss: 1.712e-01]
a-cold-wall:  43%|####2     | 1284/3000 [36:00<40:46,  1.43s/it, lr: 1.0e-04 loss: 5.787e-02]
a-cold-wall:  43%|####2     | 1284/3000 [36:00<40:46,  1.43s/it, lr: 1.0e-04 loss: 5.787e-02]
a-cold-wall:  43%|####2     | 1285/3000 [36:00<40:41,  1.42s/it, lr: 1.0e-04 loss: 5.787e-02]
a-cold-wall:  43%|####2     | 1285/3000 [36:00<40:41,  1.42s/it, lr: 1.0e-04 loss: 5.787e-02]
a-cold-wall:  43%|####2     | 1285/3000 [36:00<40:41,  1.42s/it, lr: 1.0e-04 loss: 2.785e-01]
a-cold-wall:  43%|####2     | 1285/3000 [36:00<40:41,  1.42s/it, lr: 1.0e-04 loss: 2.785e-01]
a-cold-wall:  43%|####2     | 1286/3000 [36:00<35:12,  1.23s/it, lr: 1.0e-04 loss: 2.785e-01]
a-cold-wall:  43%|####2     | 1286/3000 [36:00<35:12,  1.23s/it, lr: 1.0e-04 loss: 2.785e-01]
a-cold-wall:  43%|####2     | 1286/3000 [36:02<35:12,  1.23s/it, lr: 1.0e-04 loss: 5.015e-01]
a-cold-wall:  43%|####2     | 1286/3000 [36:02<35:12,  1.23s/it, lr: 1.0e-04 loss: 5.015e-01]
a-cold-wall:  43%|####2     | 1287/3000 [36:02<36:51,  1.29s/it, lr: 1.0e-04 loss: 5.015e-01]
a-cold-wall:  43%|####2     | 1287/3000 [36:02<36:51,  1.29s/it, lr: 1.0e-04 loss: 5.015e-01]
a-cold-wall:  43%|####2     | 1287/3000 [36:03<36:51,  1.29s/it, lr: 1.0e-04 loss: 6.467e-01]
a-cold-wall:  43%|####2     | 1287/3000 [36:03<36:51,  1.29s/it, lr: 1.0e-04 loss: 6.467e-01]
a-cold-wall:  43%|####2     | 1288/3000 [36:03<38:00,  1.33s/it, lr: 1.0e-04 loss: 6.467e-01]
a-cold-wall:  43%|####2     | 1288/3000 [36:03<38:00,  1.33s/it, lr: 1.0e-04 loss: 6.467e-01]
a-cold-wall:  43%|####2     | 1288/3000 [36:06<38:00,  1.33s/it, lr: 1.0e-04 loss: 2.625e-01]
a-cold-wall:  43%|####2     | 1288/3000 [36:06<38:00,  1.33s/it, lr: 1.0e-04 loss: 2.625e-01]
a-cold-wall:  43%|####2     | 1289/3000 [36:06<50:55,  1.79s/it, lr: 1.0e-04 loss: 2.625e-01]
a-cold-wall:  43%|####2     | 1289/3000 [36:06<50:55,  1.79s/it, lr: 1.0e-04 loss: 2.625e-01]
a-cold-wall:  43%|####2     | 1289/3000 [36:07<50:55,  1.79s/it, lr: 1.0e-04 loss: 5.846e-01]
a-cold-wall:  43%|####2     | 1289/3000 [36:07<50:55,  1.79s/it, lr: 1.0e-04 loss: 5.846e-01]
a-cold-wall:  43%|####3     | 1290/3000 [36:08<50:54,  1.79s/it, lr: 1.0e-04 loss: 5.264e-01]
a-cold-wall:  43%|####3     | 1290/3000 [36:08<50:54,  1.79s/it, lr: 1.0e-04 loss: 5.264e-01]
a-cold-wall:  43%|####3     | 1291/3000 [36:08<33:50,  1.19s/it, lr: 1.0e-04 loss: 5.264e-01]
a-cold-wall:  43%|####3     | 1291/3000 [36:08<33:50,  1.19s/it, lr: 1.0e-04 loss: 5.264e-01]
a-cold-wall:  43%|####3     | 1291/3000 [36:09<33:50,  1.19s/it, lr: 1.0e-04 loss: 3.773e-01]
a-cold-wall:  43%|####3     | 1291/3000 [36:09<33:50,  1.19s/it, lr: 1.0e-04 loss: 3.773e-01]
a-cold-wall:  43%|####3     | 1292/3000 [36:09<30:36,  1.08s/it, lr: 1.0e-04 loss: 3.773e-01]
a-cold-wall:  43%|####3     | 1292/3000 [36:09<30:36,  1.08s/it, lr: 1.0e-04 loss: 3.773e-01]
a-cold-wall:  43%|####3     | 1292/3000 [36:09<30:36,  1.08s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  43%|####3     | 1292/3000 [36:09<30:36,  1.08s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  43%|####3     | 1293/3000 [36:09<28:02,  1.01it/s, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  43%|####3     | 1293/3000 [36:09<28:02,  1.01it/s, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  43%|####3     | 1293/3000 [36:12<28:02,  1.01it/s, lr: 1.0e-04 loss: 6.482e-01]
a-cold-wall:  43%|####3     | 1293/3000 [36:12<28:02,  1.01it/s, lr: 1.0e-04 loss: 6.482e-01]
a-cold-wall:  43%|####3     | 1294/3000 [36:12<42:50,  1.51s/it, lr: 1.0e-04 loss: 6.482e-01]
a-cold-wall:  43%|####3     | 1294/3000 [36:12<42:50,  1.51s/it, lr: 1.0e-04 loss: 6.482e-01]
a-cold-wall:  43%|####3     | 1294/3000 [36:14<42:50,  1.51s/it, lr: 1.0e-04 loss: 3.772e-01]
a-cold-wall:  43%|####3     | 1294/3000 [36:14<42:50,  1.51s/it, lr: 1.0e-04 loss: 3.772e-01]
a-cold-wall:  43%|####3     | 1295/3000 [36:14<42:09,  1.48s/it, lr: 1.0e-04 loss: 3.772e-01]
a-cold-wall:  43%|####3     | 1295/3000 [36:14<42:09,  1.48s/it, lr: 1.0e-04 loss: 3.772e-01]
a-cold-wall:  43%|####3     | 1295/3000 [36:14<42:09,  1.48s/it, lr: 1.0e-04 loss: 7.002e-02]
a-cold-wall:  43%|####3     | 1295/3000 [36:14<42:09,  1.48s/it, lr: 1.0e-04 loss: 7.002e-02]
a-cold-wall:  43%|####3     | 1296/3000 [36:14<36:20,  1.28s/it, lr: 1.0e-04 loss: 7.002e-02]
a-cold-wall:  43%|####3     | 1296/3000 [36:14<36:20,  1.28s/it, lr: 1.0e-04 loss: 7.002e-02]
a-cold-wall:  43%|####3     | 1296/3000 [36:15<36:20,  1.28s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  43%|####3     | 1296/3000 [36:15<36:20,  1.28s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  43%|####3     | 1297/3000 [36:15<31:56,  1.13s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  43%|####3     | 1297/3000 [36:15<31:56,  1.13s/it, lr: 1.0e-04 loss: 1.267e-01]
a-cold-wall:  43%|####3     | 1297/3000 [36:17<31:56,  1.13s/it, lr: 1.0e-04 loss: 2.455e-01]
a-cold-wall:  43%|####3     | 1297/3000 [36:17<31:56,  1.13s/it, lr: 1.0e-04 loss: 2.455e-01]
a-cold-wall:  43%|####3     | 1298/3000 [36:17<34:22,  1.21s/it, lr: 1.0e-04 loss: 2.455e-01]
a-cold-wall:  43%|####3     | 1298/3000 [36:17<34:22,  1.21s/it, lr: 1.0e-04 loss: 2.455e-01]
a-cold-wall:  43%|####3     | 1298/3000 [36:18<34:22,  1.21s/it, lr: 1.0e-04 loss: 4.149e-01]
a-cold-wall:  43%|####3     | 1298/3000 [36:18<34:22,  1.21s/it, lr: 1.0e-04 loss: 4.149e-01]
a-cold-wall:  43%|####3     | 1299/3000 [36:18<36:13,  1.28s/it, lr: 1.0e-04 loss: 4.149e-01]
a-cold-wall:  43%|####3     | 1299/3000 [36:18<36:13,  1.28s/it, lr: 1.0e-04 loss: 4.149e-01]
a-cold-wall:  43%|####3     | 1299/3000 [36:20<36:13,  1.28s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  43%|####3     | 1299/3000 [36:20<36:13,  1.28s/it, lr: 1.0e-04 loss: 1.135e-01]
a-cold-wall:  43%|####3     | 1300/3000 [36:21<36:12,  1.28s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  43%|####3     | 1300/3000 [36:21<36:12,  1.28s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  43%|####3     | 1301/3000 [36:21<28:48,  1.02s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  43%|####3     | 1301/3000 [36:21<28:48,  1.02s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  43%|####3     | 1301/3000 [36:24<28:48,  1.02s/it, lr: 1.0e-04 loss: 2.827e-02]
a-cold-wall:  43%|####3     | 1301/3000 [36:24<28:48,  1.02s/it, lr: 1.0e-04 loss: 2.827e-02]
a-cold-wall:  43%|####3     | 1302/3000 [36:24<41:54,  1.48s/it, lr: 1.0e-04 loss: 2.827e-02]
a-cold-wall:  43%|####3     | 1302/3000 [36:24<41:54,  1.48s/it, lr: 1.0e-04 loss: 2.827e-02]
a-cold-wall:  43%|####3     | 1302/3000 [36:27<41:54,  1.48s/it, lr: 1.0e-04 loss: 1.953e-01]
a-cold-wall:  43%|####3     | 1302/3000 [36:27<41:54,  1.48s/it, lr: 1.0e-04 loss: 1.953e-01]
a-cold-wall:  43%|####3     | 1303/3000 [36:27<52:13,  1.85s/it, lr: 1.0e-04 loss: 1.953e-01]
a-cold-wall:  43%|####3     | 1303/3000 [36:27<52:13,  1.85s/it, lr: 1.0e-04 loss: 1.953e-01]
a-cold-wall:  43%|####3     | 1303/3000 [36:28<52:13,  1.85s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  43%|####3     | 1303/3000 [36:28<52:13,  1.85s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  43%|####3     | 1304/3000 [36:28<50:10,  1.77s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  43%|####3     | 1304/3000 [36:28<50:10,  1.77s/it, lr: 1.0e-04 loss: 2.039e-01]
a-cold-wall:  43%|####3     | 1304/3000 [36:29<50:10,  1.77s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  43%|####3     | 1304/3000 [36:29<50:10,  1.77s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  44%|####3     | 1305/3000 [36:29<42:00,  1.49s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  44%|####3     | 1305/3000 [36:29<42:00,  1.49s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  44%|####3     | 1305/3000 [36:30<42:00,  1.49s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  44%|####3     | 1305/3000 [36:30<42:00,  1.49s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  44%|####3     | 1306/3000 [36:30<36:06,  1.28s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  44%|####3     | 1306/3000 [36:30<36:06,  1.28s/it, lr: 1.0e-04 loss: 5.656e-01]
a-cold-wall:  44%|####3     | 1306/3000 [36:33<36:06,  1.28s/it, lr: 1.0e-04 loss: 5.710e-01]
a-cold-wall:  44%|####3     | 1306/3000 [36:33<36:06,  1.28s/it, lr: 1.0e-04 loss: 5.710e-01]
a-cold-wall:  44%|####3     | 1307/3000 [36:33<49:11,  1.74s/it, lr: 1.0e-04 loss: 5.710e-01]
a-cold-wall:  44%|####3     | 1307/3000 [36:33<49:11,  1.74s/it, lr: 1.0e-04 loss: 5.710e-01]
a-cold-wall:  44%|####3     | 1307/3000 [36:34<49:11,  1.74s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  44%|####3     | 1307/3000 [36:34<49:11,  1.74s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  44%|####3     | 1308/3000 [36:34<46:12,  1.64s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  44%|####3     | 1308/3000 [36:34<46:12,  1.64s/it, lr: 1.0e-04 loss: 5.858e-01]
a-cold-wall:  44%|####3     | 1308/3000 [36:35<46:12,  1.64s/it, lr: 1.0e-04 loss: 1.243e-01]
a-cold-wall:  44%|####3     | 1308/3000 [36:35<46:12,  1.64s/it, lr: 1.0e-04 loss: 1.243e-01]
a-cold-wall:  44%|####3     | 1309/3000 [36:35<38:46,  1.38s/it, lr: 1.0e-04 loss: 1.243e-01]
a-cold-wall:  44%|####3     | 1309/3000 [36:35<38:46,  1.38s/it, lr: 1.0e-04 loss: 1.243e-01]
a-cold-wall:  44%|####3     | 1309/3000 [36:38<38:46,  1.38s/it, lr: 1.0e-04 loss: 5.064e-01]
a-cold-wall:  44%|####3     | 1309/3000 [36:38<38:46,  1.38s/it, lr: 1.0e-04 loss: 5.064e-01]
a-cold-wall:  44%|####3     | 1310/3000 [36:39<38:45,  1.38s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  44%|####3     | 1310/3000 [36:39<38:45,  1.38s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  44%|####3     | 1311/3000 [36:39<30:09,  1.07s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  44%|####3     | 1311/3000 [36:39<30:09,  1.07s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  44%|####3     | 1311/3000 [36:42<30:09,  1.07s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  44%|####3     | 1311/3000 [36:42<30:09,  1.07s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  44%|####3     | 1312/3000 [36:42<42:40,  1.52s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  44%|####3     | 1312/3000 [36:42<42:40,  1.52s/it, lr: 1.0e-04 loss: 6.844e-01]
a-cold-wall:  44%|####3     | 1312/3000 [36:45<42:40,  1.52s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  44%|####3     | 1312/3000 [36:45<42:40,  1.52s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  44%|####3     | 1313/3000 [36:45<52:35,  1.87s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  44%|####3     | 1313/3000 [36:45<52:35,  1.87s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  44%|####3     | 1313/3000 [36:46<52:35,  1.87s/it, lr: 1.0e-04 loss: 1.485e-01]
a-cold-wall:  44%|####3     | 1313/3000 [36:46<52:35,  1.87s/it, lr: 1.0e-04 loss: 1.485e-01]
a-cold-wall:  44%|####3     | 1314/3000 [36:46<44:02,  1.57s/it, lr: 1.0e-04 loss: 1.485e-01]
a-cold-wall:  44%|####3     | 1314/3000 [36:46<44:02,  1.57s/it, lr: 1.0e-04 loss: 1.485e-01]
a-cold-wall:  44%|####3     | 1314/3000 [36:48<44:02,  1.57s/it, lr: 1.0e-04 loss: 5.694e-01]
a-cold-wall:  44%|####3     | 1314/3000 [36:48<44:02,  1.57s/it, lr: 1.0e-04 loss: 5.694e-01]
a-cold-wall:  44%|####3     | 1315/3000 [36:49<54:18,  1.93s/it, lr: 1.0e-04 loss: 5.694e-01]
a-cold-wall:  44%|####3     | 1315/3000 [36:49<54:18,  1.93s/it, lr: 1.0e-04 loss: 5.694e-01]
a-cold-wall:  44%|####3     | 1315/3000 [36:49<54:18,  1.93s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  44%|####3     | 1315/3000 [36:49<54:18,  1.93s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  44%|####3     | 1316/3000 [36:49<44:42,  1.59s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  44%|####3     | 1316/3000 [36:49<44:42,  1.59s/it, lr: 1.0e-04 loss: 7.011e-01]
a-cold-wall:  44%|####3     | 1316/3000 [36:50<44:42,  1.59s/it, lr: 1.0e-04 loss: 2.085e-01]
a-cold-wall:  44%|####3     | 1316/3000 [36:50<44:42,  1.59s/it, lr: 1.0e-04 loss: 2.085e-01]
a-cold-wall:  44%|####3     | 1317/3000 [36:50<39:28,  1.41s/it, lr: 1.0e-04 loss: 2.085e-01]
a-cold-wall:  44%|####3     | 1317/3000 [36:50<39:28,  1.41s/it, lr: 1.0e-04 loss: 2.085e-01]
a-cold-wall:  44%|####3     | 1317/3000 [36:52<39:28,  1.41s/it, lr: 1.0e-04 loss: 7.551e-01]
a-cold-wall:  44%|####3     | 1317/3000 [36:52<39:28,  1.41s/it, lr: 1.0e-04 loss: 7.551e-01]
a-cold-wall:  44%|####3     | 1318/3000 [36:52<39:23,  1.41s/it, lr: 1.0e-04 loss: 7.551e-01]
a-cold-wall:  44%|####3     | 1318/3000 [36:52<39:23,  1.41s/it, lr: 1.0e-04 loss: 7.551e-01]
a-cold-wall:  44%|####3     | 1318/3000 [36:54<39:23,  1.41s/it, lr: 1.0e-04 loss: 6.878e-01]
a-cold-wall:  44%|####3     | 1318/3000 [36:54<39:23,  1.41s/it, lr: 1.0e-04 loss: 6.878e-01]
a-cold-wall:  44%|####3     | 1319/3000 [36:54<51:29,  1.84s/it, lr: 1.0e-04 loss: 6.878e-01]
a-cold-wall:  44%|####3     | 1319/3000 [36:54<51:29,  1.84s/it, lr: 1.0e-04 loss: 6.878e-01]
a-cold-wall:  44%|####3     | 1319/3000 [36:57<51:29,  1.84s/it, lr: 1.0e-04 loss: 4.827e-01]
a-cold-wall:  44%|####3     | 1319/3000 [36:57<51:29,  1.84s/it, lr: 1.0e-04 loss: 4.827e-01]
a-cold-wall:  44%|####4     | 1320/3000 [36:59<51:27,  1.84s/it, lr: 1.0e-04 loss: 5.824e-01]
a-cold-wall:  44%|####4     | 1320/3000 [36:59<51:27,  1.84s/it, lr: 1.0e-04 loss: 5.824e-01]
a-cold-wall:  44%|####4     | 1321/3000 [36:59<36:57,  1.32s/it, lr: 1.0e-04 loss: 5.824e-01]
a-cold-wall:  44%|####4     | 1321/3000 [36:59<36:57,  1.32s/it, lr: 1.0e-04 loss: 5.824e-01]
a-cold-wall:  44%|####4     | 1321/3000 [36:59<36:57,  1.32s/it, lr: 1.0e-04 loss: 6.569e-01]
a-cold-wall:  44%|####4     | 1321/3000 [36:59<36:57,  1.32s/it, lr: 1.0e-04 loss: 6.569e-01]
a-cold-wall:  44%|####4     | 1322/3000 [36:59<32:57,  1.18s/it, lr: 1.0e-04 loss: 6.569e-01]
a-cold-wall:  44%|####4     | 1322/3000 [36:59<32:57,  1.18s/it, lr: 1.0e-04 loss: 6.569e-01]
a-cold-wall:  44%|####4     | 1322/3000 [37:01<32:57,  1.18s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  44%|####4     | 1322/3000 [37:01<32:57,  1.18s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  44%|####4     | 1323/3000 [37:01<34:35,  1.24s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  44%|####4     | 1323/3000 [37:01<34:35,  1.24s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  44%|####4     | 1323/3000 [37:02<34:35,  1.24s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  44%|####4     | 1323/3000 [37:02<34:35,  1.24s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  44%|####4     | 1324/3000 [37:02<35:56,  1.29s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  44%|####4     | 1324/3000 [37:02<35:56,  1.29s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  44%|####4     | 1324/3000 [37:04<35:56,  1.29s/it, lr: 1.0e-04 loss: 2.579e-01]
a-cold-wall:  44%|####4     | 1324/3000 [37:04<35:56,  1.29s/it, lr: 1.0e-04 loss: 2.579e-01]
a-cold-wall:  44%|####4     | 1325/3000 [37:04<37:05,  1.33s/it, lr: 1.0e-04 loss: 2.579e-01]
a-cold-wall:  44%|####4     | 1325/3000 [37:04<37:05,  1.33s/it, lr: 1.0e-04 loss: 2.579e-01]
a-cold-wall:  44%|####4     | 1325/3000 [37:07<37:05,  1.33s/it, lr: 1.0e-04 loss: 6.267e-01]
a-cold-wall:  44%|####4     | 1325/3000 [37:07<37:05,  1.33s/it, lr: 1.0e-04 loss: 6.267e-01]
a-cold-wall:  44%|####4     | 1326/3000 [37:07<49:03,  1.76s/it, lr: 1.0e-04 loss: 6.267e-01]
a-cold-wall:  44%|####4     | 1326/3000 [37:07<49:03,  1.76s/it, lr: 1.0e-04 loss: 6.267e-01]
a-cold-wall:  44%|####4     | 1326/3000 [37:07<49:03,  1.76s/it, lr: 1.0e-04 loss: 4.846e-01]
a-cold-wall:  44%|####4     | 1326/3000 [37:07<49:03,  1.76s/it, lr: 1.0e-04 loss: 4.846e-01]
a-cold-wall:  44%|####4     | 1327/3000 [37:07<40:49,  1.46s/it, lr: 1.0e-04 loss: 4.846e-01]
a-cold-wall:  44%|####4     | 1327/3000 [37:07<40:49,  1.46s/it, lr: 1.0e-04 loss: 4.846e-01]
a-cold-wall:  44%|####4     | 1327/3000 [37:08<40:49,  1.46s/it, lr: 1.0e-04 loss: 3.565e-01]
a-cold-wall:  44%|####4     | 1327/3000 [37:08<40:49,  1.46s/it, lr: 1.0e-04 loss: 3.565e-01]
a-cold-wall:  44%|####4     | 1328/3000 [37:08<34:55,  1.25s/it, lr: 1.0e-04 loss: 3.565e-01]
a-cold-wall:  44%|####4     | 1328/3000 [37:08<34:55,  1.25s/it, lr: 1.0e-04 loss: 3.565e-01]
a-cold-wall:  44%|####4     | 1328/3000 [37:11<34:55,  1.25s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  44%|####4     | 1328/3000 [37:11<34:55,  1.25s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  44%|####4     | 1329/3000 [37:11<48:09,  1.73s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  44%|####4     | 1329/3000 [37:11<48:09,  1.73s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  44%|####4     | 1329/3000 [37:12<48:09,  1.73s/it, lr: 1.0e-04 loss: 2.213e-01]
a-cold-wall:  44%|####4     | 1329/3000 [37:12<48:09,  1.73s/it, lr: 1.0e-04 loss: 2.213e-01]
a-cold-wall:  44%|####4     | 1330/3000 [37:15<48:07,  1.73s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  44%|####4     | 1330/3000 [37:15<48:07,  1.73s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  44%|####4     | 1331/3000 [37:15<44:08,  1.59s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  44%|####4     | 1331/3000 [37:15<44:08,  1.59s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  44%|####4     | 1331/3000 [37:16<44:08,  1.59s/it, lr: 1.0e-04 loss: 6.451e-01]
a-cold-wall:  44%|####4     | 1331/3000 [37:16<44:08,  1.59s/it, lr: 1.0e-04 loss: 6.451e-01]
a-cold-wall:  44%|####4     | 1332/3000 [37:16<42:57,  1.55s/it, lr: 1.0e-04 loss: 6.451e-01]
a-cold-wall:  44%|####4     | 1332/3000 [37:16<42:57,  1.55s/it, lr: 1.0e-04 loss: 6.451e-01]
a-cold-wall:  44%|####4     | 1332/3000 [37:19<42:57,  1.55s/it, lr: 1.0e-04 loss: 2.589e-01]
a-cold-wall:  44%|####4     | 1332/3000 [37:19<42:57,  1.55s/it, lr: 1.0e-04 loss: 2.589e-01]
a-cold-wall:  44%|####4     | 1333/3000 [37:19<52:30,  1.89s/it, lr: 1.0e-04 loss: 2.589e-01]
a-cold-wall:  44%|####4     | 1333/3000 [37:19<52:30,  1.89s/it, lr: 1.0e-04 loss: 2.589e-01]
a-cold-wall:  44%|####4     | 1333/3000 [37:20<52:30,  1.89s/it, lr: 1.0e-04 loss: 8.459e-01]
a-cold-wall:  44%|####4     | 1333/3000 [37:20<52:30,  1.89s/it, lr: 1.0e-04 loss: 8.459e-01]
a-cold-wall:  44%|####4     | 1334/3000 [37:20<48:55,  1.76s/it, lr: 1.0e-04 loss: 8.459e-01]
a-cold-wall:  44%|####4     | 1334/3000 [37:20<48:55,  1.76s/it, lr: 1.0e-04 loss: 8.459e-01]
a-cold-wall:  44%|####4     | 1334/3000 [37:23<48:55,  1.76s/it, lr: 1.0e-04 loss: 1.538e-02]
a-cold-wall:  44%|####4     | 1334/3000 [37:23<48:55,  1.76s/it, lr: 1.0e-04 loss: 1.538e-02]
a-cold-wall:  44%|####4     | 1335/3000 [37:23<57:14,  2.06s/it, lr: 1.0e-04 loss: 1.538e-02]
a-cold-wall:  44%|####4     | 1335/3000 [37:23<57:14,  2.06s/it, lr: 1.0e-04 loss: 1.538e-02]
a-cold-wall:  44%|####4     | 1335/3000 [37:24<57:14,  2.06s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  44%|####4     | 1335/3000 [37:24<57:14,  2.06s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  45%|####4     | 1336/3000 [37:24<48:29,  1.75s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  45%|####4     | 1336/3000 [37:24<48:29,  1.75s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  45%|####4     | 1336/3000 [37:27<48:29,  1.75s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  45%|####4     | 1336/3000 [37:27<48:29,  1.75s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  45%|####4     | 1337/3000 [37:27<57:12,  2.06s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  45%|####4     | 1337/3000 [37:27<57:12,  2.06s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  45%|####4     | 1337/3000 [37:30<57:12,  2.06s/it, lr: 1.0e-04 loss: 2.297e-01]
a-cold-wall:  45%|####4     | 1337/3000 [37:30<57:12,  2.06s/it, lr: 1.0e-04 loss: 2.297e-01]
a-cold-wall:  45%|####4     | 1338/3000 [37:30<1:03:44,  2.30s/it, lr: 1.0e-04 loss: 2.297e-01]
a-cold-wall:  45%|####4     | 1338/3000 [37:30<1:03:44,  2.30s/it, lr: 1.0e-04 loss: 2.297e-01]
a-cold-wall:  45%|####4     | 1338/3000 [37:33<1:03:44,  2.30s/it, lr: 1.0e-04 loss: 3.955e-02]
a-cold-wall:  45%|####4     | 1338/3000 [37:33<1:03:44,  2.30s/it, lr: 1.0e-04 loss: 3.955e-02]
a-cold-wall:  45%|####4     | 1339/3000 [37:33<1:08:19,  2.47s/it, lr: 1.0e-04 loss: 3.955e-02]
a-cold-wall:  45%|####4     | 1339/3000 [37:33<1:08:19,  2.47s/it, lr: 1.0e-04 loss: 3.955e-02]
a-cold-wall:  45%|####4     | 1339/3000 [37:34<1:08:19,  2.47s/it, lr: 1.0e-04 loss: 4.464e-02]
a-cold-wall:  45%|####4     | 1339/3000 [37:34<1:08:19,  2.47s/it, lr: 1.0e-04 loss: 4.464e-02]
a-cold-wall:  45%|####4     | 1340/3000 [37:34<1:08:16,  2.47s/it, lr: 1.0e-04 loss: 2.443e-01]
a-cold-wall:  45%|####4     | 1340/3000 [37:34<1:08:16,  2.47s/it, lr: 1.0e-04 loss: 2.443e-01]
a-cold-wall:  45%|####4     | 1341/3000 [37:35<41:43,  1.51s/it, lr: 1.0e-04 loss: 2.443e-01]  
a-cold-wall:  45%|####4     | 1341/3000 [37:35<41:43,  1.51s/it, lr: 1.0e-04 loss: 2.443e-01]  
a-cold-wall:  45%|####4     | 1341/3000 [37:35<41:43,  1.51s/it, lr: 1.0e-04 loss: 4.540e-01]
a-cold-wall:  45%|####4     | 1341/3000 [37:35<41:43,  1.51s/it, lr: 1.0e-04 loss: 4.540e-01]
a-cold-wall:  45%|####4     | 1342/3000 [37:35<36:29,  1.32s/it, lr: 1.0e-04 loss: 4.540e-01]
a-cold-wall:  45%|####4     | 1342/3000 [37:35<36:29,  1.32s/it, lr: 1.0e-04 loss: 4.540e-01]
a-cold-wall:  45%|####4     | 1342/3000 [37:38<36:29,  1.32s/it, lr: 1.0e-04 loss: 5.804e-01]
a-cold-wall:  45%|####4     | 1342/3000 [37:38<36:29,  1.32s/it, lr: 1.0e-04 loss: 5.804e-01]
a-cold-wall:  45%|####4     | 1343/3000 [37:38<47:23,  1.72s/it, lr: 1.0e-04 loss: 5.804e-01]
a-cold-wall:  45%|####4     | 1343/3000 [37:38<47:23,  1.72s/it, lr: 1.0e-04 loss: 5.804e-01]
a-cold-wall:  45%|####4     | 1343/3000 [37:39<47:23,  1.72s/it, lr: 1.0e-04 loss: 1.809e-01]
a-cold-wall:  45%|####4     | 1343/3000 [37:39<47:23,  1.72s/it, lr: 1.0e-04 loss: 1.809e-01]
a-cold-wall:  45%|####4     | 1344/3000 [37:39<40:03,  1.45s/it, lr: 1.0e-04 loss: 1.809e-01]
a-cold-wall:  45%|####4     | 1344/3000 [37:39<40:03,  1.45s/it, lr: 1.0e-04 loss: 1.809e-01]
a-cold-wall:  45%|####4     | 1344/3000 [37:40<40:03,  1.45s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  45%|####4     | 1344/3000 [37:40<40:03,  1.45s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  45%|####4     | 1345/3000 [37:40<36:21,  1.32s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  45%|####4     | 1345/3000 [37:40<36:21,  1.32s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  45%|####4     | 1345/3000 [37:41<36:21,  1.32s/it, lr: 1.0e-04 loss: 6.658e-01]
a-cold-wall:  45%|####4     | 1345/3000 [37:41<36:21,  1.32s/it, lr: 1.0e-04 loss: 6.658e-01]
a-cold-wall:  45%|####4     | 1346/3000 [37:41<31:47,  1.15s/it, lr: 1.0e-04 loss: 6.658e-01]
a-cold-wall:  45%|####4     | 1346/3000 [37:41<31:47,  1.15s/it, lr: 1.0e-04 loss: 6.658e-01]
a-cold-wall:  45%|####4     | 1346/3000 [37:43<31:47,  1.15s/it, lr: 1.0e-04 loss: 3.810e-01]
a-cold-wall:  45%|####4     | 1346/3000 [37:43<31:47,  1.15s/it, lr: 1.0e-04 loss: 3.810e-01]
a-cold-wall:  45%|####4     | 1347/3000 [37:43<45:31,  1.65s/it, lr: 1.0e-04 loss: 3.810e-01]
a-cold-wall:  45%|####4     | 1347/3000 [37:43<45:31,  1.65s/it, lr: 1.0e-04 loss: 3.810e-01]
a-cold-wall:  45%|####4     | 1347/3000 [37:46<45:31,  1.65s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  45%|####4     | 1347/3000 [37:46<45:31,  1.65s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  45%|####4     | 1348/3000 [37:46<55:21,  2.01s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  45%|####4     | 1348/3000 [37:46<55:21,  2.01s/it, lr: 1.0e-04 loss: 4.978e-01]
a-cold-wall:  45%|####4     | 1348/3000 [37:48<55:21,  2.01s/it, lr: 1.0e-04 loss: 6.580e-01]
a-cold-wall:  45%|####4     | 1348/3000 [37:48<55:21,  2.01s/it, lr: 1.0e-04 loss: 6.580e-01]
a-cold-wall:  45%|####4     | 1349/3000 [37:48<50:32,  1.84s/it, lr: 1.0e-04 loss: 6.580e-01]
a-cold-wall:  45%|####4     | 1349/3000 [37:48<50:32,  1.84s/it, lr: 1.0e-04 loss: 6.580e-01]
a-cold-wall:  45%|####4     | 1349/3000 [37:51<50:32,  1.84s/it, lr: 1.0e-04 loss: 5.073e-01]
a-cold-wall:  45%|####4     | 1349/3000 [37:51<50:32,  1.84s/it, lr: 1.0e-04 loss: 5.073e-01]
a-cold-wall:  45%|####5     | 1350/3000 [37:53<50:30,  1.84s/it, lr: 1.0e-04 loss: 5.844e-01]
a-cold-wall:  45%|####5     | 1350/3000 [37:53<50:30,  1.84s/it, lr: 1.0e-04 loss: 5.844e-01]
a-cold-wall:  45%|####5     | 1351/3000 [37:53<45:20,  1.65s/it, lr: 1.0e-04 loss: 5.844e-01]
a-cold-wall:  45%|####5     | 1351/3000 [37:53<45:20,  1.65s/it, lr: 1.0e-04 loss: 5.844e-01]
a-cold-wall:  45%|####5     | 1351/3000 [37:55<45:20,  1.65s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  45%|####5     | 1351/3000 [37:55<45:20,  1.65s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  45%|####5     | 1352/3000 [37:55<43:43,  1.59s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  45%|####5     | 1352/3000 [37:55<43:43,  1.59s/it, lr: 1.0e-04 loss: 6.141e-01]
a-cold-wall:  45%|####5     | 1352/3000 [37:56<43:43,  1.59s/it, lr: 1.0e-04 loss: 1.247e-01]
a-cold-wall:  45%|####5     | 1352/3000 [37:56<43:43,  1.59s/it, lr: 1.0e-04 loss: 1.247e-01]
a-cold-wall:  45%|####5     | 1353/3000 [37:56<42:29,  1.55s/it, lr: 1.0e-04 loss: 1.247e-01]
a-cold-wall:  45%|####5     | 1353/3000 [37:56<42:29,  1.55s/it, lr: 1.0e-04 loss: 1.247e-01]
a-cold-wall:  45%|####5     | 1353/3000 [37:58<42:29,  1.55s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  45%|####5     | 1353/3000 [37:58<42:29,  1.55s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  45%|####5     | 1354/3000 [37:58<42:23,  1.55s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  45%|####5     | 1354/3000 [37:58<42:23,  1.55s/it, lr: 1.0e-04 loss: 4.433e-01]
a-cold-wall:  45%|####5     | 1354/3000 [37:59<42:23,  1.55s/it, lr: 1.0e-04 loss: 6.320e-02]
a-cold-wall:  45%|####5     | 1354/3000 [37:59<42:23,  1.55s/it, lr: 1.0e-04 loss: 6.320e-02]
a-cold-wall:  45%|####5     | 1355/3000 [37:59<41:36,  1.52s/it, lr: 1.0e-04 loss: 6.320e-02]
a-cold-wall:  45%|####5     | 1355/3000 [37:59<41:36,  1.52s/it, lr: 1.0e-04 loss: 6.320e-02]
a-cold-wall:  45%|####5     | 1355/3000 [38:00<41:36,  1.52s/it, lr: 1.0e-04 loss: 4.806e-01]
a-cold-wall:  45%|####5     | 1355/3000 [38:00<41:36,  1.52s/it, lr: 1.0e-04 loss: 4.806e-01]
a-cold-wall:  45%|####5     | 1356/3000 [38:00<35:29,  1.30s/it, lr: 1.0e-04 loss: 4.806e-01]
a-cold-wall:  45%|####5     | 1356/3000 [38:00<35:29,  1.30s/it, lr: 1.0e-04 loss: 4.806e-01]
a-cold-wall:  45%|####5     | 1356/3000 [38:01<35:29,  1.30s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  45%|####5     | 1356/3000 [38:01<35:29,  1.30s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  45%|####5     | 1357/3000 [38:01<31:08,  1.14s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  45%|####5     | 1357/3000 [38:01<31:08,  1.14s/it, lr: 1.0e-04 loss: 2.394e-01]
a-cold-wall:  45%|####5     | 1357/3000 [38:04<31:08,  1.14s/it, lr: 1.0e-04 loss: 5.955e-01]
a-cold-wall:  45%|####5     | 1357/3000 [38:04<31:08,  1.14s/it, lr: 1.0e-04 loss: 5.955e-01]
a-cold-wall:  45%|####5     | 1358/3000 [38:04<44:58,  1.64s/it, lr: 1.0e-04 loss: 5.955e-01]
a-cold-wall:  45%|####5     | 1358/3000 [38:04<44:58,  1.64s/it, lr: 1.0e-04 loss: 5.955e-01]
a-cold-wall:  45%|####5     | 1358/3000 [38:05<44:58,  1.64s/it, lr: 1.0e-04 loss: 1.150e-01]
a-cold-wall:  45%|####5     | 1358/3000 [38:05<44:58,  1.64s/it, lr: 1.0e-04 loss: 1.150e-01]
a-cold-wall:  45%|####5     | 1359/3000 [38:05<39:33,  1.45s/it, lr: 1.0e-04 loss: 1.150e-01]
a-cold-wall:  45%|####5     | 1359/3000 [38:05<39:33,  1.45s/it, lr: 1.0e-04 loss: 1.150e-01]
a-cold-wall:  45%|####5     | 1359/3000 [38:06<39:33,  1.45s/it, lr: 1.0e-04 loss: 7.198e-02]
a-cold-wall:  45%|####5     | 1359/3000 [38:06<39:33,  1.45s/it, lr: 1.0e-04 loss: 7.198e-02]
a-cold-wall:  45%|####5     | 1360/3000 [38:07<39:31,  1.45s/it, lr: 1.0e-04 loss: 4.252e-01]
a-cold-wall:  45%|####5     | 1360/3000 [38:07<39:31,  1.45s/it, lr: 1.0e-04 loss: 4.252e-01]
a-cold-wall:  45%|####5     | 1361/3000 [38:07<30:19,  1.11s/it, lr: 1.0e-04 loss: 4.252e-01]
a-cold-wall:  45%|####5     | 1361/3000 [38:07<30:19,  1.11s/it, lr: 1.0e-04 loss: 4.252e-01]
a-cold-wall:  45%|####5     | 1361/3000 [38:10<30:19,  1.11s/it, lr: 1.0e-04 loss: 4.535e-01]
a-cold-wall:  45%|####5     | 1361/3000 [38:10<30:19,  1.11s/it, lr: 1.0e-04 loss: 4.535e-01]
a-cold-wall:  45%|####5     | 1362/3000 [38:10<42:24,  1.55s/it, lr: 1.0e-04 loss: 4.535e-01]
a-cold-wall:  45%|####5     | 1362/3000 [38:10<42:24,  1.55s/it, lr: 1.0e-04 loss: 4.535e-01]
a-cold-wall:  45%|####5     | 1362/3000 [38:12<42:24,  1.55s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  45%|####5     | 1362/3000 [38:12<42:24,  1.55s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  45%|####5     | 1363/3000 [38:12<41:26,  1.52s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  45%|####5     | 1363/3000 [38:12<41:26,  1.52s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  45%|####5     | 1363/3000 [38:13<41:26,  1.52s/it, lr: 1.0e-04 loss: 1.213e-01]
a-cold-wall:  45%|####5     | 1363/3000 [38:13<41:26,  1.52s/it, lr: 1.0e-04 loss: 1.213e-01]
a-cold-wall:  45%|####5     | 1364/3000 [38:13<36:21,  1.33s/it, lr: 1.0e-04 loss: 1.213e-01]
a-cold-wall:  45%|####5     | 1364/3000 [38:13<36:21,  1.33s/it, lr: 1.0e-04 loss: 1.213e-01]
a-cold-wall:  45%|####5     | 1364/3000 [38:16<36:21,  1.33s/it, lr: 1.0e-04 loss: 4.063e-01]
a-cold-wall:  45%|####5     | 1364/3000 [38:16<36:21,  1.33s/it, lr: 1.0e-04 loss: 4.063e-01]
a-cold-wall:  46%|####5     | 1365/3000 [38:16<48:23,  1.78s/it, lr: 1.0e-04 loss: 4.063e-01]
a-cold-wall:  46%|####5     | 1365/3000 [38:16<48:23,  1.78s/it, lr: 1.0e-04 loss: 4.063e-01]
a-cold-wall:  46%|####5     | 1365/3000 [38:17<48:23,  1.78s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  46%|####5     | 1365/3000 [38:17<48:23,  1.78s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  46%|####5     | 1366/3000 [38:17<40:28,  1.49s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  46%|####5     | 1366/3000 [38:17<40:28,  1.49s/it, lr: 1.0e-04 loss: 2.795e-01]
a-cold-wall:  46%|####5     | 1366/3000 [38:17<40:28,  1.49s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  46%|####5     | 1366/3000 [38:17<40:28,  1.49s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  46%|####5     | 1367/3000 [38:17<34:41,  1.27s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  46%|####5     | 1367/3000 [38:17<34:41,  1.27s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  46%|####5     | 1367/3000 [38:20<34:41,  1.27s/it, lr: 1.0e-04 loss: 6.297e-01]
a-cold-wall:  46%|####5     | 1367/3000 [38:20<34:41,  1.27s/it, lr: 1.0e-04 loss: 6.297e-01]
a-cold-wall:  46%|####5     | 1368/3000 [38:20<47:38,  1.75s/it, lr: 1.0e-04 loss: 6.297e-01]
a-cold-wall:  46%|####5     | 1368/3000 [38:20<47:38,  1.75s/it, lr: 1.0e-04 loss: 6.297e-01]
a-cold-wall:  46%|####5     | 1368/3000 [38:21<47:38,  1.75s/it, lr: 1.0e-04 loss: 1.675e-01]
a-cold-wall:  46%|####5     | 1368/3000 [38:21<47:38,  1.75s/it, lr: 1.0e-04 loss: 1.675e-01]
a-cold-wall:  46%|####5     | 1369/3000 [38:21<39:27,  1.45s/it, lr: 1.0e-04 loss: 1.675e-01]
a-cold-wall:  46%|####5     | 1369/3000 [38:21<39:27,  1.45s/it, lr: 1.0e-04 loss: 1.675e-01]
a-cold-wall:  46%|####5     | 1369/3000 [38:23<39:27,  1.45s/it, lr: 1.0e-04 loss: 7.702e-02]
a-cold-wall:  46%|####5     | 1369/3000 [38:23<39:27,  1.45s/it, lr: 1.0e-04 loss: 7.702e-02]
a-cold-wall:  46%|####5     | 1370/3000 [38:25<39:26,  1.45s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  46%|####5     | 1370/3000 [38:25<39:26,  1.45s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  46%|####5     | 1371/3000 [38:25<39:08,  1.44s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  46%|####5     | 1371/3000 [38:25<39:08,  1.44s/it, lr: 1.0e-04 loss: 6.983e-01]
a-cold-wall:  46%|####5     | 1371/3000 [38:27<39:08,  1.44s/it, lr: 1.0e-04 loss: 2.034e-01]
a-cold-wall:  46%|####5     | 1371/3000 [38:27<39:08,  1.44s/it, lr: 1.0e-04 loss: 2.034e-01]
a-cold-wall:  46%|####5     | 1372/3000 [38:27<40:35,  1.50s/it, lr: 1.0e-04 loss: 2.034e-01]
a-cold-wall:  46%|####5     | 1372/3000 [38:27<40:35,  1.50s/it, lr: 1.0e-04 loss: 2.034e-01]
a-cold-wall:  46%|####5     | 1372/3000 [38:30<40:35,  1.50s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  46%|####5     | 1372/3000 [38:30<40:35,  1.50s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  46%|####5     | 1373/3000 [38:30<50:06,  1.85s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  46%|####5     | 1373/3000 [38:30<50:06,  1.85s/it, lr: 1.0e-04 loss: 5.407e-01]
a-cold-wall:  46%|####5     | 1373/3000 [38:31<50:06,  1.85s/it, lr: 1.0e-04 loss: 8.104e-02]
a-cold-wall:  46%|####5     | 1373/3000 [38:31<50:06,  1.85s/it, lr: 1.0e-04 loss: 8.104e-02]
a-cold-wall:  46%|####5     | 1374/3000 [38:31<47:04,  1.74s/it, lr: 1.0e-04 loss: 8.104e-02]
a-cold-wall:  46%|####5     | 1374/3000 [38:31<47:04,  1.74s/it, lr: 1.0e-04 loss: 8.104e-02]
a-cold-wall:  46%|####5     | 1374/3000 [38:33<47:04,  1.74s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  46%|####5     | 1374/3000 [38:33<47:04,  1.74s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  46%|####5     | 1375/3000 [38:33<44:32,  1.64s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  46%|####5     | 1375/3000 [38:33<44:32,  1.64s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  46%|####5     | 1375/3000 [38:34<44:32,  1.64s/it, lr: 1.0e-04 loss: 2.253e-01]
a-cold-wall:  46%|####5     | 1375/3000 [38:34<44:32,  1.64s/it, lr: 1.0e-04 loss: 2.253e-01]
a-cold-wall:  46%|####5     | 1376/3000 [38:34<37:32,  1.39s/it, lr: 1.0e-04 loss: 2.253e-01]
a-cold-wall:  46%|####5     | 1376/3000 [38:34<37:32,  1.39s/it, lr: 1.0e-04 loss: 2.253e-01]
a-cold-wall:  46%|####5     | 1376/3000 [38:34<37:32,  1.39s/it, lr: 1.0e-04 loss: 7.817e-01]
a-cold-wall:  46%|####5     | 1376/3000 [38:34<37:32,  1.39s/it, lr: 1.0e-04 loss: 7.817e-01]
a-cold-wall:  46%|####5     | 1377/3000 [38:34<32:28,  1.20s/it, lr: 1.0e-04 loss: 7.817e-01]
a-cold-wall:  46%|####5     | 1377/3000 [38:34<32:28,  1.20s/it, lr: 1.0e-04 loss: 7.817e-01]
a-cold-wall:  46%|####5     | 1377/3000 [38:37<32:28,  1.20s/it, lr: 1.0e-04 loss: 6.709e-01]
a-cold-wall:  46%|####5     | 1377/3000 [38:37<32:28,  1.20s/it, lr: 1.0e-04 loss: 6.709e-01]
a-cold-wall:  46%|####5     | 1378/3000 [38:37<45:39,  1.69s/it, lr: 1.0e-04 loss: 6.709e-01]
a-cold-wall:  46%|####5     | 1378/3000 [38:37<45:39,  1.69s/it, lr: 1.0e-04 loss: 6.709e-01]
a-cold-wall:  46%|####5     | 1378/3000 [38:39<45:39,  1.69s/it, lr: 1.0e-04 loss: 1.436e-01]
a-cold-wall:  46%|####5     | 1378/3000 [38:39<45:39,  1.69s/it, lr: 1.0e-04 loss: 1.436e-01]
a-cold-wall:  46%|####5     | 1379/3000 [38:39<43:37,  1.61s/it, lr: 1.0e-04 loss: 1.436e-01]
a-cold-wall:  46%|####5     | 1379/3000 [38:39<43:37,  1.61s/it, lr: 1.0e-04 loss: 1.436e-01]
a-cold-wall:  46%|####5     | 1379/3000 [38:40<43:37,  1.61s/it, lr: 1.0e-04 loss: 5.889e-01]
a-cold-wall:  46%|####5     | 1379/3000 [38:40<43:37,  1.61s/it, lr: 1.0e-04 loss: 5.889e-01]
a-cold-wall:  46%|####6     | 1380/3000 [38:41<43:35,  1.61s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  46%|####6     | 1380/3000 [38:41<43:35,  1.61s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  46%|####6     | 1381/3000 [38:41<32:23,  1.20s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  46%|####6     | 1381/3000 [38:41<32:23,  1.20s/it, lr: 1.0e-04 loss: 2.812e-01]
a-cold-wall:  46%|####6     | 1381/3000 [38:43<32:23,  1.20s/it, lr: 1.0e-04 loss: 5.944e-01]
a-cold-wall:  46%|####6     | 1381/3000 [38:43<32:23,  1.20s/it, lr: 1.0e-04 loss: 5.944e-01]
a-cold-wall:  46%|####6     | 1382/3000 [38:43<33:47,  1.25s/it, lr: 1.0e-04 loss: 5.944e-01]
a-cold-wall:  46%|####6     | 1382/3000 [38:43<33:47,  1.25s/it, lr: 1.0e-04 loss: 5.944e-01]
a-cold-wall:  46%|####6     | 1382/3000 [38:46<33:47,  1.25s/it, lr: 1.0e-04 loss: 1.034e-01]
a-cold-wall:  46%|####6     | 1382/3000 [38:46<33:47,  1.25s/it, lr: 1.0e-04 loss: 1.034e-01]
a-cold-wall:  46%|####6     | 1383/3000 [38:46<44:51,  1.66s/it, lr: 1.0e-04 loss: 1.034e-01]
a-cold-wall:  46%|####6     | 1383/3000 [38:46<44:51,  1.66s/it, lr: 1.0e-04 loss: 1.034e-01]
a-cold-wall:  46%|####6     | 1383/3000 [38:46<44:51,  1.66s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  46%|####6     | 1383/3000 [38:46<44:51,  1.66s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  46%|####6     | 1384/3000 [38:46<38:02,  1.41s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  46%|####6     | 1384/3000 [38:46<38:02,  1.41s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  46%|####6     | 1384/3000 [38:47<38:02,  1.41s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  46%|####6     | 1384/3000 [38:47<38:02,  1.41s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  46%|####6     | 1385/3000 [38:47<34:43,  1.29s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  46%|####6     | 1385/3000 [38:47<34:43,  1.29s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  46%|####6     | 1385/3000 [38:49<34:43,  1.29s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  46%|####6     | 1385/3000 [38:49<34:43,  1.29s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  46%|####6     | 1386/3000 [38:49<35:39,  1.33s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  46%|####6     | 1386/3000 [38:49<35:39,  1.33s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  46%|####6     | 1386/3000 [38:52<35:39,  1.33s/it, lr: 1.0e-04 loss: 5.738e-01]
a-cold-wall:  46%|####6     | 1386/3000 [38:52<35:39,  1.33s/it, lr: 1.0e-04 loss: 5.738e-01]
a-cold-wall:  46%|####6     | 1387/3000 [38:52<47:37,  1.77s/it, lr: 1.0e-04 loss: 5.738e-01]
a-cold-wall:  46%|####6     | 1387/3000 [38:52<47:37,  1.77s/it, lr: 1.0e-04 loss: 5.738e-01]
a-cold-wall:  46%|####6     | 1387/3000 [38:54<47:37,  1.77s/it, lr: 1.0e-04 loss: 3.403e-01]
a-cold-wall:  46%|####6     | 1387/3000 [38:54<47:37,  1.77s/it, lr: 1.0e-04 loss: 3.403e-01]
a-cold-wall:  46%|####6     | 1388/3000 [38:54<56:09,  2.09s/it, lr: 1.0e-04 loss: 3.403e-01]
a-cold-wall:  46%|####6     | 1388/3000 [38:54<56:09,  2.09s/it, lr: 1.0e-04 loss: 3.403e-01]
a-cold-wall:  46%|####6     | 1388/3000 [38:56<56:09,  2.09s/it, lr: 1.0e-04 loss: 1.234e-01]
a-cold-wall:  46%|####6     | 1388/3000 [38:56<56:09,  2.09s/it, lr: 1.0e-04 loss: 1.234e-01]
a-cold-wall:  46%|####6     | 1389/3000 [38:56<50:40,  1.89s/it, lr: 1.0e-04 loss: 1.234e-01]
a-cold-wall:  46%|####6     | 1389/3000 [38:56<50:40,  1.89s/it, lr: 1.0e-04 loss: 1.234e-01]
a-cold-wall:  46%|####6     | 1389/3000 [38:59<50:40,  1.89s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  46%|####6     | 1389/3000 [38:59<50:40,  1.89s/it, lr: 1.0e-04 loss: 1.351e-01]
a-cold-wall:  46%|####6     | 1390/3000 [39:00<50:38,  1.89s/it, lr: 1.0e-04 loss: 5.265e-01]
a-cold-wall:  46%|####6     | 1390/3000 [39:00<50:38,  1.89s/it, lr: 1.0e-04 loss: 5.265e-01]
a-cold-wall:  46%|####6     | 1391/3000 [39:00<36:07,  1.35s/it, lr: 1.0e-04 loss: 5.265e-01]
a-cold-wall:  46%|####6     | 1391/3000 [39:00<36:07,  1.35s/it, lr: 1.0e-04 loss: 5.265e-01]
a-cold-wall:  46%|####6     | 1391/3000 [39:01<36:07,  1.35s/it, lr: 1.0e-04 loss: 4.215e-02]
a-cold-wall:  46%|####6     | 1391/3000 [39:01<36:07,  1.35s/it, lr: 1.0e-04 loss: 4.215e-02]
a-cold-wall:  46%|####6     | 1392/3000 [39:01<33:31,  1.25s/it, lr: 1.0e-04 loss: 4.215e-02]
a-cold-wall:  46%|####6     | 1392/3000 [39:01<33:31,  1.25s/it, lr: 1.0e-04 loss: 4.215e-02]
a-cold-wall:  46%|####6     | 1392/3000 [39:02<33:31,  1.25s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  46%|####6     | 1392/3000 [39:02<33:31,  1.25s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  46%|####6     | 1393/3000 [39:02<31:27,  1.17s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  46%|####6     | 1393/3000 [39:02<31:27,  1.17s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  46%|####6     | 1393/3000 [39:03<31:27,  1.17s/it, lr: 1.0e-04 loss: 6.576e-01]
a-cold-wall:  46%|####6     | 1393/3000 [39:03<31:27,  1.17s/it, lr: 1.0e-04 loss: 6.576e-01]
a-cold-wall:  46%|####6     | 1394/3000 [39:03<28:08,  1.05s/it, lr: 1.0e-04 loss: 6.576e-01]
a-cold-wall:  46%|####6     | 1394/3000 [39:03<28:08,  1.05s/it, lr: 1.0e-04 loss: 6.576e-01]
a-cold-wall:  46%|####6     | 1394/3000 [39:06<28:08,  1.05s/it, lr: 1.0e-04 loss: 5.395e-01]
a-cold-wall:  46%|####6     | 1394/3000 [39:06<28:08,  1.05s/it, lr: 1.0e-04 loss: 5.395e-01]
a-cold-wall:  46%|####6     | 1395/3000 [39:06<41:25,  1.55s/it, lr: 1.0e-04 loss: 5.395e-01]
a-cold-wall:  46%|####6     | 1395/3000 [39:06<41:25,  1.55s/it, lr: 1.0e-04 loss: 5.395e-01]
a-cold-wall:  46%|####6     | 1395/3000 [39:07<41:25,  1.55s/it, lr: 1.0e-04 loss: 5.014e-01]
a-cold-wall:  46%|####6     | 1395/3000 [39:07<41:25,  1.55s/it, lr: 1.0e-04 loss: 5.014e-01]
a-cold-wall:  47%|####6     | 1396/3000 [39:07<40:23,  1.51s/it, lr: 1.0e-04 loss: 5.014e-01]
a-cold-wall:  47%|####6     | 1396/3000 [39:07<40:23,  1.51s/it, lr: 1.0e-04 loss: 5.014e-01]
a-cold-wall:  47%|####6     | 1396/3000 [39:10<40:23,  1.51s/it, lr: 1.0e-04 loss: 4.244e-01]
a-cold-wall:  47%|####6     | 1396/3000 [39:10<40:23,  1.51s/it, lr: 1.0e-04 loss: 4.244e-01]
a-cold-wall:  47%|####6     | 1397/3000 [39:10<50:46,  1.90s/it, lr: 1.0e-04 loss: 4.244e-01]
a-cold-wall:  47%|####6     | 1397/3000 [39:10<50:46,  1.90s/it, lr: 1.0e-04 loss: 4.244e-01]
a-cold-wall:  47%|####6     | 1397/3000 [39:11<50:46,  1.90s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  47%|####6     | 1397/3000 [39:11<50:46,  1.90s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  47%|####6     | 1398/3000 [39:11<46:51,  1.75s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  47%|####6     | 1398/3000 [39:11<46:51,  1.75s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  47%|####6     | 1398/3000 [39:14<46:51,  1.75s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:  47%|####6     | 1398/3000 [39:14<46:51,  1.75s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:  47%|####6     | 1399/3000 [39:14<56:00,  2.10s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:  47%|####6     | 1399/3000 [39:14<56:00,  2.10s/it, lr: 1.0e-04 loss: 3.346e-01]
a-cold-wall:  47%|####6     | 1399/3000 [39:15<56:00,  2.10s/it, lr: 1.0e-04 loss: 8.285e-02]
a-cold-wall:  47%|####6     | 1399/3000 [39:15<56:00,  2.10s/it, lr: 1.0e-04 loss: 8.285e-02]
a-cold-wall:  47%|####6     | 1400/3000 [39:16<55:58,  2.10s/it, lr: 1.0e-04 loss: 7.449e-01]
a-cold-wall:  47%|####6     | 1400/3000 [39:16<55:58,  2.10s/it, lr: 1.0e-04 loss: 7.449e-01]
a-cold-wall:  47%|####6     | 1401/3000 [39:16<38:58,  1.46s/it, lr: 1.0e-04 loss: 7.449e-01]
a-cold-wall:  47%|####6     | 1401/3000 [39:16<38:58,  1.46s/it, lr: 1.0e-04 loss: 7.449e-01]
a-cold-wall:  47%|####6     | 1401/3000 [39:17<38:58,  1.46s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  47%|####6     | 1401/3000 [39:17<38:58,  1.46s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  47%|####6     | 1402/3000 [39:17<34:13,  1.29s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  47%|####6     | 1402/3000 [39:17<34:13,  1.29s/it, lr: 1.0e-04 loss: 1.978e-01]
a-cold-wall:  47%|####6     | 1402/3000 [39:19<34:13,  1.29s/it, lr: 1.0e-04 loss: 5.823e-01]
a-cold-wall:  47%|####6     | 1402/3000 [39:19<34:13,  1.29s/it, lr: 1.0e-04 loss: 5.823e-01]
a-cold-wall:  47%|####6     | 1403/3000 [39:19<35:06,  1.32s/it, lr: 1.0e-04 loss: 5.823e-01]
a-cold-wall:  47%|####6     | 1403/3000 [39:19<35:06,  1.32s/it, lr: 1.0e-04 loss: 5.823e-01]
a-cold-wall:  47%|####6     | 1403/3000 [39:20<35:06,  1.32s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  47%|####6     | 1403/3000 [39:20<35:06,  1.32s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  47%|####6     | 1404/3000 [39:20<35:45,  1.34s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  47%|####6     | 1404/3000 [39:20<35:45,  1.34s/it, lr: 1.0e-04 loss: 2.831e-01]
a-cold-wall:  47%|####6     | 1404/3000 [39:23<35:45,  1.34s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  47%|####6     | 1404/3000 [39:23<35:45,  1.34s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  47%|####6     | 1405/3000 [39:23<47:03,  1.77s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  47%|####6     | 1405/3000 [39:23<47:03,  1.77s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  47%|####6     | 1405/3000 [39:24<47:03,  1.77s/it, lr: 1.0e-04 loss: 3.840e-01]
a-cold-wall:  47%|####6     | 1405/3000 [39:24<47:03,  1.77s/it, lr: 1.0e-04 loss: 3.840e-01]
a-cold-wall:  47%|####6     | 1406/3000 [39:24<39:13,  1.48s/it, lr: 1.0e-04 loss: 3.840e-01]
a-cold-wall:  47%|####6     | 1406/3000 [39:24<39:13,  1.48s/it, lr: 1.0e-04 loss: 3.840e-01]
a-cold-wall:  47%|####6     | 1406/3000 [39:24<39:13,  1.48s/it, lr: 1.0e-04 loss: 6.071e-01]
a-cold-wall:  47%|####6     | 1406/3000 [39:24<39:13,  1.48s/it, lr: 1.0e-04 loss: 6.071e-01]
a-cold-wall:  47%|####6     | 1407/3000 [39:24<33:32,  1.26s/it, lr: 1.0e-04 loss: 6.071e-01]
a-cold-wall:  47%|####6     | 1407/3000 [39:24<33:32,  1.26s/it, lr: 1.0e-04 loss: 6.071e-01]
a-cold-wall:  47%|####6     | 1407/3000 [39:27<33:32,  1.26s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:  47%|####6     | 1407/3000 [39:27<33:32,  1.26s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:  47%|####6     | 1408/3000 [39:27<45:55,  1.73s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:  47%|####6     | 1408/3000 [39:27<45:55,  1.73s/it, lr: 1.0e-04 loss: 4.478e-01]
a-cold-wall:  47%|####6     | 1408/3000 [39:30<45:55,  1.73s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:  47%|####6     | 1408/3000 [39:30<45:55,  1.73s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:  47%|####6     | 1409/3000 [39:30<54:43,  2.06s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:  47%|####6     | 1409/3000 [39:30<54:43,  2.06s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall:  47%|####6     | 1409/3000 [39:31<54:43,  2.06s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  47%|####6     | 1409/3000 [39:31<54:43,  2.06s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  47%|####6     | 1410/3000 [39:32<54:41,  2.06s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  47%|####6     | 1410/3000 [39:32<54:41,  2.06s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  47%|####7     | 1411/3000 [39:32<38:16,  1.44s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  47%|####7     | 1411/3000 [39:32<38:16,  1.44s/it, lr: 1.0e-04 loss: 7.464e-01]
a-cold-wall:  47%|####7     | 1411/3000 [39:34<38:16,  1.44s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  47%|####7     | 1411/3000 [39:34<38:16,  1.44s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  47%|####7     | 1412/3000 [39:34<37:56,  1.43s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  47%|####7     | 1412/3000 [39:34<37:56,  1.43s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  47%|####7     | 1412/3000 [39:35<37:56,  1.43s/it, lr: 1.0e-04 loss: 3.951e-01]
a-cold-wall:  47%|####7     | 1412/3000 [39:35<37:56,  1.43s/it, lr: 1.0e-04 loss: 3.951e-01]
a-cold-wall:  47%|####7     | 1413/3000 [39:35<34:47,  1.32s/it, lr: 1.0e-04 loss: 3.951e-01]
a-cold-wall:  47%|####7     | 1413/3000 [39:35<34:47,  1.32s/it, lr: 1.0e-04 loss: 3.951e-01]
a-cold-wall:  47%|####7     | 1413/3000 [39:36<34:47,  1.32s/it, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  47%|####7     | 1413/3000 [39:36<34:47,  1.32s/it, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  47%|####7     | 1414/3000 [39:36<36:17,  1.37s/it, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  47%|####7     | 1414/3000 [39:36<36:17,  1.37s/it, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  47%|####7     | 1414/3000 [39:39<36:17,  1.37s/it, lr: 1.0e-04 loss: 4.754e-02]
a-cold-wall:  47%|####7     | 1414/3000 [39:39<36:17,  1.37s/it, lr: 1.0e-04 loss: 4.754e-02]
a-cold-wall:  47%|####7     | 1415/3000 [39:39<47:06,  1.78s/it, lr: 1.0e-04 loss: 4.754e-02]
a-cold-wall:  47%|####7     | 1415/3000 [39:39<47:06,  1.78s/it, lr: 1.0e-04 loss: 4.754e-02]
a-cold-wall:  47%|####7     | 1415/3000 [39:40<47:06,  1.78s/it, lr: 1.0e-04 loss: 1.995e-01]
a-cold-wall:  47%|####7     | 1415/3000 [39:40<47:06,  1.78s/it, lr: 1.0e-04 loss: 1.995e-01]
a-cold-wall:  47%|####7     | 1416/3000 [39:40<39:16,  1.49s/it, lr: 1.0e-04 loss: 1.995e-01]
a-cold-wall:  47%|####7     | 1416/3000 [39:40<39:16,  1.49s/it, lr: 1.0e-04 loss: 1.995e-01]
a-cold-wall:  47%|####7     | 1416/3000 [39:40<39:16,  1.49s/it, lr: 1.0e-04 loss: 5.316e-01]
a-cold-wall:  47%|####7     | 1416/3000 [39:40<39:16,  1.49s/it, lr: 1.0e-04 loss: 5.316e-01]
a-cold-wall:  47%|####7     | 1417/3000 [39:40<33:32,  1.27s/it, lr: 1.0e-04 loss: 5.316e-01]
a-cold-wall:  47%|####7     | 1417/3000 [39:40<33:32,  1.27s/it, lr: 1.0e-04 loss: 5.316e-01]
a-cold-wall:  47%|####7     | 1417/3000 [39:41<33:32,  1.27s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  47%|####7     | 1417/3000 [39:41<33:32,  1.27s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  47%|####7     | 1418/3000 [39:41<29:34,  1.12s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  47%|####7     | 1418/3000 [39:41<29:34,  1.12s/it, lr: 1.0e-04 loss: 7.238e-01]
a-cold-wall:  47%|####7     | 1418/3000 [39:42<29:34,  1.12s/it, lr: 1.0e-04 loss: 5.568e-01]
a-cold-wall:  47%|####7     | 1418/3000 [39:42<29:34,  1.12s/it, lr: 1.0e-04 loss: 5.568e-01]
a-cold-wall:  47%|####7     | 1419/3000 [39:42<26:37,  1.01s/it, lr: 1.0e-04 loss: 5.568e-01]
a-cold-wall:  47%|####7     | 1419/3000 [39:42<26:37,  1.01s/it, lr: 1.0e-04 loss: 5.568e-01]
a-cold-wall:  47%|####7     | 1419/3000 [39:45<26:37,  1.01s/it, lr: 1.0e-04 loss: 6.089e-01]
a-cold-wall:  47%|####7     | 1419/3000 [39:45<26:37,  1.01s/it, lr: 1.0e-04 loss: 6.089e-01]
a-cold-wall:  47%|####7     | 1420/3000 [39:46<26:36,  1.01s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  47%|####7     | 1420/3000 [39:46<26:36,  1.01s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  47%|####7     | 1421/3000 [39:46<22:54,  1.15it/s, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  47%|####7     | 1421/3000 [39:46<22:54,  1.15it/s, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  47%|####7     | 1421/3000 [39:47<22:54,  1.15it/s, lr: 1.0e-04 loss: 6.727e-03]
a-cold-wall:  47%|####7     | 1421/3000 [39:47<22:54,  1.15it/s, lr: 1.0e-04 loss: 6.727e-03]
a-cold-wall:  47%|####7     | 1422/3000 [39:47<22:03,  1.19it/s, lr: 1.0e-04 loss: 6.727e-03]
a-cold-wall:  47%|####7     | 1422/3000 [39:47<22:03,  1.19it/s, lr: 1.0e-04 loss: 6.727e-03]
a-cold-wall:  47%|####7     | 1422/3000 [39:50<22:03,  1.19it/s, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  47%|####7     | 1422/3000 [39:50<22:03,  1.19it/s, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  47%|####7     | 1423/3000 [39:50<35:48,  1.36s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  47%|####7     | 1423/3000 [39:50<35:48,  1.36s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  47%|####7     | 1423/3000 [39:53<35:48,  1.36s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  47%|####7     | 1423/3000 [39:53<35:48,  1.36s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  47%|####7     | 1424/3000 [39:53<46:36,  1.77s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  47%|####7     | 1424/3000 [39:53<46:36,  1.77s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  47%|####7     | 1424/3000 [39:53<46:36,  1.77s/it, lr: 1.0e-04 loss: 2.930e-01]
a-cold-wall:  47%|####7     | 1424/3000 [39:53<46:36,  1.77s/it, lr: 1.0e-04 loss: 2.930e-01]
a-cold-wall:  48%|####7     | 1425/3000 [39:53<39:03,  1.49s/it, lr: 1.0e-04 loss: 2.930e-01]
a-cold-wall:  48%|####7     | 1425/3000 [39:53<39:03,  1.49s/it, lr: 1.0e-04 loss: 2.930e-01]
a-cold-wall:  48%|####7     | 1425/3000 [39:56<39:03,  1.49s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  48%|####7     | 1425/3000 [39:56<39:03,  1.49s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  48%|####7     | 1426/3000 [39:56<49:56,  1.90s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  48%|####7     | 1426/3000 [39:56<49:56,  1.90s/it, lr: 1.0e-04 loss: 1.958e-01]
a-cold-wall:  48%|####7     | 1426/3000 [39:59<49:56,  1.90s/it, lr: 1.0e-04 loss: 2.132e-01]
a-cold-wall:  48%|####7     | 1426/3000 [39:59<49:56,  1.90s/it, lr: 1.0e-04 loss: 2.132e-01]
a-cold-wall:  48%|####7     | 1427/3000 [39:59<57:08,  2.18s/it, lr: 1.0e-04 loss: 2.132e-01]
a-cold-wall:  48%|####7     | 1427/3000 [39:59<57:08,  2.18s/it, lr: 1.0e-04 loss: 2.132e-01]
a-cold-wall:  48%|####7     | 1427/3000 [40:00<57:08,  2.18s/it, lr: 1.0e-04 loss: 6.483e-01]
a-cold-wall:  48%|####7     | 1427/3000 [40:00<57:08,  2.18s/it, lr: 1.0e-04 loss: 6.483e-01]
a-cold-wall:  48%|####7     | 1428/3000 [40:00<46:05,  1.76s/it, lr: 1.0e-04 loss: 6.483e-01]
a-cold-wall:  48%|####7     | 1428/3000 [40:00<46:05,  1.76s/it, lr: 1.0e-04 loss: 6.483e-01]
a-cold-wall:  48%|####7     | 1428/3000 [40:01<46:05,  1.76s/it, lr: 1.0e-04 loss: 2.698e-01]
a-cold-wall:  48%|####7     | 1428/3000 [40:01<46:05,  1.76s/it, lr: 1.0e-04 loss: 2.698e-01]
a-cold-wall:  48%|####7     | 1429/3000 [40:01<38:17,  1.46s/it, lr: 1.0e-04 loss: 2.698e-01]
a-cold-wall:  48%|####7     | 1429/3000 [40:01<38:17,  1.46s/it, lr: 1.0e-04 loss: 2.698e-01]
a-cold-wall:  48%|####7     | 1429/3000 [40:01<38:17,  1.46s/it, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  48%|####7     | 1429/3000 [40:01<38:17,  1.46s/it, lr: 1.0e-04 loss: 1.703e-01]
a-cold-wall:  48%|####7     | 1430/3000 [40:03<38:16,  1.46s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  48%|####7     | 1430/3000 [40:03<38:16,  1.46s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  48%|####7     | 1431/3000 [40:03<29:24,  1.12s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  48%|####7     | 1431/3000 [40:03<29:24,  1.12s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  48%|####7     | 1431/3000 [40:06<29:24,  1.12s/it, lr: 1.0e-04 loss: 4.716e-01]
a-cold-wall:  48%|####7     | 1431/3000 [40:06<29:24,  1.12s/it, lr: 1.0e-04 loss: 4.716e-01]
a-cold-wall:  48%|####7     | 1432/3000 [40:06<41:06,  1.57s/it, lr: 1.0e-04 loss: 4.716e-01]
a-cold-wall:  48%|####7     | 1432/3000 [40:06<41:06,  1.57s/it, lr: 1.0e-04 loss: 4.716e-01]
a-cold-wall:  48%|####7     | 1432/3000 [40:07<41:06,  1.57s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  48%|####7     | 1432/3000 [40:07<41:06,  1.57s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  48%|####7     | 1433/3000 [40:07<40:11,  1.54s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  48%|####7     | 1433/3000 [40:07<40:11,  1.54s/it, lr: 1.0e-04 loss: 2.120e-01]
a-cold-wall:  48%|####7     | 1433/3000 [40:09<40:11,  1.54s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  48%|####7     | 1433/3000 [40:09<40:11,  1.54s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  48%|####7     | 1434/3000 [40:09<39:24,  1.51s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  48%|####7     | 1434/3000 [40:09<39:24,  1.51s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  48%|####7     | 1434/3000 [40:12<39:24,  1.51s/it, lr: 1.0e-04 loss: 4.598e-02]
a-cold-wall:  48%|####7     | 1434/3000 [40:12<39:24,  1.51s/it, lr: 1.0e-04 loss: 4.598e-02]
a-cold-wall:  48%|####7     | 1435/3000 [40:12<49:33,  1.90s/it, lr: 1.0e-04 loss: 4.598e-02]
a-cold-wall:  48%|####7     | 1435/3000 [40:12<49:33,  1.90s/it, lr: 1.0e-04 loss: 4.598e-02]
a-cold-wall:  48%|####7     | 1435/3000 [40:13<49:33,  1.90s/it, lr: 1.0e-04 loss: 5.219e-01]
a-cold-wall:  48%|####7     | 1435/3000 [40:13<49:33,  1.90s/it, lr: 1.0e-04 loss: 5.219e-01]
a-cold-wall:  48%|####7     | 1436/3000 [40:13<46:05,  1.77s/it, lr: 1.0e-04 loss: 5.219e-01]
a-cold-wall:  48%|####7     | 1436/3000 [40:13<46:05,  1.77s/it, lr: 1.0e-04 loss: 5.219e-01]
a-cold-wall:  48%|####7     | 1436/3000 [40:16<46:05,  1.77s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  48%|####7     | 1436/3000 [40:16<46:05,  1.77s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  48%|####7     | 1437/3000 [40:16<54:42,  2.10s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  48%|####7     | 1437/3000 [40:16<54:42,  2.10s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  48%|####7     | 1437/3000 [40:17<54:42,  2.10s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  48%|####7     | 1437/3000 [40:17<54:42,  2.10s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  48%|####7     | 1438/3000 [40:17<44:24,  1.71s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  48%|####7     | 1438/3000 [40:17<44:24,  1.71s/it, lr: 1.0e-04 loss: 3.074e-01]
a-cold-wall:  48%|####7     | 1438/3000 [40:20<44:24,  1.71s/it, lr: 1.0e-04 loss: 5.339e-01]
a-cold-wall:  48%|####7     | 1438/3000 [40:20<44:24,  1.71s/it, lr: 1.0e-04 loss: 5.339e-01]
a-cold-wall:  48%|####7     | 1439/3000 [40:20<53:54,  2.07s/it, lr: 1.0e-04 loss: 5.339e-01]
a-cold-wall:  48%|####7     | 1439/3000 [40:20<53:54,  2.07s/it, lr: 1.0e-04 loss: 5.339e-01]
a-cold-wall:  48%|####7     | 1439/3000 [40:21<53:54,  2.07s/it, lr: 1.0e-04 loss: 4.389e-01]
a-cold-wall:  48%|####7     | 1439/3000 [40:21<53:54,  2.07s/it, lr: 1.0e-04 loss: 4.389e-01]
a-cold-wall:  48%|####8     | 1440/3000 [40:24<53:52,  2.07s/it, lr: 1.0e-04 loss: 5.894e-01]
a-cold-wall:  48%|####8     | 1440/3000 [40:24<53:52,  2.07s/it, lr: 1.0e-04 loss: 5.894e-01]
a-cold-wall:  48%|####8     | 1441/3000 [40:24<46:32,  1.79s/it, lr: 1.0e-04 loss: 5.894e-01]
a-cold-wall:  48%|####8     | 1441/3000 [40:24<46:32,  1.79s/it, lr: 1.0e-04 loss: 5.894e-01]
a-cold-wall:  48%|####8     | 1441/3000 [40:25<46:32,  1.79s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  48%|####8     | 1441/3000 [40:25<46:32,  1.79s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  48%|####8     | 1442/3000 [40:25<44:10,  1.70s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  48%|####8     | 1442/3000 [40:25<44:10,  1.70s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  48%|####8     | 1442/3000 [40:27<44:10,  1.70s/it, lr: 1.0e-04 loss: 2.089e-01]
a-cold-wall:  48%|####8     | 1442/3000 [40:27<44:10,  1.70s/it, lr: 1.0e-04 loss: 2.089e-01]
a-cold-wall:  48%|####8     | 1443/3000 [40:27<42:22,  1.63s/it, lr: 1.0e-04 loss: 2.089e-01]
a-cold-wall:  48%|####8     | 1443/3000 [40:27<42:22,  1.63s/it, lr: 1.0e-04 loss: 2.089e-01]
a-cold-wall:  48%|####8     | 1443/3000 [40:28<42:22,  1.63s/it, lr: 1.0e-04 loss: 5.487e-01]
a-cold-wall:  48%|####8     | 1443/3000 [40:28<42:22,  1.63s/it, lr: 1.0e-04 loss: 5.487e-01]
a-cold-wall:  48%|####8     | 1444/3000 [40:28<36:08,  1.39s/it, lr: 1.0e-04 loss: 5.487e-01]
a-cold-wall:  48%|####8     | 1444/3000 [40:28<36:08,  1.39s/it, lr: 1.0e-04 loss: 5.487e-01]
a-cold-wall:  48%|####8     | 1444/3000 [40:31<36:08,  1.39s/it, lr: 1.0e-04 loss: 7.780e-02]
a-cold-wall:  48%|####8     | 1444/3000 [40:31<36:08,  1.39s/it, lr: 1.0e-04 loss: 7.780e-02]
a-cold-wall:  48%|####8     | 1445/3000 [40:31<46:58,  1.81s/it, lr: 1.0e-04 loss: 7.780e-02]
a-cold-wall:  48%|####8     | 1445/3000 [40:31<46:58,  1.81s/it, lr: 1.0e-04 loss: 7.780e-02]
a-cold-wall:  48%|####8     | 1445/3000 [40:31<46:58,  1.81s/it, lr: 1.0e-04 loss: 4.721e-01]
a-cold-wall:  48%|####8     | 1445/3000 [40:31<46:58,  1.81s/it, lr: 1.0e-04 loss: 4.721e-01]
a-cold-wall:  48%|####8     | 1446/3000 [40:31<39:04,  1.51s/it, lr: 1.0e-04 loss: 4.721e-01]
a-cold-wall:  48%|####8     | 1446/3000 [40:31<39:04,  1.51s/it, lr: 1.0e-04 loss: 4.721e-01]
a-cold-wall:  48%|####8     | 1446/3000 [40:34<39:04,  1.51s/it, lr: 1.0e-04 loss: 9.831e-02]
a-cold-wall:  48%|####8     | 1446/3000 [40:34<39:04,  1.51s/it, lr: 1.0e-04 loss: 9.831e-02]
a-cold-wall:  48%|####8     | 1447/3000 [40:34<49:07,  1.90s/it, lr: 1.0e-04 loss: 9.831e-02]
a-cold-wall:  48%|####8     | 1447/3000 [40:34<49:07,  1.90s/it, lr: 1.0e-04 loss: 9.831e-02]
a-cold-wall:  48%|####8     | 1447/3000 [40:35<49:07,  1.90s/it, lr: 1.0e-04 loss: 5.404e-01]
a-cold-wall:  48%|####8     | 1447/3000 [40:35<49:07,  1.90s/it, lr: 1.0e-04 loss: 5.404e-01]
a-cold-wall:  48%|####8     | 1448/3000 [40:35<40:18,  1.56s/it, lr: 1.0e-04 loss: 5.404e-01]
a-cold-wall:  48%|####8     | 1448/3000 [40:35<40:18,  1.56s/it, lr: 1.0e-04 loss: 5.404e-01]
a-cold-wall:  48%|####8     | 1448/3000 [40:38<40:18,  1.56s/it, lr: 1.0e-04 loss: 5.429e-01]
a-cold-wall:  48%|####8     | 1448/3000 [40:38<40:18,  1.56s/it, lr: 1.0e-04 loss: 5.429e-01]
a-cold-wall:  48%|####8     | 1449/3000 [40:38<50:08,  1.94s/it, lr: 1.0e-04 loss: 5.429e-01]
a-cold-wall:  48%|####8     | 1449/3000 [40:38<50:08,  1.94s/it, lr: 1.0e-04 loss: 5.429e-01]
a-cold-wall:  48%|####8     | 1449/3000 [40:38<50:08,  1.94s/it, lr: 1.0e-04 loss: 4.575e-01]
a-cold-wall:  48%|####8     | 1449/3000 [40:38<50:08,  1.94s/it, lr: 1.0e-04 loss: 4.575e-01]
a-cold-wall:  48%|####8     | 1450/3000 [40:39<50:06,  1.94s/it, lr: 1.0e-04 loss: 5.078e-01]
a-cold-wall:  48%|####8     | 1450/3000 [40:39<50:06,  1.94s/it, lr: 1.0e-04 loss: 5.078e-01]
a-cold-wall:  48%|####8     | 1451/3000 [40:39<31:33,  1.22s/it, lr: 1.0e-04 loss: 5.078e-01]
a-cold-wall:  48%|####8     | 1451/3000 [40:39<31:33,  1.22s/it, lr: 1.0e-04 loss: 5.078e-01]
a-cold-wall:  48%|####8     | 1451/3000 [40:42<31:33,  1.22s/it, lr: 1.0e-04 loss: 7.382e-01]
a-cold-wall:  48%|####8     | 1451/3000 [40:42<31:33,  1.22s/it, lr: 1.0e-04 loss: 7.382e-01]
a-cold-wall:  48%|####8     | 1452/3000 [40:42<42:20,  1.64s/it, lr: 1.0e-04 loss: 7.382e-01]
a-cold-wall:  48%|####8     | 1452/3000 [40:42<42:20,  1.64s/it, lr: 1.0e-04 loss: 7.382e-01]
a-cold-wall:  48%|####8     | 1452/3000 [40:43<42:20,  1.64s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  48%|####8     | 1452/3000 [40:43<42:20,  1.64s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  48%|####8     | 1453/3000 [40:43<36:17,  1.41s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  48%|####8     | 1453/3000 [40:43<36:17,  1.41s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  48%|####8     | 1453/3000 [40:44<36:17,  1.41s/it, lr: 1.0e-04 loss: 4.265e-01]
a-cold-wall:  48%|####8     | 1453/3000 [40:44<36:17,  1.41s/it, lr: 1.0e-04 loss: 4.265e-01]
a-cold-wall:  48%|####8     | 1454/3000 [40:44<36:15,  1.41s/it, lr: 1.0e-04 loss: 4.265e-01]
a-cold-wall:  48%|####8     | 1454/3000 [40:44<36:15,  1.41s/it, lr: 1.0e-04 loss: 4.265e-01]
a-cold-wall:  48%|####8     | 1454/3000 [40:46<36:15,  1.41s/it, lr: 1.0e-04 loss: 6.375e-01]
a-cold-wall:  48%|####8     | 1454/3000 [40:46<36:15,  1.41s/it, lr: 1.0e-04 loss: 6.375e-01]
a-cold-wall:  48%|####8     | 1455/3000 [40:46<36:17,  1.41s/it, lr: 1.0e-04 loss: 6.375e-01]
a-cold-wall:  48%|####8     | 1455/3000 [40:46<36:17,  1.41s/it, lr: 1.0e-04 loss: 6.375e-01]
a-cold-wall:  48%|####8     | 1455/3000 [40:49<36:17,  1.41s/it, lr: 1.0e-04 loss: 6.598e-01]
a-cold-wall:  48%|####8     | 1455/3000 [40:49<36:17,  1.41s/it, lr: 1.0e-04 loss: 6.598e-01]
a-cold-wall:  49%|####8     | 1456/3000 [40:49<46:54,  1.82s/it, lr: 1.0e-04 loss: 6.598e-01]
a-cold-wall:  49%|####8     | 1456/3000 [40:49<46:54,  1.82s/it, lr: 1.0e-04 loss: 6.598e-01]
a-cold-wall:  49%|####8     | 1456/3000 [40:50<46:54,  1.82s/it, lr: 1.0e-04 loss: 3.808e-01]
a-cold-wall:  49%|####8     | 1456/3000 [40:50<46:54,  1.82s/it, lr: 1.0e-04 loss: 3.808e-01]
a-cold-wall:  49%|####8     | 1457/3000 [40:50<43:49,  1.70s/it, lr: 1.0e-04 loss: 3.808e-01]
a-cold-wall:  49%|####8     | 1457/3000 [40:50<43:49,  1.70s/it, lr: 1.0e-04 loss: 3.808e-01]
a-cold-wall:  49%|####8     | 1457/3000 [40:51<43:49,  1.70s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  49%|####8     | 1457/3000 [40:51<43:49,  1.70s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  49%|####8     | 1458/3000 [40:51<41:42,  1.62s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  49%|####8     | 1458/3000 [40:51<41:42,  1.62s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  49%|####8     | 1458/3000 [40:52<41:42,  1.62s/it, lr: 1.0e-04 loss: 1.913e-01]
a-cold-wall:  49%|####8     | 1458/3000 [40:52<41:42,  1.62s/it, lr: 1.0e-04 loss: 1.913e-01]
a-cold-wall:  49%|####8     | 1459/3000 [40:52<35:05,  1.37s/it, lr: 1.0e-04 loss: 1.913e-01]
a-cold-wall:  49%|####8     | 1459/3000 [40:52<35:05,  1.37s/it, lr: 1.0e-04 loss: 1.913e-01]
a-cold-wall:  49%|####8     | 1459/3000 [40:55<35:05,  1.37s/it, lr: 1.0e-04 loss: 6.365e-01]
a-cold-wall:  49%|####8     | 1459/3000 [40:55<35:05,  1.37s/it, lr: 1.0e-04 loss: 6.365e-01]
a-cold-wall:  49%|####8     | 1460/3000 [40:58<35:04,  1.37s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  49%|####8     | 1460/3000 [40:58<35:04,  1.37s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  49%|####8     | 1461/3000 [40:58<35:44,  1.39s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  49%|####8     | 1461/3000 [40:58<35:44,  1.39s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  49%|####8     | 1461/3000 [40:59<35:44,  1.39s/it, lr: 1.0e-04 loss: 4.985e-01]
a-cold-wall:  49%|####8     | 1461/3000 [40:59<35:44,  1.39s/it, lr: 1.0e-04 loss: 4.985e-01]
a-cold-wall:  49%|####8     | 1462/3000 [40:59<35:45,  1.39s/it, lr: 1.0e-04 loss: 4.985e-01]
a-cold-wall:  49%|####8     | 1462/3000 [40:59<35:45,  1.39s/it, lr: 1.0e-04 loss: 4.985e-01]
a-cold-wall:  49%|####8     | 1462/3000 [41:00<35:45,  1.39s/it, lr: 1.0e-04 loss: 7.479e-01]
a-cold-wall:  49%|####8     | 1462/3000 [41:00<35:45,  1.39s/it, lr: 1.0e-04 loss: 7.479e-01]
a-cold-wall:  49%|####8     | 1463/3000 [41:00<31:21,  1.22s/it, lr: 1.0e-04 loss: 7.479e-01]
a-cold-wall:  49%|####8     | 1463/3000 [41:00<31:21,  1.22s/it, lr: 1.0e-04 loss: 7.479e-01]
a-cold-wall:  49%|####8     | 1463/3000 [41:01<31:21,  1.22s/it, lr: 1.0e-04 loss: 4.895e-01]
a-cold-wall:  49%|####8     | 1463/3000 [41:01<31:21,  1.22s/it, lr: 1.0e-04 loss: 4.895e-01]
a-cold-wall:  49%|####8     | 1464/3000 [41:01<32:33,  1.27s/it, lr: 1.0e-04 loss: 4.895e-01]
a-cold-wall:  49%|####8     | 1464/3000 [41:01<32:33,  1.27s/it, lr: 1.0e-04 loss: 4.895e-01]
a-cold-wall:  49%|####8     | 1464/3000 [41:04<32:33,  1.27s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:  49%|####8     | 1464/3000 [41:04<32:33,  1.27s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:  49%|####8     | 1465/3000 [41:04<43:52,  1.72s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:  49%|####8     | 1465/3000 [41:04<43:52,  1.72s/it, lr: 1.0e-04 loss: 4.348e-01]
a-cold-wall:  49%|####8     | 1465/3000 [41:05<43:52,  1.72s/it, lr: 1.0e-04 loss: 3.528e-01]
a-cold-wall:  49%|####8     | 1465/3000 [41:05<43:52,  1.72s/it, lr: 1.0e-04 loss: 3.528e-01]
a-cold-wall:  49%|####8     | 1466/3000 [41:05<36:44,  1.44s/it, lr: 1.0e-04 loss: 3.528e-01]
a-cold-wall:  49%|####8     | 1466/3000 [41:05<36:44,  1.44s/it, lr: 1.0e-04 loss: 3.528e-01]
a-cold-wall:  49%|####8     | 1466/3000 [41:07<36:44,  1.44s/it, lr: 1.0e-04 loss: 5.536e-01]
a-cold-wall:  49%|####8     | 1466/3000 [41:07<36:44,  1.44s/it, lr: 1.0e-04 loss: 5.536e-01]
a-cold-wall:  49%|####8     | 1467/3000 [41:07<37:36,  1.47s/it, lr: 1.0e-04 loss: 5.536e-01]
a-cold-wall:  49%|####8     | 1467/3000 [41:07<37:36,  1.47s/it, lr: 1.0e-04 loss: 5.536e-01]
a-cold-wall:  49%|####8     | 1467/3000 [41:07<37:36,  1.47s/it, lr: 1.0e-04 loss: 3.121e-01]
a-cold-wall:  49%|####8     | 1467/3000 [41:07<37:36,  1.47s/it, lr: 1.0e-04 loss: 3.121e-01]
a-cold-wall:  49%|####8     | 1468/3000 [41:07<32:02,  1.25s/it, lr: 1.0e-04 loss: 3.121e-01]
a-cold-wall:  49%|####8     | 1468/3000 [41:07<32:02,  1.25s/it, lr: 1.0e-04 loss: 3.121e-01]
a-cold-wall:  49%|####8     | 1468/3000 [41:08<32:02,  1.25s/it, lr: 1.0e-04 loss: 4.526e-01]
a-cold-wall:  49%|####8     | 1468/3000 [41:08<32:02,  1.25s/it, lr: 1.0e-04 loss: 4.526e-01]
a-cold-wall:  49%|####8     | 1469/3000 [41:08<28:43,  1.13s/it, lr: 1.0e-04 loss: 4.526e-01]
a-cold-wall:  49%|####8     | 1469/3000 [41:08<28:43,  1.13s/it, lr: 1.0e-04 loss: 4.526e-01]
a-cold-wall:  49%|####8     | 1469/3000 [41:10<28:43,  1.13s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  49%|####8     | 1469/3000 [41:10<28:43,  1.13s/it, lr: 1.0e-04 loss: 5.285e-01]
a-cold-wall:  49%|####9     | 1470/3000 [41:11<28:42,  1.13s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  49%|####9     | 1470/3000 [41:11<28:42,  1.13s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  49%|####9     | 1471/3000 [41:11<20:00,  1.27it/s, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  49%|####9     | 1471/3000 [41:11<20:00,  1.27it/s, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  49%|####9     | 1471/3000 [41:14<20:00,  1.27it/s, lr: 1.0e-04 loss: 1.753e-01]
a-cold-wall:  49%|####9     | 1471/3000 [41:14<20:00,  1.27it/s, lr: 1.0e-04 loss: 1.753e-01]
a-cold-wall:  49%|####9     | 1472/3000 [41:14<32:43,  1.28s/it, lr: 1.0e-04 loss: 1.753e-01]
a-cold-wall:  49%|####9     | 1472/3000 [41:14<32:43,  1.28s/it, lr: 1.0e-04 loss: 1.753e-01]
a-cold-wall:  49%|####9     | 1472/3000 [41:15<32:43,  1.28s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  49%|####9     | 1472/3000 [41:15<32:43,  1.28s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  49%|####9     | 1473/3000 [41:15<30:33,  1.20s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  49%|####9     | 1473/3000 [41:15<30:33,  1.20s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  49%|####9     | 1473/3000 [41:16<30:33,  1.20s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  49%|####9     | 1473/3000 [41:16<30:33,  1.20s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  49%|####9     | 1474/3000 [41:16<32:07,  1.26s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  49%|####9     | 1474/3000 [41:16<32:07,  1.26s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  49%|####9     | 1474/3000 [41:19<32:07,  1.26s/it, lr: 1.0e-04 loss: 5.655e-01]
a-cold-wall:  49%|####9     | 1474/3000 [41:19<32:07,  1.26s/it, lr: 1.0e-04 loss: 5.655e-01]
a-cold-wall:  49%|####9     | 1475/3000 [41:19<43:22,  1.71s/it, lr: 1.0e-04 loss: 5.655e-01]
a-cold-wall:  49%|####9     | 1475/3000 [41:19<43:22,  1.71s/it, lr: 1.0e-04 loss: 5.655e-01]
a-cold-wall:  49%|####9     | 1475/3000 [41:20<43:22,  1.71s/it, lr: 1.0e-04 loss: 1.525e-01]
a-cold-wall:  49%|####9     | 1475/3000 [41:20<43:22,  1.71s/it, lr: 1.0e-04 loss: 1.525e-01]
a-cold-wall:  49%|####9     | 1476/3000 [41:20<36:28,  1.44s/it, lr: 1.0e-04 loss: 1.525e-01]
a-cold-wall:  49%|####9     | 1476/3000 [41:20<36:28,  1.44s/it, lr: 1.0e-04 loss: 1.525e-01]
a-cold-wall:  49%|####9     | 1476/3000 [41:20<36:28,  1.44s/it, lr: 1.0e-04 loss: 1.539e-01]
a-cold-wall:  49%|####9     | 1476/3000 [41:20<36:28,  1.44s/it, lr: 1.0e-04 loss: 1.539e-01]
a-cold-wall:  49%|####9     | 1477/3000 [41:20<31:28,  1.24s/it, lr: 1.0e-04 loss: 1.539e-01]
a-cold-wall:  49%|####9     | 1477/3000 [41:20<31:28,  1.24s/it, lr: 1.0e-04 loss: 1.539e-01]
a-cold-wall:  49%|####9     | 1477/3000 [41:22<31:28,  1.24s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:  49%|####9     | 1477/3000 [41:22<31:28,  1.24s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:  49%|####9     | 1478/3000 [41:22<32:44,  1.29s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:  49%|####9     | 1478/3000 [41:22<32:44,  1.29s/it, lr: 1.0e-04 loss: 2.091e-01]
a-cold-wall:  49%|####9     | 1478/3000 [41:22<32:44,  1.29s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  49%|####9     | 1478/3000 [41:22<32:44,  1.29s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  49%|####9     | 1479/3000 [41:22<28:37,  1.13s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  49%|####9     | 1479/3000 [41:22<28:37,  1.13s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  49%|####9     | 1479/3000 [41:24<28:37,  1.13s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  49%|####9     | 1479/3000 [41:24<28:37,  1.13s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  49%|####9     | 1480/3000 [41:27<28:36,  1.13s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  49%|####9     | 1480/3000 [41:27<28:36,  1.13s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  49%|####9     | 1481/3000 [41:27<33:14,  1.31s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  49%|####9     | 1481/3000 [41:27<33:14,  1.31s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  49%|####9     | 1481/3000 [41:28<33:14,  1.31s/it, lr: 1.0e-04 loss: 4.235e-01]
a-cold-wall:  49%|####9     | 1481/3000 [41:28<33:14,  1.31s/it, lr: 1.0e-04 loss: 4.235e-01]
a-cold-wall:  49%|####9     | 1482/3000 [41:28<33:44,  1.33s/it, lr: 1.0e-04 loss: 4.235e-01]
a-cold-wall:  49%|####9     | 1482/3000 [41:28<33:44,  1.33s/it, lr: 1.0e-04 loss: 4.235e-01]
a-cold-wall:  49%|####9     | 1482/3000 [41:29<33:44,  1.33s/it, lr: 1.0e-04 loss: 4.626e-01]
a-cold-wall:  49%|####9     | 1482/3000 [41:29<33:44,  1.33s/it, lr: 1.0e-04 loss: 4.626e-01]
a-cold-wall:  49%|####9     | 1483/3000 [41:29<29:52,  1.18s/it, lr: 1.0e-04 loss: 4.626e-01]
a-cold-wall:  49%|####9     | 1483/3000 [41:29<29:52,  1.18s/it, lr: 1.0e-04 loss: 4.626e-01]
a-cold-wall:  49%|####9     | 1483/3000 [41:30<29:52,  1.18s/it, lr: 1.0e-04 loss: 6.121e-01]
a-cold-wall:  49%|####9     | 1483/3000 [41:30<29:52,  1.18s/it, lr: 1.0e-04 loss: 6.121e-01]
a-cold-wall:  49%|####9     | 1484/3000 [41:30<26:48,  1.06s/it, lr: 1.0e-04 loss: 6.121e-01]
a-cold-wall:  49%|####9     | 1484/3000 [41:30<26:48,  1.06s/it, lr: 1.0e-04 loss: 6.121e-01]
a-cold-wall:  49%|####9     | 1484/3000 [41:31<26:48,  1.06s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  49%|####9     | 1484/3000 [41:31<26:48,  1.06s/it, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  50%|####9     | 1485/3000 [41:31<24:29,  1.03it/s, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  50%|####9     | 1485/3000 [41:31<24:29,  1.03it/s, lr: 1.0e-04 loss: 7.070e-01]
a-cold-wall:  50%|####9     | 1485/3000 [41:32<24:29,  1.03it/s, lr: 1.0e-04 loss: 2.270e-01]
a-cold-wall:  50%|####9     | 1485/3000 [41:32<24:29,  1.03it/s, lr: 1.0e-04 loss: 2.270e-01]
a-cold-wall:  50%|####9     | 1486/3000 [41:32<27:33,  1.09s/it, lr: 1.0e-04 loss: 2.270e-01]
a-cold-wall:  50%|####9     | 1486/3000 [41:32<27:33,  1.09s/it, lr: 1.0e-04 loss: 2.270e-01]
a-cold-wall:  50%|####9     | 1486/3000 [41:33<27:33,  1.09s/it, lr: 1.0e-04 loss: 2.012e-01]
a-cold-wall:  50%|####9     | 1486/3000 [41:33<27:33,  1.09s/it, lr: 1.0e-04 loss: 2.012e-01]
a-cold-wall:  50%|####9     | 1487/3000 [41:33<25:00,  1.01it/s, lr: 1.0e-04 loss: 2.012e-01]
a-cold-wall:  50%|####9     | 1487/3000 [41:33<25:00,  1.01it/s, lr: 1.0e-04 loss: 2.012e-01]
a-cold-wall:  50%|####9     | 1487/3000 [41:36<25:00,  1.01it/s, lr: 1.0e-04 loss: 4.472e-01]
a-cold-wall:  50%|####9     | 1487/3000 [41:36<25:00,  1.01it/s, lr: 1.0e-04 loss: 4.472e-01]
a-cold-wall:  50%|####9     | 1488/3000 [41:36<38:27,  1.53s/it, lr: 1.0e-04 loss: 4.472e-01]
a-cold-wall:  50%|####9     | 1488/3000 [41:36<38:27,  1.53s/it, lr: 1.0e-04 loss: 4.472e-01]
a-cold-wall:  50%|####9     | 1488/3000 [41:37<38:27,  1.53s/it, lr: 1.0e-04 loss: 3.986e-01]
a-cold-wall:  50%|####9     | 1488/3000 [41:37<38:27,  1.53s/it, lr: 1.0e-04 loss: 3.986e-01]
a-cold-wall:  50%|####9     | 1489/3000 [41:37<37:27,  1.49s/it, lr: 1.0e-04 loss: 3.986e-01]
a-cold-wall:  50%|####9     | 1489/3000 [41:37<37:27,  1.49s/it, lr: 1.0e-04 loss: 3.986e-01]
a-cold-wall:  50%|####9     | 1489/3000 [41:40<37:27,  1.49s/it, lr: 1.0e-04 loss: 2.289e-01]
a-cold-wall:  50%|####9     | 1489/3000 [41:40<37:27,  1.49s/it, lr: 1.0e-04 loss: 2.289e-01]
a-cold-wall:  50%|####9     | 1490/3000 [41:43<37:26,  1.49s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  50%|####9     | 1490/3000 [41:43<37:26,  1.49s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  50%|####9     | 1491/3000 [41:43<36:30,  1.45s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  50%|####9     | 1491/3000 [41:43<36:30,  1.45s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  50%|####9     | 1491/3000 [41:45<36:30,  1.45s/it, lr: 1.0e-04 loss: 5.003e-01]
a-cold-wall:  50%|####9     | 1491/3000 [41:45<36:30,  1.45s/it, lr: 1.0e-04 loss: 5.003e-01]
a-cold-wall:  50%|####9     | 1492/3000 [41:45<45:06,  1.79s/it, lr: 1.0e-04 loss: 5.003e-01]
a-cold-wall:  50%|####9     | 1492/3000 [41:45<45:06,  1.79s/it, lr: 1.0e-04 loss: 5.003e-01]
a-cold-wall:  50%|####9     | 1492/3000 [41:47<45:06,  1.79s/it, lr: 1.0e-04 loss: 8.436e-02]
a-cold-wall:  50%|####9     | 1492/3000 [41:47<45:06,  1.79s/it, lr: 1.0e-04 loss: 8.436e-02]
a-cold-wall:  50%|####9     | 1493/3000 [41:47<42:28,  1.69s/it, lr: 1.0e-04 loss: 8.436e-02]
a-cold-wall:  50%|####9     | 1493/3000 [41:47<42:28,  1.69s/it, lr: 1.0e-04 loss: 8.436e-02]
a-cold-wall:  50%|####9     | 1493/3000 [41:48<42:28,  1.69s/it, lr: 1.0e-04 loss: 4.561e-01]
a-cold-wall:  50%|####9     | 1493/3000 [41:48<42:28,  1.69s/it, lr: 1.0e-04 loss: 4.561e-01]
a-cold-wall:  50%|####9     | 1494/3000 [41:48<37:36,  1.50s/it, lr: 1.0e-04 loss: 4.561e-01]
a-cold-wall:  50%|####9     | 1494/3000 [41:48<37:36,  1.50s/it, lr: 1.0e-04 loss: 4.561e-01]
a-cold-wall:  50%|####9     | 1494/3000 [41:51<37:36,  1.50s/it, lr: 1.0e-04 loss: 3.335e-01]
a-cold-wall:  50%|####9     | 1494/3000 [41:51<37:36,  1.50s/it, lr: 1.0e-04 loss: 3.335e-01]
a-cold-wall:  50%|####9     | 1495/3000 [41:51<46:53,  1.87s/it, lr: 1.0e-04 loss: 3.335e-01]
a-cold-wall:  50%|####9     | 1495/3000 [41:51<46:53,  1.87s/it, lr: 1.0e-04 loss: 3.335e-01]
a-cold-wall:  50%|####9     | 1495/3000 [41:53<46:53,  1.87s/it, lr: 1.0e-04 loss: 3.258e-01]
a-cold-wall:  50%|####9     | 1495/3000 [41:53<46:53,  1.87s/it, lr: 1.0e-04 loss: 3.258e-01]
a-cold-wall:  50%|####9     | 1496/3000 [41:53<53:37,  2.14s/it, lr: 1.0e-04 loss: 3.258e-01]
a-cold-wall:  50%|####9     | 1496/3000 [41:53<53:37,  2.14s/it, lr: 1.0e-04 loss: 3.258e-01]
a-cold-wall:  50%|####9     | 1496/3000 [41:55<53:37,  2.14s/it, lr: 1.0e-04 loss: 7.047e-01]
a-cold-wall:  50%|####9     | 1496/3000 [41:55<53:37,  2.14s/it, lr: 1.0e-04 loss: 7.047e-01]
a-cold-wall:  50%|####9     | 1497/3000 [41:55<48:13,  1.93s/it, lr: 1.0e-04 loss: 7.047e-01]
a-cold-wall:  50%|####9     | 1497/3000 [41:55<48:13,  1.93s/it, lr: 1.0e-04 loss: 7.047e-01]
a-cold-wall:  50%|####9     | 1497/3000 [41:56<48:13,  1.93s/it, lr: 1.0e-04 loss: 6.753e-01]
a-cold-wall:  50%|####9     | 1497/3000 [41:56<48:13,  1.93s/it, lr: 1.0e-04 loss: 6.753e-01]
a-cold-wall:  50%|####9     | 1498/3000 [41:56<39:33,  1.58s/it, lr: 1.0e-04 loss: 6.753e-01]
a-cold-wall:  50%|####9     | 1498/3000 [41:56<39:33,  1.58s/it, lr: 1.0e-04 loss: 6.753e-01]
a-cold-wall:  50%|####9     | 1498/3000 [41:57<39:33,  1.58s/it, lr: 1.0e-04 loss: 7.434e-01]
a-cold-wall:  50%|####9     | 1498/3000 [41:57<39:33,  1.58s/it, lr: 1.0e-04 loss: 7.434e-01]
a-cold-wall:  50%|####9     | 1499/3000 [41:57<38:10,  1.53s/it, lr: 1.0e-04 loss: 7.434e-01]
a-cold-wall:  50%|####9     | 1499/3000 [41:57<38:10,  1.53s/it, lr: 1.0e-04 loss: 7.434e-01]
a-cold-wall:  50%|####9     | 1499/3000 [41:58<38:10,  1.53s/it, lr: 1.0e-04 loss: 2.534e-01]
a-cold-wall:  50%|####9     | 1499/3000 [41:58<38:10,  1.53s/it, lr: 1.0e-04 loss: 2.534e-01]
Saving at step 1500
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000001500.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000000500.safetensors

a-cold-wall:  50%|#####     | 1500/3000 [41:59<38:09,  1.53s/it, lr: 1.0e-04 loss: 4.913e-01]
a-cold-wall:  50%|#####     | 1500/3000 [41:59<38:09,  1.53s/it, lr: 1.0e-04 loss: 4.913e-01]
a-cold-wall:  50%|#####     | 1501/3000 [41:59<29:59,  1.20s/it, lr: 1.0e-04 loss: 4.913e-01]
a-cold-wall:  50%|#####     | 1501/3000 [41:59<29:59,  1.20s/it, lr: 1.0e-04 loss: 4.913e-01]
a-cold-wall:  50%|#####     | 1501/3000 [42:02<29:59,  1.20s/it, lr: 1.0e-04 loss: 5.591e-01]
a-cold-wall:  50%|#####     | 1501/3000 [42:02<29:59,  1.20s/it, lr: 1.0e-04 loss: 5.591e-01]
a-cold-wall:  50%|#####     | 1502/3000 [42:02<40:04,  1.61s/it, lr: 1.0e-04 loss: 5.591e-01]
a-cold-wall:  50%|#####     | 1502/3000 [42:02<40:04,  1.61s/it, lr: 1.0e-04 loss: 5.591e-01]
a-cold-wall:  50%|#####     | 1502/3000 [42:03<40:04,  1.61s/it, lr: 1.0e-04 loss: 4.243e-01]
a-cold-wall:  50%|#####     | 1502/3000 [42:03<40:04,  1.61s/it, lr: 1.0e-04 loss: 4.243e-01]
a-cold-wall:  50%|#####     | 1503/3000 [42:03<34:24,  1.38s/it, lr: 1.0e-04 loss: 4.243e-01]
a-cold-wall:  50%|#####     | 1503/3000 [42:03<34:24,  1.38s/it, lr: 1.0e-04 loss: 4.243e-01]
a-cold-wall:  50%|#####     | 1503/3000 [42:04<34:24,  1.38s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  50%|#####     | 1503/3000 [42:04<34:24,  1.38s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  50%|#####     | 1504/3000 [42:04<30:04,  1.21s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  50%|#####     | 1504/3000 [42:04<30:04,  1.21s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  50%|#####     | 1504/3000 [42:05<30:04,  1.21s/it, lr: 1.0e-04 loss: 4.570e-01]
a-cold-wall:  50%|#####     | 1504/3000 [42:05<30:04,  1.21s/it, lr: 1.0e-04 loss: 4.570e-01]
a-cold-wall:  50%|#####     | 1505/3000 [42:05<31:27,  1.26s/it, lr: 1.0e-04 loss: 4.570e-01]
a-cold-wall:  50%|#####     | 1505/3000 [42:05<31:27,  1.26s/it, lr: 1.0e-04 loss: 4.570e-01]
a-cold-wall:  50%|#####     | 1505/3000 [42:06<31:27,  1.26s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  50%|#####     | 1505/3000 [42:06<31:27,  1.26s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  50%|#####     | 1506/3000 [42:06<27:36,  1.11s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  50%|#####     | 1506/3000 [42:06<27:36,  1.11s/it, lr: 1.0e-04 loss: 7.482e-01]
a-cold-wall:  50%|#####     | 1506/3000 [42:07<27:36,  1.11s/it, lr: 1.0e-04 loss: 6.094e-01]
a-cold-wall:  50%|#####     | 1506/3000 [42:07<27:36,  1.11s/it, lr: 1.0e-04 loss: 6.094e-01]
a-cold-wall:  50%|#####     | 1507/3000 [42:07<24:49,  1.00it/s, lr: 1.0e-04 loss: 6.094e-01]
a-cold-wall:  50%|#####     | 1507/3000 [42:07<24:49,  1.00it/s, lr: 1.0e-04 loss: 6.094e-01]
a-cold-wall:  50%|#####     | 1507/3000 [42:08<24:49,  1.00it/s, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  50%|#####     | 1507/3000 [42:08<24:49,  1.00it/s, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  50%|#####     | 1508/3000 [42:08<27:28,  1.10s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  50%|#####     | 1508/3000 [42:08<27:28,  1.10s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  50%|#####     | 1508/3000 [42:09<27:28,  1.10s/it, lr: 1.0e-04 loss: 5.044e-01]
a-cold-wall:  50%|#####     | 1508/3000 [42:09<27:28,  1.10s/it, lr: 1.0e-04 loss: 5.044e-01]
a-cold-wall:  50%|#####     | 1509/3000 [42:09<29:20,  1.18s/it, lr: 1.0e-04 loss: 5.044e-01]
a-cold-wall:  50%|#####     | 1509/3000 [42:09<29:20,  1.18s/it, lr: 1.0e-04 loss: 5.044e-01]
a-cold-wall:  50%|#####     | 1509/3000 [42:11<29:20,  1.18s/it, lr: 1.0e-04 loss: 5.912e-01]
a-cold-wall:  50%|#####     | 1509/3000 [42:11<29:20,  1.18s/it, lr: 1.0e-04 loss: 5.912e-01]
a-cold-wall:  50%|#####     | 1510/3000 [42:11<29:19,  1.18s/it, lr: 1.0e-04 loss: 2.444e-01]
a-cold-wall:  50%|#####     | 1510/3000 [42:11<29:19,  1.18s/it, lr: 1.0e-04 loss: 2.444e-01]
a-cold-wall:  50%|#####     | 1511/3000 [42:11<20:04,  1.24it/s, lr: 1.0e-04 loss: 2.444e-01]
a-cold-wall:  50%|#####     | 1511/3000 [42:11<20:04,  1.24it/s, lr: 1.0e-04 loss: 2.444e-01]
a-cold-wall:  50%|#####     | 1511/3000 [42:14<20:04,  1.24it/s, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  50%|#####     | 1511/3000 [42:14<20:04,  1.24it/s, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  50%|#####     | 1512/3000 [42:14<32:19,  1.30s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  50%|#####     | 1512/3000 [42:14<32:19,  1.30s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  50%|#####     | 1512/3000 [42:16<32:19,  1.30s/it, lr: 1.0e-04 loss: 2.119e-02]
a-cold-wall:  50%|#####     | 1512/3000 [42:16<32:19,  1.30s/it, lr: 1.0e-04 loss: 2.119e-02]
a-cold-wall:  50%|#####     | 1513/3000 [42:16<33:46,  1.36s/it, lr: 1.0e-04 loss: 2.119e-02]
a-cold-wall:  50%|#####     | 1513/3000 [42:16<33:46,  1.36s/it, lr: 1.0e-04 loss: 2.119e-02]
a-cold-wall:  50%|#####     | 1513/3000 [42:19<33:46,  1.36s/it, lr: 1.0e-04 loss: 1.503e-02]
a-cold-wall:  50%|#####     | 1513/3000 [42:19<33:46,  1.36s/it, lr: 1.0e-04 loss: 1.503e-02]
a-cold-wall:  50%|#####     | 1514/3000 [42:19<43:47,  1.77s/it, lr: 1.0e-04 loss: 1.503e-02]
a-cold-wall:  50%|#####     | 1514/3000 [42:19<43:47,  1.77s/it, lr: 1.0e-04 loss: 1.503e-02]
a-cold-wall:  50%|#####     | 1514/3000 [42:21<43:47,  1.77s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  50%|#####     | 1514/3000 [42:21<43:47,  1.77s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  50%|#####     | 1515/3000 [42:21<51:15,  2.07s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  50%|#####     | 1515/3000 [42:21<51:15,  2.07s/it, lr: 1.0e-04 loss: 2.003e-01]
a-cold-wall:  50%|#####     | 1515/3000 [42:22<51:15,  2.07s/it, lr: 1.0e-04 loss: 6.247e-01]
a-cold-wall:  50%|#####     | 1515/3000 [42:22<51:15,  2.07s/it, lr: 1.0e-04 loss: 6.247e-01]
a-cold-wall:  51%|#####     | 1516/3000 [42:22<41:48,  1.69s/it, lr: 1.0e-04 loss: 6.247e-01]
a-cold-wall:  51%|#####     | 1516/3000 [42:22<41:48,  1.69s/it, lr: 1.0e-04 loss: 6.247e-01]
a-cold-wall:  51%|#####     | 1516/3000 [42:24<41:48,  1.69s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:  51%|#####     | 1516/3000 [42:24<41:48,  1.69s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:  51%|#####     | 1517/3000 [42:24<39:54,  1.61s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:  51%|#####     | 1517/3000 [42:24<39:54,  1.61s/it, lr: 1.0e-04 loss: 1.240e-01]
a-cold-wall:  51%|#####     | 1517/3000 [42:24<39:54,  1.61s/it, lr: 1.0e-04 loss: 6.177e-01]
a-cold-wall:  51%|#####     | 1517/3000 [42:24<39:54,  1.61s/it, lr: 1.0e-04 loss: 6.177e-01]
a-cold-wall:  51%|#####     | 1518/3000 [42:24<33:35,  1.36s/it, lr: 1.0e-04 loss: 6.177e-01]
a-cold-wall:  51%|#####     | 1518/3000 [42:24<33:35,  1.36s/it, lr: 1.0e-04 loss: 6.177e-01]
a-cold-wall:  51%|#####     | 1518/3000 [42:25<33:35,  1.36s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:  51%|#####     | 1518/3000 [42:25<33:35,  1.36s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:  51%|#####     | 1519/3000 [42:25<29:40,  1.20s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:  51%|#####     | 1519/3000 [42:25<29:40,  1.20s/it, lr: 1.0e-04 loss: 2.788e-01]
a-cold-wall:  51%|#####     | 1519/3000 [42:27<29:40,  1.20s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  51%|#####     | 1519/3000 [42:27<29:40,  1.20s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  51%|#####     | 1520/3000 [42:29<29:39,  1.20s/it, lr: 1.0e-04 loss: 4.353e-01]
a-cold-wall:  51%|#####     | 1520/3000 [42:29<29:39,  1.20s/it, lr: 1.0e-04 loss: 4.353e-01]
a-cold-wall:  51%|#####     | 1521/3000 [42:29<32:26,  1.32s/it, lr: 1.0e-04 loss: 4.353e-01]
a-cold-wall:  51%|#####     | 1521/3000 [42:29<32:26,  1.32s/it, lr: 1.0e-04 loss: 4.353e-01]
a-cold-wall:  51%|#####     | 1521/3000 [42:30<32:26,  1.32s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  51%|#####     | 1521/3000 [42:30<32:26,  1.32s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  51%|#####     | 1522/3000 [42:30<28:57,  1.18s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  51%|#####     | 1522/3000 [42:30<28:57,  1.18s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  51%|#####     | 1522/3000 [42:32<28:57,  1.18s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  51%|#####     | 1522/3000 [42:32<28:57,  1.18s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  51%|#####     | 1523/3000 [42:32<30:26,  1.24s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  51%|#####     | 1523/3000 [42:32<30:26,  1.24s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  51%|#####     | 1523/3000 [42:32<30:26,  1.24s/it, lr: 1.0e-04 loss: 5.337e-01]
a-cold-wall:  51%|#####     | 1523/3000 [42:32<30:26,  1.24s/it, lr: 1.0e-04 loss: 5.337e-01]
a-cold-wall:  51%|#####     | 1524/3000 [42:32<27:08,  1.10s/it, lr: 1.0e-04 loss: 5.337e-01]
a-cold-wall:  51%|#####     | 1524/3000 [42:32<27:08,  1.10s/it, lr: 1.0e-04 loss: 5.337e-01]
a-cold-wall:  51%|#####     | 1524/3000 [42:35<27:08,  1.10s/it, lr: 1.0e-04 loss: 3.790e-01]
a-cold-wall:  51%|#####     | 1524/3000 [42:35<27:08,  1.10s/it, lr: 1.0e-04 loss: 3.790e-01]
a-cold-wall:  51%|#####     | 1525/3000 [42:35<39:07,  1.59s/it, lr: 1.0e-04 loss: 3.790e-01]
a-cold-wall:  51%|#####     | 1525/3000 [42:35<39:07,  1.59s/it, lr: 1.0e-04 loss: 3.790e-01]
a-cold-wall:  51%|#####     | 1525/3000 [42:37<39:07,  1.59s/it, lr: 1.0e-04 loss: 4.307e-01]
a-cold-wall:  51%|#####     | 1525/3000 [42:37<39:07,  1.59s/it, lr: 1.0e-04 loss: 4.307e-01]
a-cold-wall:  51%|#####     | 1526/3000 [42:37<37:49,  1.54s/it, lr: 1.0e-04 loss: 4.307e-01]
a-cold-wall:  51%|#####     | 1526/3000 [42:37<37:49,  1.54s/it, lr: 1.0e-04 loss: 4.307e-01]
a-cold-wall:  51%|#####     | 1526/3000 [42:37<37:49,  1.54s/it, lr: 1.0e-04 loss: 4.745e-01]
a-cold-wall:  51%|#####     | 1526/3000 [42:37<37:49,  1.54s/it, lr: 1.0e-04 loss: 4.745e-01]
a-cold-wall:  51%|#####     | 1527/3000 [42:37<32:07,  1.31s/it, lr: 1.0e-04 loss: 4.745e-01]
a-cold-wall:  51%|#####     | 1527/3000 [42:37<32:07,  1.31s/it, lr: 1.0e-04 loss: 4.745e-01]
a-cold-wall:  51%|#####     | 1527/3000 [42:39<32:07,  1.31s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  51%|#####     | 1527/3000 [42:39<32:07,  1.31s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  51%|#####     | 1528/3000 [42:39<34:00,  1.39s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  51%|#####     | 1528/3000 [42:39<34:00,  1.39s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  51%|#####     | 1528/3000 [42:40<34:00,  1.39s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  51%|#####     | 1528/3000 [42:40<34:00,  1.39s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  51%|#####     | 1529/3000 [42:40<29:17,  1.19s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  51%|#####     | 1529/3000 [42:40<29:17,  1.19s/it, lr: 1.0e-04 loss: 3.371e-01]
a-cold-wall:  51%|#####     | 1529/3000 [42:40<29:17,  1.19s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  51%|#####     | 1529/3000 [42:40<29:17,  1.19s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  51%|#####1    | 1530/3000 [42:42<29:16,  1.19s/it, lr: 1.0e-04 loss: 3.995e-01]
a-cold-wall:  51%|#####1    | 1530/3000 [42:42<29:16,  1.19s/it, lr: 1.0e-04 loss: 3.995e-01]
a-cold-wall:  51%|#####1    | 1531/3000 [42:42<23:53,  1.02it/s, lr: 1.0e-04 loss: 3.995e-01]
a-cold-wall:  51%|#####1    | 1531/3000 [42:42<23:53,  1.02it/s, lr: 1.0e-04 loss: 3.995e-01]
a-cold-wall:  51%|#####1    | 1531/3000 [42:45<23:53,  1.02it/s, lr: 1.0e-04 loss: 4.225e-01]
a-cold-wall:  51%|#####1    | 1531/3000 [42:45<23:53,  1.02it/s, lr: 1.0e-04 loss: 4.225e-01]
a-cold-wall:  51%|#####1    | 1532/3000 [42:45<35:12,  1.44s/it, lr: 1.0e-04 loss: 4.225e-01]
a-cold-wall:  51%|#####1    | 1532/3000 [42:45<35:12,  1.44s/it, lr: 1.0e-04 loss: 4.225e-01]
a-cold-wall:  51%|#####1    | 1532/3000 [42:46<35:12,  1.44s/it, lr: 1.0e-04 loss: 4.731e-01]
a-cold-wall:  51%|#####1    | 1532/3000 [42:46<35:12,  1.44s/it, lr: 1.0e-04 loss: 4.731e-01]
a-cold-wall:  51%|#####1    | 1533/3000 [42:46<30:47,  1.26s/it, lr: 1.0e-04 loss: 4.731e-01]
a-cold-wall:  51%|#####1    | 1533/3000 [42:46<30:47,  1.26s/it, lr: 1.0e-04 loss: 4.731e-01]
a-cold-wall:  51%|#####1    | 1533/3000 [42:46<30:47,  1.26s/it, lr: 1.0e-04 loss: 4.404e-01]
a-cold-wall:  51%|#####1    | 1533/3000 [42:46<30:47,  1.26s/it, lr: 1.0e-04 loss: 4.404e-01]
a-cold-wall:  51%|#####1    | 1534/3000 [42:46<27:27,  1.12s/it, lr: 1.0e-04 loss: 4.404e-01]
a-cold-wall:  51%|#####1    | 1534/3000 [42:46<27:27,  1.12s/it, lr: 1.0e-04 loss: 4.404e-01]
a-cold-wall:  51%|#####1    | 1534/3000 [42:49<27:27,  1.12s/it, lr: 1.0e-04 loss: 1.968e-01]
a-cold-wall:  51%|#####1    | 1534/3000 [42:49<27:27,  1.12s/it, lr: 1.0e-04 loss: 1.968e-01]
a-cold-wall:  51%|#####1    | 1535/3000 [42:49<39:03,  1.60s/it, lr: 1.0e-04 loss: 1.968e-01]
a-cold-wall:  51%|#####1    | 1535/3000 [42:49<39:03,  1.60s/it, lr: 1.0e-04 loss: 1.968e-01]
a-cold-wall:  51%|#####1    | 1535/3000 [42:52<39:03,  1.60s/it, lr: 1.0e-04 loss: 2.748e-01]
a-cold-wall:  51%|#####1    | 1535/3000 [42:52<39:03,  1.60s/it, lr: 1.0e-04 loss: 2.748e-01]
a-cold-wall:  51%|#####1    | 1536/3000 [42:52<47:48,  1.96s/it, lr: 1.0e-04 loss: 2.748e-01]
a-cold-wall:  51%|#####1    | 1536/3000 [42:52<47:48,  1.96s/it, lr: 1.0e-04 loss: 2.748e-01]
a-cold-wall:  51%|#####1    | 1536/3000 [42:55<47:48,  1.96s/it, lr: 1.0e-04 loss: 1.602e-01]
a-cold-wall:  51%|#####1    | 1536/3000 [42:55<47:48,  1.96s/it, lr: 1.0e-04 loss: 1.602e-01]
a-cold-wall:  51%|#####1    | 1537/3000 [42:55<53:55,  2.21s/it, lr: 1.0e-04 loss: 1.602e-01]
a-cold-wall:  51%|#####1    | 1537/3000 [42:55<53:55,  2.21s/it, lr: 1.0e-04 loss: 1.602e-01]
a-cold-wall:  51%|#####1    | 1537/3000 [42:56<53:55,  2.21s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  51%|#####1    | 1537/3000 [42:56<53:55,  2.21s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  51%|#####1    | 1538/3000 [42:56<48:07,  1.97s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  51%|#####1    | 1538/3000 [42:56<48:07,  1.97s/it, lr: 1.0e-04 loss: 5.401e-01]
a-cold-wall:  51%|#####1    | 1538/3000 [42:57<48:07,  1.97s/it, lr: 1.0e-04 loss: 5.575e-01]
a-cold-wall:  51%|#####1    | 1538/3000 [42:57<48:07,  1.97s/it, lr: 1.0e-04 loss: 5.575e-01]
a-cold-wall:  51%|#####1    | 1539/3000 [42:57<39:10,  1.61s/it, lr: 1.0e-04 loss: 5.575e-01]
a-cold-wall:  51%|#####1    | 1539/3000 [42:57<39:10,  1.61s/it, lr: 1.0e-04 loss: 5.575e-01]
a-cold-wall:  51%|#####1    | 1539/3000 [42:58<39:10,  1.61s/it, lr: 1.0e-04 loss: 1.806e-01]
a-cold-wall:  51%|#####1    | 1539/3000 [42:58<39:10,  1.61s/it, lr: 1.0e-04 loss: 1.806e-01]
a-cold-wall:  51%|#####1    | 1540/3000 [43:01<39:09,  1.61s/it, lr: 1.0e-04 loss: 4.057e-01]
a-cold-wall:  51%|#####1    | 1540/3000 [43:01<39:09,  1.61s/it, lr: 1.0e-04 loss: 4.057e-01]
a-cold-wall:  51%|#####1    | 1541/3000 [43:01<36:59,  1.52s/it, lr: 1.0e-04 loss: 4.057e-01]
a-cold-wall:  51%|#####1    | 1541/3000 [43:01<36:59,  1.52s/it, lr: 1.0e-04 loss: 4.057e-01]
a-cold-wall:  51%|#####1    | 1541/3000 [43:04<36:59,  1.52s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  51%|#####1    | 1541/3000 [43:04<36:59,  1.52s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  51%|#####1    | 1542/3000 [43:04<45:52,  1.89s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  51%|#####1    | 1542/3000 [43:04<45:52,  1.89s/it, lr: 1.0e-04 loss: 6.201e-01]
a-cold-wall:  51%|#####1    | 1542/3000 [43:05<45:52,  1.89s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  51%|#####1    | 1542/3000 [43:05<45:52,  1.89s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  51%|#####1    | 1543/3000 [43:05<38:34,  1.59s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  51%|#####1    | 1543/3000 [43:05<38:34,  1.59s/it, lr: 1.0e-04 loss: 2.056e-01]
a-cold-wall:  51%|#####1    | 1543/3000 [43:08<38:34,  1.59s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  51%|#####1    | 1543/3000 [43:08<38:34,  1.59s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  51%|#####1    | 1544/3000 [43:08<47:00,  1.94s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  51%|#####1    | 1544/3000 [43:08<47:00,  1.94s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  51%|#####1    | 1544/3000 [43:11<47:00,  1.94s/it, lr: 1.0e-04 loss: 1.424e-01]
a-cold-wall:  51%|#####1    | 1544/3000 [43:11<47:00,  1.94s/it, lr: 1.0e-04 loss: 1.424e-01]
a-cold-wall:  52%|#####1    | 1545/3000 [43:11<53:20,  2.20s/it, lr: 1.0e-04 loss: 1.424e-01]
a-cold-wall:  52%|#####1    | 1545/3000 [43:11<53:20,  2.20s/it, lr: 1.0e-04 loss: 1.424e-01]
a-cold-wall:  52%|#####1    | 1545/3000 [43:11<53:20,  2.20s/it, lr: 1.0e-04 loss: 3.722e-01]
a-cold-wall:  52%|#####1    | 1545/3000 [43:11<53:20,  2.20s/it, lr: 1.0e-04 loss: 3.722e-01]
a-cold-wall:  52%|#####1    | 1546/3000 [43:11<43:21,  1.79s/it, lr: 1.0e-04 loss: 3.722e-01]
a-cold-wall:  52%|#####1    | 1546/3000 [43:11<43:21,  1.79s/it, lr: 1.0e-04 loss: 3.722e-01]
a-cold-wall:  52%|#####1    | 1546/3000 [43:13<43:21,  1.79s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  52%|#####1    | 1546/3000 [43:13<43:21,  1.79s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  52%|#####1    | 1547/3000 [43:13<40:41,  1.68s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  52%|#####1    | 1547/3000 [43:13<40:41,  1.68s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  52%|#####1    | 1547/3000 [43:14<40:41,  1.68s/it, lr: 1.0e-04 loss: 6.186e-01]
a-cold-wall:  52%|#####1    | 1547/3000 [43:14<40:41,  1.68s/it, lr: 1.0e-04 loss: 6.186e-01]
a-cold-wall:  52%|#####1    | 1548/3000 [43:14<38:47,  1.60s/it, lr: 1.0e-04 loss: 6.186e-01]
a-cold-wall:  52%|#####1    | 1548/3000 [43:14<38:47,  1.60s/it, lr: 1.0e-04 loss: 6.186e-01]
a-cold-wall:  52%|#####1    | 1548/3000 [43:17<38:47,  1.60s/it, lr: 1.0e-04 loss: 5.139e-02]
a-cold-wall:  52%|#####1    | 1548/3000 [43:17<38:47,  1.60s/it, lr: 1.0e-04 loss: 5.139e-02]
a-cold-wall:  52%|#####1    | 1549/3000 [43:17<47:44,  1.97s/it, lr: 1.0e-04 loss: 5.139e-02]
a-cold-wall:  52%|#####1    | 1549/3000 [43:17<47:44,  1.97s/it, lr: 1.0e-04 loss: 5.139e-02]
a-cold-wall:  52%|#####1    | 1549/3000 [43:20<47:44,  1.97s/it, lr: 1.0e-04 loss: 4.601e-01]
a-cold-wall:  52%|#####1    | 1549/3000 [43:20<47:44,  1.97s/it, lr: 1.0e-04 loss: 4.601e-01]
a-cold-wall:  52%|#####1    | 1550/3000 [43:21<47:42,  1.97s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  52%|#####1    | 1550/3000 [43:21<47:42,  1.97s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  52%|#####1    | 1551/3000 [43:21<31:17,  1.30s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  52%|#####1    | 1551/3000 [43:21<31:17,  1.30s/it, lr: 1.0e-04 loss: 6.053e-01]
a-cold-wall:  52%|#####1    | 1551/3000 [43:22<31:17,  1.30s/it, lr: 1.0e-04 loss: 5.825e-01]
a-cold-wall:  52%|#####1    | 1551/3000 [43:22<31:17,  1.30s/it, lr: 1.0e-04 loss: 5.825e-01]
a-cold-wall:  52%|#####1    | 1552/3000 [43:22<32:06,  1.33s/it, lr: 1.0e-04 loss: 5.825e-01]
a-cold-wall:  52%|#####1    | 1552/3000 [43:22<32:06,  1.33s/it, lr: 1.0e-04 loss: 5.825e-01]
a-cold-wall:  52%|#####1    | 1552/3000 [43:23<32:06,  1.33s/it, lr: 1.0e-04 loss: 4.362e-02]
a-cold-wall:  52%|#####1    | 1552/3000 [43:23<32:06,  1.33s/it, lr: 1.0e-04 loss: 4.362e-02]
a-cold-wall:  52%|#####1    | 1553/3000 [43:23<28:28,  1.18s/it, lr: 1.0e-04 loss: 4.362e-02]
a-cold-wall:  52%|#####1    | 1553/3000 [43:23<28:28,  1.18s/it, lr: 1.0e-04 loss: 4.362e-02]
a-cold-wall:  52%|#####1    | 1553/3000 [43:26<28:28,  1.18s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:  52%|#####1    | 1553/3000 [43:26<28:28,  1.18s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:  52%|#####1    | 1554/3000 [43:26<39:45,  1.65s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:  52%|#####1    | 1554/3000 [43:26<39:45,  1.65s/it, lr: 1.0e-04 loss: 6.242e-01]
a-cold-wall:  52%|#####1    | 1554/3000 [43:29<39:45,  1.65s/it, lr: 1.0e-04 loss: 4.593e-01]
a-cold-wall:  52%|#####1    | 1554/3000 [43:29<39:45,  1.65s/it, lr: 1.0e-04 loss: 4.593e-01]
a-cold-wall:  52%|#####1    | 1555/3000 [43:29<49:40,  2.06s/it, lr: 1.0e-04 loss: 4.593e-01]
a-cold-wall:  52%|#####1    | 1555/3000 [43:29<49:40,  2.06s/it, lr: 1.0e-04 loss: 4.593e-01]
a-cold-wall:  52%|#####1    | 1555/3000 [43:31<49:40,  2.06s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  52%|#####1    | 1555/3000 [43:31<49:40,  2.06s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  52%|#####1    | 1556/3000 [43:31<45:17,  1.88s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  52%|#####1    | 1556/3000 [43:31<45:17,  1.88s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  52%|#####1    | 1556/3000 [43:31<45:17,  1.88s/it, lr: 1.0e-04 loss: 3.324e-01]
a-cold-wall:  52%|#####1    | 1556/3000 [43:31<45:17,  1.88s/it, lr: 1.0e-04 loss: 3.324e-01]
a-cold-wall:  52%|#####1    | 1557/3000 [43:31<37:21,  1.55s/it, lr: 1.0e-04 loss: 3.324e-01]
a-cold-wall:  52%|#####1    | 1557/3000 [43:31<37:21,  1.55s/it, lr: 1.0e-04 loss: 3.324e-01]
a-cold-wall:  52%|#####1    | 1557/3000 [43:33<37:21,  1.55s/it, lr: 1.0e-04 loss: 1.549e-01]
a-cold-wall:  52%|#####1    | 1557/3000 [43:33<37:21,  1.55s/it, lr: 1.0e-04 loss: 1.549e-01]
a-cold-wall:  52%|#####1    | 1558/3000 [43:33<36:34,  1.52s/it, lr: 1.0e-04 loss: 1.549e-01]
a-cold-wall:  52%|#####1    | 1558/3000 [43:33<36:34,  1.52s/it, lr: 1.0e-04 loss: 1.549e-01]
a-cold-wall:  52%|#####1    | 1558/3000 [43:34<36:34,  1.52s/it, lr: 1.0e-04 loss: 3.816e-02]
a-cold-wall:  52%|#####1    | 1558/3000 [43:34<36:34,  1.52s/it, lr: 1.0e-04 loss: 3.816e-02]
a-cold-wall:  52%|#####1    | 1559/3000 [43:34<35:59,  1.50s/it, lr: 1.0e-04 loss: 3.816e-02]
a-cold-wall:  52%|#####1    | 1559/3000 [43:34<35:59,  1.50s/it, lr: 1.0e-04 loss: 3.816e-02]
a-cold-wall:  52%|#####1    | 1559/3000 [43:37<35:59,  1.50s/it, lr: 1.0e-04 loss: 4.272e-01]
a-cold-wall:  52%|#####1    | 1559/3000 [43:37<35:59,  1.50s/it, lr: 1.0e-04 loss: 4.272e-01]
a-cold-wall:  52%|#####2    | 1560/3000 [43:38<35:57,  1.50s/it, lr: 1.0e-04 loss: 5.819e-02]
a-cold-wall:  52%|#####2    | 1560/3000 [43:38<35:57,  1.50s/it, lr: 1.0e-04 loss: 5.819e-02]
a-cold-wall:  52%|#####2    | 1561/3000 [43:38<23:36,  1.02it/s, lr: 1.0e-04 loss: 5.819e-02]
a-cold-wall:  52%|#####2    | 1561/3000 [43:38<23:36,  1.02it/s, lr: 1.0e-04 loss: 5.819e-02]
a-cold-wall:  52%|#####2    | 1561/3000 [43:41<23:36,  1.02it/s, lr: 1.0e-04 loss: 4.704e-01]
a-cold-wall:  52%|#####2    | 1561/3000 [43:41<23:36,  1.02it/s, lr: 1.0e-04 loss: 4.704e-01]
a-cold-wall:  52%|#####2    | 1562/3000 [43:41<34:58,  1.46s/it, lr: 1.0e-04 loss: 4.704e-01]
a-cold-wall:  52%|#####2    | 1562/3000 [43:41<34:58,  1.46s/it, lr: 1.0e-04 loss: 4.704e-01]
a-cold-wall:  52%|#####2    | 1562/3000 [43:42<34:58,  1.46s/it, lr: 1.0e-04 loss: 2.469e-01]
a-cold-wall:  52%|#####2    | 1562/3000 [43:42<34:58,  1.46s/it, lr: 1.0e-04 loss: 2.469e-01]
a-cold-wall:  52%|#####2    | 1563/3000 [43:42<34:28,  1.44s/it, lr: 1.0e-04 loss: 2.469e-01]
a-cold-wall:  52%|#####2    | 1563/3000 [43:42<34:28,  1.44s/it, lr: 1.0e-04 loss: 2.469e-01]
a-cold-wall:  52%|#####2    | 1563/3000 [43:45<34:28,  1.44s/it, lr: 1.0e-04 loss: 4.296e-01]
a-cold-wall:  52%|#####2    | 1563/3000 [43:45<34:28,  1.44s/it, lr: 1.0e-04 loss: 4.296e-01]
a-cold-wall:  52%|#####2    | 1564/3000 [43:45<43:56,  1.84s/it, lr: 1.0e-04 loss: 4.296e-01]
a-cold-wall:  52%|#####2    | 1564/3000 [43:45<43:56,  1.84s/it, lr: 1.0e-04 loss: 4.296e-01]
a-cold-wall:  52%|#####2    | 1564/3000 [43:47<43:56,  1.84s/it, lr: 1.0e-04 loss: 7.541e-01]
a-cold-wall:  52%|#####2    | 1564/3000 [43:47<43:56,  1.84s/it, lr: 1.0e-04 loss: 7.541e-01]
a-cold-wall:  52%|#####2    | 1565/3000 [43:47<41:09,  1.72s/it, lr: 1.0e-04 loss: 7.541e-01]
a-cold-wall:  52%|#####2    | 1565/3000 [43:47<41:09,  1.72s/it, lr: 1.0e-04 loss: 7.541e-01]
a-cold-wall:  52%|#####2    | 1565/3000 [43:49<41:09,  1.72s/it, lr: 1.0e-04 loss: 1.329e-01]
a-cold-wall:  52%|#####2    | 1565/3000 [43:49<41:09,  1.72s/it, lr: 1.0e-04 loss: 1.329e-01]
a-cold-wall:  52%|#####2    | 1566/3000 [43:49<48:49,  2.04s/it, lr: 1.0e-04 loss: 1.329e-01]
a-cold-wall:  52%|#####2    | 1566/3000 [43:49<48:49,  2.04s/it, lr: 1.0e-04 loss: 1.329e-01]
a-cold-wall:  52%|#####2    | 1566/3000 [43:52<48:49,  2.04s/it, lr: 1.0e-04 loss: 2.246e-01]
a-cold-wall:  52%|#####2    | 1566/3000 [43:52<48:49,  2.04s/it, lr: 1.0e-04 loss: 2.246e-01]
a-cold-wall:  52%|#####2    | 1567/3000 [43:52<54:17,  2.27s/it, lr: 1.0e-04 loss: 2.246e-01]
a-cold-wall:  52%|#####2    | 1567/3000 [43:52<54:17,  2.27s/it, lr: 1.0e-04 loss: 2.246e-01]
a-cold-wall:  52%|#####2    | 1567/3000 [43:53<54:17,  2.27s/it, lr: 1.0e-04 loss: 4.606e-01]
a-cold-wall:  52%|#####2    | 1567/3000 [43:53<54:17,  2.27s/it, lr: 1.0e-04 loss: 4.606e-01]
a-cold-wall:  52%|#####2    | 1568/3000 [43:53<45:17,  1.90s/it, lr: 1.0e-04 loss: 4.606e-01]
a-cold-wall:  52%|#####2    | 1568/3000 [43:53<45:17,  1.90s/it, lr: 1.0e-04 loss: 4.606e-01]
a-cold-wall:  52%|#####2    | 1568/3000 [43:56<45:17,  1.90s/it, lr: 1.0e-04 loss: 4.527e-01]
a-cold-wall:  52%|#####2    | 1568/3000 [43:56<45:17,  1.90s/it, lr: 1.0e-04 loss: 4.527e-01]
a-cold-wall:  52%|#####2    | 1569/3000 [43:56<52:08,  2.19s/it, lr: 1.0e-04 loss: 4.527e-01]
a-cold-wall:  52%|#####2    | 1569/3000 [43:56<52:08,  2.19s/it, lr: 1.0e-04 loss: 4.527e-01]
a-cold-wall:  52%|#####2    | 1569/3000 [43:58<52:08,  2.19s/it, lr: 1.0e-04 loss: 5.131e-01]
a-cold-wall:  52%|#####2    | 1569/3000 [43:58<52:08,  2.19s/it, lr: 1.0e-04 loss: 5.131e-01]
a-cold-wall:  52%|#####2    | 1570/3000 [43:58<52:06,  2.19s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  52%|#####2    | 1570/3000 [43:58<52:06,  2.19s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  52%|#####2    | 1571/3000 [43:58<32:18,  1.36s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  52%|#####2    | 1571/3000 [43:58<32:18,  1.36s/it, lr: 1.0e-04 loss: 4.185e-01]
a-cold-wall:  52%|#####2    | 1571/3000 [44:00<32:18,  1.36s/it, lr: 1.0e-04 loss: 6.640e-02]
a-cold-wall:  52%|#####2    | 1571/3000 [44:00<32:18,  1.36s/it, lr: 1.0e-04 loss: 6.640e-02]
a-cold-wall:  52%|#####2    | 1572/3000 [44:00<33:20,  1.40s/it, lr: 1.0e-04 loss: 6.640e-02]
a-cold-wall:  52%|#####2    | 1572/3000 [44:00<33:20,  1.40s/it, lr: 1.0e-04 loss: 6.640e-02]
a-cold-wall:  52%|#####2    | 1572/3000 [44:01<33:20,  1.40s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  52%|#####2    | 1572/3000 [44:01<33:20,  1.40s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  52%|#####2    | 1573/3000 [44:01<29:14,  1.23s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  52%|#####2    | 1573/3000 [44:01<29:14,  1.23s/it, lr: 1.0e-04 loss: 4.495e-01]
a-cold-wall:  52%|#####2    | 1573/3000 [44:03<29:14,  1.23s/it, lr: 1.0e-04 loss: 5.490e-01]
a-cold-wall:  52%|#####2    | 1573/3000 [44:03<29:14,  1.23s/it, lr: 1.0e-04 loss: 5.490e-01]
a-cold-wall:  52%|#####2    | 1574/3000 [44:03<39:32,  1.66s/it, lr: 1.0e-04 loss: 5.490e-01]
a-cold-wall:  52%|#####2    | 1574/3000 [44:03<39:32,  1.66s/it, lr: 1.0e-04 loss: 5.490e-01]
a-cold-wall:  52%|#####2    | 1574/3000 [44:05<39:32,  1.66s/it, lr: 1.0e-04 loss: 4.559e-01]
a-cold-wall:  52%|#####2    | 1574/3000 [44:05<39:32,  1.66s/it, lr: 1.0e-04 loss: 4.559e-01]
a-cold-wall:  52%|#####2    | 1575/3000 [44:05<33:58,  1.43s/it, lr: 1.0e-04 loss: 4.559e-01]
a-cold-wall:  52%|#####2    | 1575/3000 [44:05<33:58,  1.43s/it, lr: 1.0e-04 loss: 4.559e-01]
a-cold-wall:  52%|#####2    | 1575/3000 [44:06<33:58,  1.43s/it, lr: 1.0e-04 loss: 4.813e-01]
a-cold-wall:  52%|#####2    | 1575/3000 [44:06<33:58,  1.43s/it, lr: 1.0e-04 loss: 4.813e-01]
a-cold-wall:  53%|#####2    | 1576/3000 [44:06<33:45,  1.42s/it, lr: 1.0e-04 loss: 4.813e-01]
a-cold-wall:  53%|#####2    | 1576/3000 [44:06<33:45,  1.42s/it, lr: 1.0e-04 loss: 4.813e-01]
a-cold-wall:  53%|#####2    | 1576/3000 [44:09<33:45,  1.42s/it, lr: 1.0e-04 loss: 2.630e-01]
a-cold-wall:  53%|#####2    | 1576/3000 [44:09<33:45,  1.42s/it, lr: 1.0e-04 loss: 2.630e-01]
a-cold-wall:  53%|#####2    | 1577/3000 [44:09<43:25,  1.83s/it, lr: 1.0e-04 loss: 2.630e-01]
a-cold-wall:  53%|#####2    | 1577/3000 [44:09<43:25,  1.83s/it, lr: 1.0e-04 loss: 2.630e-01]
a-cold-wall:  53%|#####2    | 1577/3000 [44:12<43:25,  1.83s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  53%|#####2    | 1577/3000 [44:12<43:25,  1.83s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  53%|#####2    | 1578/3000 [44:12<50:19,  2.12s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  53%|#####2    | 1578/3000 [44:12<50:19,  2.12s/it, lr: 1.0e-04 loss: 4.507e-01]
a-cold-wall:  53%|#####2    | 1578/3000 [44:13<50:19,  2.12s/it, lr: 1.0e-04 loss: 2.285e-01]
a-cold-wall:  53%|#####2    | 1578/3000 [44:13<50:19,  2.12s/it, lr: 1.0e-04 loss: 2.285e-01]
a-cold-wall:  53%|#####2    | 1579/3000 [44:13<45:20,  1.91s/it, lr: 1.0e-04 loss: 2.285e-01]
a-cold-wall:  53%|#####2    | 1579/3000 [44:13<45:20,  1.91s/it, lr: 1.0e-04 loss: 2.285e-01]
a-cold-wall:  53%|#####2    | 1579/3000 [44:16<45:20,  1.91s/it, lr: 1.0e-04 loss: 5.679e-02]
a-cold-wall:  53%|#####2    | 1579/3000 [44:16<45:20,  1.91s/it, lr: 1.0e-04 loss: 5.679e-02]
a-cold-wall:  53%|#####2    | 1580/3000 [44:17<45:18,  1.91s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  53%|#####2    | 1580/3000 [44:17<45:18,  1.91s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  53%|#####2    | 1581/3000 [44:17<28:36,  1.21s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  53%|#####2    | 1581/3000 [44:17<28:36,  1.21s/it, lr: 1.0e-04 loss: 6.959e-01]
a-cold-wall:  53%|#####2    | 1581/3000 [44:18<28:36,  1.21s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  53%|#####2    | 1581/3000 [44:18<28:36,  1.21s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  53%|#####2    | 1582/3000 [44:18<29:46,  1.26s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  53%|#####2    | 1582/3000 [44:18<29:46,  1.26s/it, lr: 1.0e-04 loss: 2.263e-01]
a-cold-wall:  53%|#####2    | 1582/3000 [44:21<29:46,  1.26s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:  53%|#####2    | 1582/3000 [44:21<29:46,  1.26s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:  53%|#####2    | 1583/3000 [44:21<40:28,  1.71s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:  53%|#####2    | 1583/3000 [44:21<40:28,  1.71s/it, lr: 1.0e-04 loss: 3.153e-01]
a-cold-wall:  53%|#####2    | 1583/3000 [44:24<40:28,  1.71s/it, lr: 1.0e-04 loss: 4.157e-01]
a-cold-wall:  53%|#####2    | 1583/3000 [44:24<40:28,  1.71s/it, lr: 1.0e-04 loss: 4.157e-01]
a-cold-wall:  53%|#####2    | 1584/3000 [44:24<47:33,  2.02s/it, lr: 1.0e-04 loss: 4.157e-01]
a-cold-wall:  53%|#####2    | 1584/3000 [44:24<47:33,  2.02s/it, lr: 1.0e-04 loss: 4.157e-01]
a-cold-wall:  53%|#####2    | 1584/3000 [44:27<47:33,  2.02s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  53%|#####2    | 1584/3000 [44:27<47:33,  2.02s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  53%|#####2    | 1585/3000 [44:27<52:52,  2.24s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  53%|#####2    | 1585/3000 [44:27<52:52,  2.24s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  53%|#####2    | 1585/3000 [44:28<52:52,  2.24s/it, lr: 1.0e-04 loss: 2.797e-01]
a-cold-wall:  53%|#####2    | 1585/3000 [44:28<52:52,  2.24s/it, lr: 1.0e-04 loss: 2.797e-01]
a-cold-wall:  53%|#####2    | 1586/3000 [44:28<47:17,  2.01s/it, lr: 1.0e-04 loss: 2.797e-01]
a-cold-wall:  53%|#####2    | 1586/3000 [44:28<47:17,  2.01s/it, lr: 1.0e-04 loss: 2.797e-01]
a-cold-wall:  53%|#####2    | 1586/3000 [44:31<47:17,  2.01s/it, lr: 1.0e-04 loss: 7.124e-01]
a-cold-wall:  53%|#####2    | 1586/3000 [44:31<47:17,  2.01s/it, lr: 1.0e-04 loss: 7.124e-01]
a-cold-wall:  53%|#####2    | 1587/3000 [44:31<53:02,  2.25s/it, lr: 1.0e-04 loss: 7.124e-01]
a-cold-wall:  53%|#####2    | 1587/3000 [44:31<53:02,  2.25s/it, lr: 1.0e-04 loss: 7.124e-01]
a-cold-wall:  53%|#####2    | 1587/3000 [44:32<53:02,  2.25s/it, lr: 1.0e-04 loss: 2.304e-01]
a-cold-wall:  53%|#####2    | 1587/3000 [44:32<53:02,  2.25s/it, lr: 1.0e-04 loss: 2.304e-01]
a-cold-wall:  53%|#####2    | 1588/3000 [44:32<42:35,  1.81s/it, lr: 1.0e-04 loss: 2.304e-01]
a-cold-wall:  53%|#####2    | 1588/3000 [44:32<42:35,  1.81s/it, lr: 1.0e-04 loss: 2.304e-01]
a-cold-wall:  53%|#####2    | 1588/3000 [44:33<42:35,  1.81s/it, lr: 1.0e-04 loss: 5.093e-02]
a-cold-wall:  53%|#####2    | 1588/3000 [44:33<42:35,  1.81s/it, lr: 1.0e-04 loss: 5.093e-02]
a-cold-wall:  53%|#####2    | 1589/3000 [44:33<35:09,  1.50s/it, lr: 1.0e-04 loss: 5.093e-02]
a-cold-wall:  53%|#####2    | 1589/3000 [44:33<35:09,  1.50s/it, lr: 1.0e-04 loss: 5.093e-02]
a-cold-wall:  53%|#####2    | 1589/3000 [44:33<35:09,  1.50s/it, lr: 1.0e-04 loss: 6.628e-01]
a-cold-wall:  53%|#####2    | 1589/3000 [44:33<35:09,  1.50s/it, lr: 1.0e-04 loss: 6.628e-01]
a-cold-wall:  53%|#####3    | 1590/3000 [44:35<35:08,  1.50s/it, lr: 1.0e-04 loss: 1.516e-01]
a-cold-wall:  53%|#####3    | 1590/3000 [44:35<35:08,  1.50s/it, lr: 1.0e-04 loss: 1.516e-01]
a-cold-wall:  53%|#####3    | 1591/3000 [44:35<26:38,  1.13s/it, lr: 1.0e-04 loss: 1.516e-01]
a-cold-wall:  53%|#####3    | 1591/3000 [44:35<26:38,  1.13s/it, lr: 1.0e-04 loss: 1.516e-01]
a-cold-wall:  53%|#####3    | 1591/3000 [44:38<26:38,  1.13s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  53%|#####3    | 1591/3000 [44:38<26:38,  1.13s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  53%|#####3    | 1592/3000 [44:38<36:36,  1.56s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  53%|#####3    | 1592/3000 [44:38<36:36,  1.56s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  53%|#####3    | 1592/3000 [44:38<36:36,  1.56s/it, lr: 1.0e-04 loss: 2.467e-01]
a-cold-wall:  53%|#####3    | 1592/3000 [44:38<36:36,  1.56s/it, lr: 1.0e-04 loss: 2.467e-01]
a-cold-wall:  53%|#####3    | 1593/3000 [44:38<31:36,  1.35s/it, lr: 1.0e-04 loss: 2.467e-01]
a-cold-wall:  53%|#####3    | 1593/3000 [44:38<31:36,  1.35s/it, lr: 1.0e-04 loss: 2.467e-01]
a-cold-wall:  53%|#####3    | 1593/3000 [44:40<31:36,  1.35s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  53%|#####3    | 1593/3000 [44:40<31:36,  1.35s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  53%|#####3    | 1594/3000 [44:40<31:59,  1.37s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  53%|#####3    | 1594/3000 [44:40<31:59,  1.37s/it, lr: 1.0e-04 loss: 1.860e-01]
a-cold-wall:  53%|#####3    | 1594/3000 [44:41<31:59,  1.37s/it, lr: 1.0e-04 loss: 2.510e-02]
a-cold-wall:  53%|#####3    | 1594/3000 [44:41<31:59,  1.37s/it, lr: 1.0e-04 loss: 2.510e-02]
a-cold-wall:  53%|#####3    | 1595/3000 [44:41<32:17,  1.38s/it, lr: 1.0e-04 loss: 2.510e-02]
a-cold-wall:  53%|#####3    | 1595/3000 [44:41<32:17,  1.38s/it, lr: 1.0e-04 loss: 2.510e-02]
a-cold-wall:  53%|#####3    | 1595/3000 [44:42<32:17,  1.38s/it, lr: 1.0e-04 loss: 2.771e-01]
a-cold-wall:  53%|#####3    | 1595/3000 [44:42<32:17,  1.38s/it, lr: 1.0e-04 loss: 2.771e-01]
a-cold-wall:  53%|#####3    | 1596/3000 [44:42<28:01,  1.20s/it, lr: 1.0e-04 loss: 2.771e-01]
a-cold-wall:  53%|#####3    | 1596/3000 [44:42<28:01,  1.20s/it, lr: 1.0e-04 loss: 2.771e-01]
a-cold-wall:  53%|#####3    | 1596/3000 [44:43<28:01,  1.20s/it, lr: 1.0e-04 loss: 2.185e-01]
a-cold-wall:  53%|#####3    | 1596/3000 [44:43<28:01,  1.20s/it, lr: 1.0e-04 loss: 2.185e-01]
a-cold-wall:  53%|#####3    | 1597/3000 [44:43<27:04,  1.16s/it, lr: 1.0e-04 loss: 2.185e-01]
a-cold-wall:  53%|#####3    | 1597/3000 [44:43<27:04,  1.16s/it, lr: 1.0e-04 loss: 2.185e-01]
a-cold-wall:  53%|#####3    | 1597/3000 [44:44<27:04,  1.16s/it, lr: 1.0e-04 loss: 4.649e-01]
a-cold-wall:  53%|#####3    | 1597/3000 [44:44<27:04,  1.16s/it, lr: 1.0e-04 loss: 4.649e-01]
a-cold-wall:  53%|#####3    | 1598/3000 [44:44<28:42,  1.23s/it, lr: 1.0e-04 loss: 4.649e-01]
a-cold-wall:  53%|#####3    | 1598/3000 [44:44<28:42,  1.23s/it, lr: 1.0e-04 loss: 4.649e-01]
a-cold-wall:  53%|#####3    | 1598/3000 [44:47<28:42,  1.23s/it, lr: 1.0e-04 loss: 4.347e-01]
a-cold-wall:  53%|#####3    | 1598/3000 [44:47<28:42,  1.23s/it, lr: 1.0e-04 loss: 4.347e-01]
a-cold-wall:  53%|#####3    | 1599/3000 [44:47<39:51,  1.71s/it, lr: 1.0e-04 loss: 4.347e-01]
a-cold-wall:  53%|#####3    | 1599/3000 [44:47<39:51,  1.71s/it, lr: 1.0e-04 loss: 4.347e-01]
a-cold-wall:  53%|#####3    | 1599/3000 [44:49<39:51,  1.71s/it, lr: 1.0e-04 loss: 3.308e-01]
a-cold-wall:  53%|#####3    | 1599/3000 [44:49<39:51,  1.71s/it, lr: 1.0e-04 loss: 3.308e-01]
a-cold-wall:  53%|#####3    | 1600/3000 [44:50<39:50,  1.71s/it, lr: 1.0e-04 loss: 1.937e-01]
a-cold-wall:  53%|#####3    | 1600/3000 [44:50<39:50,  1.71s/it, lr: 1.0e-04 loss: 1.937e-01]
a-cold-wall:  53%|#####3    | 1601/3000 [44:50<29:04,  1.25s/it, lr: 1.0e-04 loss: 1.937e-01]
a-cold-wall:  53%|#####3    | 1601/3000 [44:50<29:04,  1.25s/it, lr: 1.0e-04 loss: 1.937e-01]
a-cold-wall:  53%|#####3    | 1601/3000 [44:52<29:04,  1.25s/it, lr: 1.0e-04 loss: 3.235e-03]
a-cold-wall:  53%|#####3    | 1601/3000 [44:52<29:04,  1.25s/it, lr: 1.0e-04 loss: 3.235e-03]
a-cold-wall:  53%|#####3    | 1602/3000 [44:52<29:58,  1.29s/it, lr: 1.0e-04 loss: 3.235e-03]
a-cold-wall:  53%|#####3    | 1602/3000 [44:52<29:58,  1.29s/it, lr: 1.0e-04 loss: 3.235e-03]
a-cold-wall:  53%|#####3    | 1602/3000 [44:54<29:58,  1.29s/it, lr: 1.0e-04 loss: 6.792e-01]
a-cold-wall:  53%|#####3    | 1602/3000 [44:54<29:58,  1.29s/it, lr: 1.0e-04 loss: 6.792e-01]
a-cold-wall:  53%|#####3    | 1603/3000 [44:54<39:25,  1.69s/it, lr: 1.0e-04 loss: 6.792e-01]
a-cold-wall:  53%|#####3    | 1603/3000 [44:54<39:25,  1.69s/it, lr: 1.0e-04 loss: 6.792e-01]
a-cold-wall:  53%|#####3    | 1603/3000 [44:55<39:25,  1.69s/it, lr: 1.0e-04 loss: 5.221e-01]
a-cold-wall:  53%|#####3    | 1603/3000 [44:55<39:25,  1.69s/it, lr: 1.0e-04 loss: 5.221e-01]
a-cold-wall:  53%|#####3    | 1604/3000 [44:55<33:25,  1.44s/it, lr: 1.0e-04 loss: 5.221e-01]
a-cold-wall:  53%|#####3    | 1604/3000 [44:55<33:25,  1.44s/it, lr: 1.0e-04 loss: 5.221e-01]
a-cold-wall:  53%|#####3    | 1604/3000 [44:56<33:25,  1.44s/it, lr: 1.0e-04 loss: 3.190e-01]
a-cold-wall:  53%|#####3    | 1604/3000 [44:56<33:25,  1.44s/it, lr: 1.0e-04 loss: 3.190e-01]
a-cold-wall:  54%|#####3    | 1605/3000 [44:56<28:54,  1.24s/it, lr: 1.0e-04 loss: 3.190e-01]
a-cold-wall:  54%|#####3    | 1605/3000 [44:56<28:54,  1.24s/it, lr: 1.0e-04 loss: 3.190e-01]
a-cold-wall:  54%|#####3    | 1605/3000 [44:57<28:54,  1.24s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  54%|#####3    | 1605/3000 [44:57<28:54,  1.24s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  54%|#####3    | 1606/3000 [44:57<25:33,  1.10s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  54%|#####3    | 1606/3000 [44:57<25:33,  1.10s/it, lr: 1.0e-04 loss: 4.750e-01]
a-cold-wall:  54%|#####3    | 1606/3000 [44:57<25:33,  1.10s/it, lr: 1.0e-04 loss: 5.307e-02]
a-cold-wall:  54%|#####3    | 1606/3000 [44:57<25:33,  1.10s/it, lr: 1.0e-04 loss: 5.307e-02]
a-cold-wall:  54%|#####3    | 1607/3000 [44:57<23:09,  1.00it/s, lr: 1.0e-04 loss: 5.307e-02]
a-cold-wall:  54%|#####3    | 1607/3000 [44:57<23:09,  1.00it/s, lr: 1.0e-04 loss: 5.307e-02]
a-cold-wall:  54%|#####3    | 1607/3000 [44:59<23:09,  1.00it/s, lr: 1.0e-04 loss: 7.587e-01]
a-cold-wall:  54%|#####3    | 1607/3000 [44:59<23:09,  1.00it/s, lr: 1.0e-04 loss: 7.587e-01]
a-cold-wall:  54%|#####3    | 1608/3000 [44:59<25:51,  1.11s/it, lr: 1.0e-04 loss: 7.587e-01]
a-cold-wall:  54%|#####3    | 1608/3000 [44:59<25:51,  1.11s/it, lr: 1.0e-04 loss: 7.587e-01]
a-cold-wall:  54%|#####3    | 1608/3000 [45:02<25:51,  1.11s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  54%|#####3    | 1608/3000 [45:02<25:51,  1.11s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  54%|#####3    | 1609/3000 [45:02<37:45,  1.63s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  54%|#####3    | 1609/3000 [45:02<37:45,  1.63s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  54%|#####3    | 1609/3000 [45:03<37:45,  1.63s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  54%|#####3    | 1609/3000 [45:03<37:45,  1.63s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  54%|#####3    | 1610/3000 [45:05<37:43,  1.63s/it, lr: 1.0e-04 loss: 4.821e-01]
a-cold-wall:  54%|#####3    | 1610/3000 [45:05<37:43,  1.63s/it, lr: 1.0e-04 loss: 4.821e-01]
a-cold-wall:  54%|#####3    | 1611/3000 [45:05<35:33,  1.54s/it, lr: 1.0e-04 loss: 4.821e-01]
a-cold-wall:  54%|#####3    | 1611/3000 [45:05<35:33,  1.54s/it, lr: 1.0e-04 loss: 4.821e-01]
a-cold-wall:  54%|#####3    | 1611/3000 [45:07<35:33,  1.54s/it, lr: 1.0e-04 loss: 4.872e-01]
a-cold-wall:  54%|#####3    | 1611/3000 [45:07<35:33,  1.54s/it, lr: 1.0e-04 loss: 4.872e-01]
a-cold-wall:  54%|#####3    | 1612/3000 [45:07<34:50,  1.51s/it, lr: 1.0e-04 loss: 4.872e-01]
a-cold-wall:  54%|#####3    | 1612/3000 [45:07<34:50,  1.51s/it, lr: 1.0e-04 loss: 4.872e-01]
a-cold-wall:  54%|#####3    | 1612/3000 [45:10<34:50,  1.51s/it, lr: 1.0e-04 loss: 2.510e-01]
a-cold-wall:  54%|#####3    | 1612/3000 [45:10<34:50,  1.51s/it, lr: 1.0e-04 loss: 2.510e-01]
a-cold-wall:  54%|#####3    | 1613/3000 [45:10<42:41,  1.85s/it, lr: 1.0e-04 loss: 2.510e-01]
a-cold-wall:  54%|#####3    | 1613/3000 [45:10<42:41,  1.85s/it, lr: 1.0e-04 loss: 2.510e-01]
a-cold-wall:  54%|#####3    | 1613/3000 [45:11<42:41,  1.85s/it, lr: 1.0e-04 loss: 9.563e-02]
a-cold-wall:  54%|#####3    | 1613/3000 [45:11<42:41,  1.85s/it, lr: 1.0e-04 loss: 9.563e-02]
a-cold-wall:  54%|#####3    | 1614/3000 [45:11<39:57,  1.73s/it, lr: 1.0e-04 loss: 9.563e-02]
a-cold-wall:  54%|#####3    | 1614/3000 [45:11<39:57,  1.73s/it, lr: 1.0e-04 loss: 9.563e-02]
a-cold-wall:  54%|#####3    | 1614/3000 [45:12<39:57,  1.73s/it, lr: 1.0e-04 loss: 5.940e-01]
a-cold-wall:  54%|#####3    | 1614/3000 [45:12<39:57,  1.73s/it, lr: 1.0e-04 loss: 5.940e-01]
a-cold-wall:  54%|#####3    | 1615/3000 [45:12<33:34,  1.45s/it, lr: 1.0e-04 loss: 5.940e-01]
a-cold-wall:  54%|#####3    | 1615/3000 [45:12<33:34,  1.45s/it, lr: 1.0e-04 loss: 5.940e-01]
a-cold-wall:  54%|#####3    | 1615/3000 [45:13<33:34,  1.45s/it, lr: 1.0e-04 loss: 6.003e-01]
a-cold-wall:  54%|#####3    | 1615/3000 [45:13<33:34,  1.45s/it, lr: 1.0e-04 loss: 6.003e-01]
a-cold-wall:  54%|#####3    | 1616/3000 [45:13<28:58,  1.26s/it, lr: 1.0e-04 loss: 6.003e-01]
a-cold-wall:  54%|#####3    | 1616/3000 [45:13<28:58,  1.26s/it, lr: 1.0e-04 loss: 6.003e-01]
a-cold-wall:  54%|#####3    | 1616/3000 [45:13<28:58,  1.26s/it, lr: 1.0e-04 loss: 8.035e-02]
a-cold-wall:  54%|#####3    | 1616/3000 [45:13<28:58,  1.26s/it, lr: 1.0e-04 loss: 8.035e-02]
a-cold-wall:  54%|#####3    | 1617/3000 [45:13<25:29,  1.11s/it, lr: 1.0e-04 loss: 8.035e-02]
a-cold-wall:  54%|#####3    | 1617/3000 [45:13<25:29,  1.11s/it, lr: 1.0e-04 loss: 8.035e-02]
a-cold-wall:  54%|#####3    | 1617/3000 [45:15<25:29,  1.11s/it, lr: 1.0e-04 loss: 2.909e-01]
a-cold-wall:  54%|#####3    | 1617/3000 [45:15<25:29,  1.11s/it, lr: 1.0e-04 loss: 2.909e-01]
a-cold-wall:  54%|#####3    | 1618/3000 [45:15<27:26,  1.19s/it, lr: 1.0e-04 loss: 2.909e-01]
a-cold-wall:  54%|#####3    | 1618/3000 [45:15<27:26,  1.19s/it, lr: 1.0e-04 loss: 2.909e-01]
a-cold-wall:  54%|#####3    | 1618/3000 [45:16<27:26,  1.19s/it, lr: 1.0e-04 loss: 3.588e-01]
a-cold-wall:  54%|#####3    | 1618/3000 [45:16<27:26,  1.19s/it, lr: 1.0e-04 loss: 3.588e-01]
a-cold-wall:  54%|#####3    | 1619/3000 [45:16<28:54,  1.26s/it, lr: 1.0e-04 loss: 3.588e-01]
a-cold-wall:  54%|#####3    | 1619/3000 [45:16<28:54,  1.26s/it, lr: 1.0e-04 loss: 3.588e-01]
a-cold-wall:  54%|#####3    | 1619/3000 [45:17<28:54,  1.26s/it, lr: 1.0e-04 loss: 2.221e-01]
a-cold-wall:  54%|#####3    | 1619/3000 [45:17<28:54,  1.26s/it, lr: 1.0e-04 loss: 2.221e-01]
a-cold-wall:  54%|#####4    | 1620/3000 [45:18<28:52,  1.26s/it, lr: 1.0e-04 loss: 7.830e-01]
a-cold-wall:  54%|#####4    | 1620/3000 [45:18<28:52,  1.26s/it, lr: 1.0e-04 loss: 7.830e-01]
a-cold-wall:  54%|#####4    | 1621/3000 [45:18<19:34,  1.17it/s, lr: 1.0e-04 loss: 7.830e-01]
a-cold-wall:  54%|#####4    | 1621/3000 [45:18<19:34,  1.17it/s, lr: 1.0e-04 loss: 7.830e-01]
a-cold-wall:  54%|#####4    | 1621/3000 [45:19<19:34,  1.17it/s, lr: 1.0e-04 loss: 6.223e-01]
a-cold-wall:  54%|#####4    | 1621/3000 [45:19<19:34,  1.17it/s, lr: 1.0e-04 loss: 6.223e-01]
a-cold-wall:  54%|#####4    | 1622/3000 [45:19<19:01,  1.21it/s, lr: 1.0e-04 loss: 6.223e-01]
a-cold-wall:  54%|#####4    | 1622/3000 [45:19<19:01,  1.21it/s, lr: 1.0e-04 loss: 6.223e-01]
a-cold-wall:  54%|#####4    | 1622/3000 [45:20<19:01,  1.21it/s, lr: 1.0e-04 loss: 7.289e-02]
a-cold-wall:  54%|#####4    | 1622/3000 [45:20<19:01,  1.21it/s, lr: 1.0e-04 loss: 7.289e-02]
a-cold-wall:  54%|#####4    | 1623/3000 [45:20<19:47,  1.16it/s, lr: 1.0e-04 loss: 7.289e-02]
a-cold-wall:  54%|#####4    | 1623/3000 [45:20<19:47,  1.16it/s, lr: 1.0e-04 loss: 7.289e-02]
a-cold-wall:  54%|#####4    | 1623/3000 [45:23<19:47,  1.16it/s, lr: 1.0e-04 loss: 4.341e-01]
a-cold-wall:  54%|#####4    | 1623/3000 [45:23<19:47,  1.16it/s, lr: 1.0e-04 loss: 4.341e-01]
a-cold-wall:  54%|#####4    | 1624/3000 [45:23<32:07,  1.40s/it, lr: 1.0e-04 loss: 4.341e-01]
a-cold-wall:  54%|#####4    | 1624/3000 [45:23<32:07,  1.40s/it, lr: 1.0e-04 loss: 4.341e-01]
a-cold-wall:  54%|#####4    | 1624/3000 [45:24<32:07,  1.40s/it, lr: 1.0e-04 loss: 6.469e-01]
a-cold-wall:  54%|#####4    | 1624/3000 [45:24<32:07,  1.40s/it, lr: 1.0e-04 loss: 6.469e-01]
a-cold-wall:  54%|#####4    | 1625/3000 [45:24<32:04,  1.40s/it, lr: 1.0e-04 loss: 6.469e-01]
a-cold-wall:  54%|#####4    | 1625/3000 [45:24<32:04,  1.40s/it, lr: 1.0e-04 loss: 6.469e-01]
a-cold-wall:  54%|#####4    | 1625/3000 [45:26<32:04,  1.40s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  54%|#####4    | 1625/3000 [45:26<32:04,  1.40s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  54%|#####4    | 1626/3000 [45:26<32:02,  1.40s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  54%|#####4    | 1626/3000 [45:26<32:02,  1.40s/it, lr: 1.0e-04 loss: 5.676e-01]
a-cold-wall:  54%|#####4    | 1626/3000 [45:28<32:02,  1.40s/it, lr: 1.0e-04 loss: 7.247e-01]
a-cold-wall:  54%|#####4    | 1626/3000 [45:28<32:02,  1.40s/it, lr: 1.0e-04 loss: 7.247e-01]
a-cold-wall:  54%|#####4    | 1627/3000 [45:28<41:26,  1.81s/it, lr: 1.0e-04 loss: 7.247e-01]
a-cold-wall:  54%|#####4    | 1627/3000 [45:28<41:26,  1.81s/it, lr: 1.0e-04 loss: 7.247e-01]
a-cold-wall:  54%|#####4    | 1627/3000 [45:29<41:26,  1.81s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:  54%|#####4    | 1627/3000 [45:29<41:26,  1.81s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:  54%|#####4    | 1628/3000 [45:29<34:15,  1.50s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:  54%|#####4    | 1628/3000 [45:29<34:15,  1.50s/it, lr: 1.0e-04 loss: 1.770e-01]
a-cold-wall:  54%|#####4    | 1628/3000 [45:30<34:15,  1.50s/it, lr: 1.0e-04 loss: 5.026e-01]
a-cold-wall:  54%|#####4    | 1628/3000 [45:30<34:15,  1.50s/it, lr: 1.0e-04 loss: 5.026e-01]
a-cold-wall:  54%|#####4    | 1629/3000 [45:30<29:09,  1.28s/it, lr: 1.0e-04 loss: 5.026e-01]
a-cold-wall:  54%|#####4    | 1629/3000 [45:30<29:09,  1.28s/it, lr: 1.0e-04 loss: 5.026e-01]
a-cold-wall:  54%|#####4    | 1629/3000 [45:33<29:09,  1.28s/it, lr: 1.0e-04 loss: 6.236e-01]
a-cold-wall:  54%|#####4    | 1629/3000 [45:33<29:09,  1.28s/it, lr: 1.0e-04 loss: 6.236e-01]
a-cold-wall:  54%|#####4    | 1630/3000 [45:36<29:07,  1.28s/it, lr: 1.0e-04 loss: 4.977e-01]
a-cold-wall:  54%|#####4    | 1630/3000 [45:36<29:07,  1.28s/it, lr: 1.0e-04 loss: 4.977e-01]
a-cold-wall:  54%|#####4    | 1631/3000 [45:36<30:40,  1.34s/it, lr: 1.0e-04 loss: 4.977e-01]
a-cold-wall:  54%|#####4    | 1631/3000 [45:36<30:40,  1.34s/it, lr: 1.0e-04 loss: 4.977e-01]
a-cold-wall:  54%|#####4    | 1631/3000 [45:37<30:40,  1.34s/it, lr: 1.0e-04 loss: 5.505e-01]
a-cold-wall:  54%|#####4    | 1631/3000 [45:37<30:40,  1.34s/it, lr: 1.0e-04 loss: 5.505e-01]
a-cold-wall:  54%|#####4    | 1632/3000 [45:37<30:57,  1.36s/it, lr: 1.0e-04 loss: 5.505e-01]
a-cold-wall:  54%|#####4    | 1632/3000 [45:37<30:57,  1.36s/it, lr: 1.0e-04 loss: 5.505e-01]
a-cold-wall:  54%|#####4    | 1632/3000 [45:40<30:57,  1.36s/it, lr: 1.0e-04 loss: 5.162e-01]
a-cold-wall:  54%|#####4    | 1632/3000 [45:40<30:57,  1.36s/it, lr: 1.0e-04 loss: 5.162e-01]
a-cold-wall:  54%|#####4    | 1633/3000 [45:40<40:06,  1.76s/it, lr: 1.0e-04 loss: 5.162e-01]
a-cold-wall:  54%|#####4    | 1633/3000 [45:40<40:06,  1.76s/it, lr: 1.0e-04 loss: 5.162e-01]
a-cold-wall:  54%|#####4    | 1633/3000 [45:43<40:06,  1.76s/it, lr: 1.0e-04 loss: 5.610e-03]
a-cold-wall:  54%|#####4    | 1633/3000 [45:43<40:06,  1.76s/it, lr: 1.0e-04 loss: 5.610e-03]
a-cold-wall:  54%|#####4    | 1634/3000 [45:43<46:54,  2.06s/it, lr: 1.0e-04 loss: 5.610e-03]
a-cold-wall:  54%|#####4    | 1634/3000 [45:43<46:54,  2.06s/it, lr: 1.0e-04 loss: 5.610e-03]
a-cold-wall:  54%|#####4    | 1634/3000 [45:44<46:54,  2.06s/it, lr: 1.0e-04 loss: 2.691e-01]
a-cold-wall:  54%|#####4    | 1634/3000 [45:44<46:54,  2.06s/it, lr: 1.0e-04 loss: 2.691e-01]
a-cold-wall:  55%|#####4    | 1635/3000 [45:44<38:28,  1.69s/it, lr: 1.0e-04 loss: 2.691e-01]
a-cold-wall:  55%|#####4    | 1635/3000 [45:44<38:28,  1.69s/it, lr: 1.0e-04 loss: 2.691e-01]
a-cold-wall:  55%|#####4    | 1635/3000 [45:44<38:28,  1.69s/it, lr: 1.0e-04 loss: 1.299e-01]
a-cold-wall:  55%|#####4    | 1635/3000 [45:44<38:28,  1.69s/it, lr: 1.0e-04 loss: 1.299e-01]
a-cold-wall:  55%|#####4    | 1636/3000 [45:44<32:15,  1.42s/it, lr: 1.0e-04 loss: 1.299e-01]
a-cold-wall:  55%|#####4    | 1636/3000 [45:44<32:15,  1.42s/it, lr: 1.0e-04 loss: 1.299e-01]
a-cold-wall:  55%|#####4    | 1636/3000 [45:46<32:15,  1.42s/it, lr: 1.0e-04 loss: 6.670e-02]
a-cold-wall:  55%|#####4    | 1636/3000 [45:46<32:15,  1.42s/it, lr: 1.0e-04 loss: 6.670e-02]
a-cold-wall:  55%|#####4    | 1637/3000 [45:46<32:20,  1.42s/it, lr: 1.0e-04 loss: 6.670e-02]
a-cold-wall:  55%|#####4    | 1637/3000 [45:46<32:20,  1.42s/it, lr: 1.0e-04 loss: 6.670e-02]
a-cold-wall:  55%|#####4    | 1637/3000 [45:49<32:20,  1.42s/it, lr: 1.0e-04 loss: 5.987e-01]
a-cold-wall:  55%|#####4    | 1637/3000 [45:49<32:20,  1.42s/it, lr: 1.0e-04 loss: 5.987e-01]
a-cold-wall:  55%|#####4    | 1638/3000 [45:49<42:32,  1.87s/it, lr: 1.0e-04 loss: 5.987e-01]
a-cold-wall:  55%|#####4    | 1638/3000 [45:49<42:32,  1.87s/it, lr: 1.0e-04 loss: 5.987e-01]
a-cold-wall:  55%|#####4    | 1638/3000 [45:49<42:32,  1.87s/it, lr: 1.0e-04 loss: 4.143e-01]
a-cold-wall:  55%|#####4    | 1638/3000 [45:49<42:32,  1.87s/it, lr: 1.0e-04 loss: 4.143e-01]
a-cold-wall:  55%|#####4    | 1639/3000 [45:49<34:57,  1.54s/it, lr: 1.0e-04 loss: 4.143e-01]
a-cold-wall:  55%|#####4    | 1639/3000 [45:49<34:57,  1.54s/it, lr: 1.0e-04 loss: 4.143e-01]
a-cold-wall:  55%|#####4    | 1639/3000 [45:51<34:57,  1.54s/it, lr: 1.0e-04 loss: 3.001e-01]
a-cold-wall:  55%|#####4    | 1639/3000 [45:51<34:57,  1.54s/it, lr: 1.0e-04 loss: 3.001e-01]
a-cold-wall:  55%|#####4    | 1640/3000 [45:54<34:56,  1.54s/it, lr: 1.0e-04 loss: 2.678e-01]
a-cold-wall:  55%|#####4    | 1640/3000 [45:54<34:56,  1.54s/it, lr: 1.0e-04 loss: 2.678e-01]
a-cold-wall:  55%|#####4    | 1641/3000 [45:54<33:47,  1.49s/it, lr: 1.0e-04 loss: 2.678e-01]
a-cold-wall:  55%|#####4    | 1641/3000 [45:54<33:47,  1.49s/it, lr: 1.0e-04 loss: 2.678e-01]
a-cold-wall:  55%|#####4    | 1641/3000 [45:57<33:47,  1.49s/it, lr: 1.0e-04 loss: 3.622e-01]
a-cold-wall:  55%|#####4    | 1641/3000 [45:57<33:47,  1.49s/it, lr: 1.0e-04 loss: 3.622e-01]
a-cold-wall:  55%|#####4    | 1642/3000 [45:57<41:23,  1.83s/it, lr: 1.0e-04 loss: 3.622e-01]
a-cold-wall:  55%|#####4    | 1642/3000 [45:57<41:23,  1.83s/it, lr: 1.0e-04 loss: 3.622e-01]
a-cold-wall:  55%|#####4    | 1642/3000 [45:57<41:23,  1.83s/it, lr: 1.0e-04 loss: 7.837e-01]
a-cold-wall:  55%|#####4    | 1642/3000 [45:57<41:23,  1.83s/it, lr: 1.0e-04 loss: 7.837e-01]
a-cold-wall:  55%|#####4    | 1643/3000 [45:57<34:59,  1.55s/it, lr: 1.0e-04 loss: 7.837e-01]
a-cold-wall:  55%|#####4    | 1643/3000 [45:57<34:59,  1.55s/it, lr: 1.0e-04 loss: 7.837e-01]
a-cold-wall:  55%|#####4    | 1643/3000 [46:00<34:59,  1.55s/it, lr: 1.0e-04 loss: 4.386e-01]
a-cold-wall:  55%|#####4    | 1643/3000 [46:00<34:59,  1.55s/it, lr: 1.0e-04 loss: 4.386e-01]
a-cold-wall:  55%|#####4    | 1644/3000 [46:00<42:51,  1.90s/it, lr: 1.0e-04 loss: 4.386e-01]
a-cold-wall:  55%|#####4    | 1644/3000 [46:00<42:51,  1.90s/it, lr: 1.0e-04 loss: 4.386e-01]
a-cold-wall:  55%|#####4    | 1644/3000 [46:03<42:51,  1.90s/it, lr: 1.0e-04 loss: 3.096e-01]
a-cold-wall:  55%|#####4    | 1644/3000 [46:03<42:51,  1.90s/it, lr: 1.0e-04 loss: 3.096e-01]
a-cold-wall:  55%|#####4    | 1645/3000 [46:03<48:56,  2.17s/it, lr: 1.0e-04 loss: 3.096e-01]
a-cold-wall:  55%|#####4    | 1645/3000 [46:03<48:56,  2.17s/it, lr: 1.0e-04 loss: 3.096e-01]
a-cold-wall:  55%|#####4    | 1645/3000 [46:04<48:56,  2.17s/it, lr: 1.0e-04 loss: 2.634e-01]
a-cold-wall:  55%|#####4    | 1645/3000 [46:04<48:56,  2.17s/it, lr: 1.0e-04 loss: 2.634e-01]
a-cold-wall:  55%|#####4    | 1646/3000 [46:04<41:10,  1.82s/it, lr: 1.0e-04 loss: 2.634e-01]
a-cold-wall:  55%|#####4    | 1646/3000 [46:04<41:10,  1.82s/it, lr: 1.0e-04 loss: 2.634e-01]
a-cold-wall:  55%|#####4    | 1646/3000 [46:05<41:10,  1.82s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  55%|#####4    | 1646/3000 [46:05<41:10,  1.82s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  55%|#####4    | 1647/3000 [46:05<38:24,  1.70s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  55%|#####4    | 1647/3000 [46:05<38:24,  1.70s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  55%|#####4    | 1647/3000 [46:06<38:24,  1.70s/it, lr: 1.0e-04 loss: 5.651e-01]
a-cold-wall:  55%|#####4    | 1647/3000 [46:06<38:24,  1.70s/it, lr: 1.0e-04 loss: 5.651e-01]
a-cold-wall:  55%|#####4    | 1648/3000 [46:06<32:02,  1.42s/it, lr: 1.0e-04 loss: 5.651e-01]
a-cold-wall:  55%|#####4    | 1648/3000 [46:06<32:02,  1.42s/it, lr: 1.0e-04 loss: 5.651e-01]
a-cold-wall:  55%|#####4    | 1648/3000 [46:07<32:02,  1.42s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  55%|#####4    | 1648/3000 [46:07<32:02,  1.42s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  55%|#####4    | 1649/3000 [46:07<31:59,  1.42s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  55%|#####4    | 1649/3000 [46:07<31:59,  1.42s/it, lr: 1.0e-04 loss: 1.524e-01]
a-cold-wall:  55%|#####4    | 1649/3000 [46:08<31:59,  1.42s/it, lr: 1.0e-04 loss: 7.263e-01]
a-cold-wall:  55%|#####4    | 1649/3000 [46:08<31:59,  1.42s/it, lr: 1.0e-04 loss: 7.263e-01]
a-cold-wall:  55%|#####5    | 1650/3000 [46:09<31:58,  1.42s/it, lr: 1.0e-04 loss: 7.276e-01]
a-cold-wall:  55%|#####5    | 1650/3000 [46:09<31:58,  1.42s/it, lr: 1.0e-04 loss: 7.276e-01]
a-cold-wall:  55%|#####5    | 1651/3000 [46:09<21:10,  1.06it/s, lr: 1.0e-04 loss: 7.276e-01]
a-cold-wall:  55%|#####5    | 1651/3000 [46:09<21:10,  1.06it/s, lr: 1.0e-04 loss: 7.276e-01]
a-cold-wall:  55%|#####5    | 1651/3000 [46:12<21:10,  1.06it/s, lr: 1.0e-04 loss: 3.979e-01]
a-cold-wall:  55%|#####5    | 1651/3000 [46:12<21:10,  1.06it/s, lr: 1.0e-04 loss: 3.979e-01]
a-cold-wall:  55%|#####5    | 1652/3000 [46:12<32:34,  1.45s/it, lr: 1.0e-04 loss: 3.979e-01]
a-cold-wall:  55%|#####5    | 1652/3000 [46:12<32:34,  1.45s/it, lr: 1.0e-04 loss: 3.979e-01]
a-cold-wall:  55%|#####5    | 1652/3000 [46:13<32:34,  1.45s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  55%|#####5    | 1652/3000 [46:13<32:34,  1.45s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  55%|#####5    | 1653/3000 [46:13<32:28,  1.45s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  55%|#####5    | 1653/3000 [46:13<32:28,  1.45s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  55%|#####5    | 1653/3000 [46:16<32:28,  1.45s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  55%|#####5    | 1653/3000 [46:16<32:28,  1.45s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  55%|#####5    | 1654/3000 [46:16<41:11,  1.84s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  55%|#####5    | 1654/3000 [46:16<41:11,  1.84s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  55%|#####5    | 1654/3000 [46:19<41:11,  1.84s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  55%|#####5    | 1654/3000 [46:19<41:11,  1.84s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  55%|#####5    | 1655/3000 [46:19<47:42,  2.13s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  55%|#####5    | 1655/3000 [46:19<47:42,  2.13s/it, lr: 1.0e-04 loss: 2.615e-01]
a-cold-wall:  55%|#####5    | 1655/3000 [46:20<47:42,  2.13s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  55%|#####5    | 1655/3000 [46:20<47:42,  2.13s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  55%|#####5    | 1656/3000 [46:20<40:14,  1.80s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  55%|#####5    | 1656/3000 [46:20<40:14,  1.80s/it, lr: 1.0e-04 loss: 5.241e-01]
a-cold-wall:  55%|#####5    | 1656/3000 [46:22<40:14,  1.80s/it, lr: 1.0e-04 loss: 6.650e-01]
a-cold-wall:  55%|#####5    | 1656/3000 [46:22<40:14,  1.80s/it, lr: 1.0e-04 loss: 6.650e-01]
a-cold-wall:  55%|#####5    | 1657/3000 [46:22<37:48,  1.69s/it, lr: 1.0e-04 loss: 6.650e-01]
a-cold-wall:  55%|#####5    | 1657/3000 [46:22<37:48,  1.69s/it, lr: 1.0e-04 loss: 6.650e-01]
a-cold-wall:  55%|#####5    | 1657/3000 [46:24<37:48,  1.69s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  55%|#####5    | 1657/3000 [46:24<37:48,  1.69s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  55%|#####5    | 1658/3000 [46:24<45:37,  2.04s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  55%|#####5    | 1658/3000 [46:24<45:37,  2.04s/it, lr: 1.0e-04 loss: 1.198e-01]
a-cold-wall:  55%|#####5    | 1658/3000 [46:25<45:37,  2.04s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  55%|#####5    | 1658/3000 [46:25<45:37,  2.04s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  55%|#####5    | 1659/3000 [46:25<36:59,  1.66s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  55%|#####5    | 1659/3000 [46:25<36:59,  1.66s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  55%|#####5    | 1659/3000 [46:26<36:59,  1.66s/it, lr: 1.0e-04 loss: 4.708e-01]
a-cold-wall:  55%|#####5    | 1659/3000 [46:26<36:59,  1.66s/it, lr: 1.0e-04 loss: 4.708e-01]
a-cold-wall:  55%|#####5    | 1660/3000 [46:29<36:57,  1.66s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  55%|#####5    | 1660/3000 [46:29<36:57,  1.66s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  55%|#####5    | 1661/3000 [46:29<34:39,  1.55s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  55%|#####5    | 1661/3000 [46:29<34:39,  1.55s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  55%|#####5    | 1661/3000 [46:30<34:39,  1.55s/it, lr: 1.0e-04 loss: 7.210e-01]
a-cold-wall:  55%|#####5    | 1661/3000 [46:30<34:39,  1.55s/it, lr: 1.0e-04 loss: 7.210e-01]
a-cold-wall:  55%|#####5    | 1662/3000 [46:30<33:56,  1.52s/it, lr: 1.0e-04 loss: 7.210e-01]
a-cold-wall:  55%|#####5    | 1662/3000 [46:30<33:56,  1.52s/it, lr: 1.0e-04 loss: 7.210e-01]
a-cold-wall:  55%|#####5    | 1662/3000 [46:31<33:56,  1.52s/it, lr: 1.0e-04 loss: 5.302e-01]
a-cold-wall:  55%|#####5    | 1662/3000 [46:31<33:56,  1.52s/it, lr: 1.0e-04 loss: 5.302e-01]
a-cold-wall:  55%|#####5    | 1663/3000 [46:31<29:25,  1.32s/it, lr: 1.0e-04 loss: 5.302e-01]
a-cold-wall:  55%|#####5    | 1663/3000 [46:31<29:25,  1.32s/it, lr: 1.0e-04 loss: 5.302e-01]
a-cold-wall:  55%|#####5    | 1663/3000 [46:32<29:25,  1.32s/it, lr: 1.0e-04 loss: 4.503e-02]
a-cold-wall:  55%|#####5    | 1663/3000 [46:32<29:25,  1.32s/it, lr: 1.0e-04 loss: 4.503e-02]
a-cold-wall:  55%|#####5    | 1664/3000 [46:32<25:57,  1.17s/it, lr: 1.0e-04 loss: 4.503e-02]
a-cold-wall:  55%|#####5    | 1664/3000 [46:32<25:57,  1.17s/it, lr: 1.0e-04 loss: 4.503e-02]
a-cold-wall:  55%|#####5    | 1664/3000 [46:33<25:57,  1.17s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  55%|#####5    | 1664/3000 [46:33<25:57,  1.17s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  56%|#####5    | 1665/3000 [46:33<28:59,  1.30s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  56%|#####5    | 1665/3000 [46:33<28:59,  1.30s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  56%|#####5    | 1665/3000 [46:34<28:59,  1.30s/it, lr: 1.0e-04 loss: 7.410e-01]
a-cold-wall:  56%|#####5    | 1665/3000 [46:34<28:59,  1.30s/it, lr: 1.0e-04 loss: 7.410e-01]
a-cold-wall:  56%|#####5    | 1666/3000 [46:34<25:35,  1.15s/it, lr: 1.0e-04 loss: 7.410e-01]
a-cold-wall:  56%|#####5    | 1666/3000 [46:34<25:35,  1.15s/it, lr: 1.0e-04 loss: 7.410e-01]
a-cold-wall:  56%|#####5    | 1666/3000 [46:36<25:35,  1.15s/it, lr: 1.0e-04 loss: 1.550e-02]
a-cold-wall:  56%|#####5    | 1666/3000 [46:36<25:35,  1.15s/it, lr: 1.0e-04 loss: 1.550e-02]
a-cold-wall:  56%|#####5    | 1667/3000 [46:36<27:19,  1.23s/it, lr: 1.0e-04 loss: 1.550e-02]
a-cold-wall:  56%|#####5    | 1667/3000 [46:36<27:19,  1.23s/it, lr: 1.0e-04 loss: 1.550e-02]
a-cold-wall:  56%|#####5    | 1667/3000 [46:37<27:19,  1.23s/it, lr: 1.0e-04 loss: 6.574e-01]
a-cold-wall:  56%|#####5    | 1667/3000 [46:37<27:19,  1.23s/it, lr: 1.0e-04 loss: 6.574e-01]
a-cold-wall:  56%|#####5    | 1668/3000 [46:37<28:46,  1.30s/it, lr: 1.0e-04 loss: 6.574e-01]
a-cold-wall:  56%|#####5    | 1668/3000 [46:37<28:46,  1.30s/it, lr: 1.0e-04 loss: 6.574e-01]
a-cold-wall:  56%|#####5    | 1668/3000 [46:39<28:46,  1.30s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  56%|#####5    | 1668/3000 [46:39<28:46,  1.30s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  56%|#####5    | 1669/3000 [46:39<29:42,  1.34s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  56%|#####5    | 1669/3000 [46:39<29:42,  1.34s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  56%|#####5    | 1669/3000 [46:40<29:42,  1.34s/it, lr: 1.0e-04 loss: 5.410e-01]
a-cold-wall:  56%|#####5    | 1669/3000 [46:40<29:42,  1.34s/it, lr: 1.0e-04 loss: 5.410e-01]
a-cold-wall:  56%|#####5    | 1670/3000 [46:43<29:40,  1.34s/it, lr: 1.0e-04 loss: 3.967e-01]
a-cold-wall:  56%|#####5    | 1670/3000 [46:43<29:40,  1.34s/it, lr: 1.0e-04 loss: 3.967e-01]
a-cold-wall:  56%|#####5    | 1671/3000 [46:43<30:40,  1.39s/it, lr: 1.0e-04 loss: 3.967e-01]
a-cold-wall:  56%|#####5    | 1671/3000 [46:43<30:40,  1.39s/it, lr: 1.0e-04 loss: 3.967e-01]
a-cold-wall:  56%|#####5    | 1671/3000 [46:44<30:40,  1.39s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  56%|#####5    | 1671/3000 [46:44<30:40,  1.39s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  56%|#####5    | 1672/3000 [46:44<27:14,  1.23s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  56%|#####5    | 1672/3000 [46:44<27:14,  1.23s/it, lr: 1.0e-04 loss: 1.971e-01]
a-cold-wall:  56%|#####5    | 1672/3000 [46:46<27:14,  1.23s/it, lr: 1.0e-04 loss: 5.216e-01]
a-cold-wall:  56%|#####5    | 1672/3000 [46:46<27:14,  1.23s/it, lr: 1.0e-04 loss: 5.216e-01]
a-cold-wall:  56%|#####5    | 1673/3000 [46:46<36:44,  1.66s/it, lr: 1.0e-04 loss: 5.216e-01]
a-cold-wall:  56%|#####5    | 1673/3000 [46:46<36:44,  1.66s/it, lr: 1.0e-04 loss: 5.216e-01]
a-cold-wall:  56%|#####5    | 1673/3000 [46:49<36:44,  1.66s/it, lr: 1.0e-04 loss: 5.425e-02]
a-cold-wall:  56%|#####5    | 1673/3000 [46:49<36:44,  1.66s/it, lr: 1.0e-04 loss: 5.425e-02]
a-cold-wall:  56%|#####5    | 1674/3000 [46:49<44:17,  2.00s/it, lr: 1.0e-04 loss: 5.425e-02]
a-cold-wall:  56%|#####5    | 1674/3000 [46:49<44:17,  2.00s/it, lr: 1.0e-04 loss: 5.425e-02]
a-cold-wall:  56%|#####5    | 1674/3000 [46:52<44:17,  2.00s/it, lr: 1.0e-04 loss: 5.831e-01]
a-cold-wall:  56%|#####5    | 1674/3000 [46:52<44:17,  2.00s/it, lr: 1.0e-04 loss: 5.831e-01]
a-cold-wall:  56%|#####5    | 1675/3000 [46:52<49:47,  2.25s/it, lr: 1.0e-04 loss: 5.831e-01]
a-cold-wall:  56%|#####5    | 1675/3000 [46:52<49:47,  2.25s/it, lr: 1.0e-04 loss: 5.831e-01]
a-cold-wall:  56%|#####5    | 1675/3000 [46:55<49:47,  2.25s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  56%|#####5    | 1675/3000 [46:55<49:47,  2.25s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  56%|#####5    | 1676/3000 [46:55<53:37,  2.43s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  56%|#####5    | 1676/3000 [46:55<53:37,  2.43s/it, lr: 1.0e-04 loss: 4.956e-01]
a-cold-wall:  56%|#####5    | 1676/3000 [46:57<53:37,  2.43s/it, lr: 1.0e-04 loss: 3.420e-01]
a-cold-wall:  56%|#####5    | 1676/3000 [46:57<53:37,  2.43s/it, lr: 1.0e-04 loss: 3.420e-01]
a-cold-wall:  56%|#####5    | 1677/3000 [46:57<47:14,  2.14s/it, lr: 1.0e-04 loss: 3.420e-01]
a-cold-wall:  56%|#####5    | 1677/3000 [46:57<47:14,  2.14s/it, lr: 1.0e-04 loss: 3.420e-01]
a-cold-wall:  56%|#####5    | 1677/3000 [46:58<47:14,  2.14s/it, lr: 1.0e-04 loss: 6.232e-01]
a-cold-wall:  56%|#####5    | 1677/3000 [46:58<47:14,  2.14s/it, lr: 1.0e-04 loss: 6.232e-01]
a-cold-wall:  56%|#####5    | 1678/3000 [46:58<43:42,  1.98s/it, lr: 1.0e-04 loss: 6.232e-01]
a-cold-wall:  56%|#####5    | 1678/3000 [46:58<43:42,  1.98s/it, lr: 1.0e-04 loss: 6.232e-01]
a-cold-wall:  56%|#####5    | 1678/3000 [46:59<43:42,  1.98s/it, lr: 1.0e-04 loss: 6.018e-01]
a-cold-wall:  56%|#####5    | 1678/3000 [46:59<43:42,  1.98s/it, lr: 1.0e-04 loss: 6.018e-01]
a-cold-wall:  56%|#####5    | 1679/3000 [46:59<35:32,  1.61s/it, lr: 1.0e-04 loss: 6.018e-01]
a-cold-wall:  56%|#####5    | 1679/3000 [46:59<35:32,  1.61s/it, lr: 1.0e-04 loss: 6.018e-01]
a-cold-wall:  56%|#####5    | 1679/3000 [47:00<35:32,  1.61s/it, lr: 1.0e-04 loss: 3.839e-02]
a-cold-wall:  56%|#####5    | 1679/3000 [47:00<35:32,  1.61s/it, lr: 1.0e-04 loss: 3.839e-02]
a-cold-wall:  56%|#####6    | 1680/3000 [47:02<35:30,  1.61s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  56%|#####6    | 1680/3000 [47:02<35:30,  1.61s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  56%|#####6    | 1681/3000 [47:02<26:32,  1.21s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  56%|#####6    | 1681/3000 [47:02<26:32,  1.21s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  56%|#####6    | 1681/3000 [47:03<26:32,  1.21s/it, lr: 1.0e-04 loss: 4.651e-01]
a-cold-wall:  56%|#####6    | 1681/3000 [47:03<26:32,  1.21s/it, lr: 1.0e-04 loss: 4.651e-01]
a-cold-wall:  56%|#####6    | 1682/3000 [47:03<27:39,  1.26s/it, lr: 1.0e-04 loss: 4.651e-01]
a-cold-wall:  56%|#####6    | 1682/3000 [47:03<27:39,  1.26s/it, lr: 1.0e-04 loss: 4.651e-01]
a-cold-wall:  56%|#####6    | 1682/3000 [47:04<27:39,  1.26s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:  56%|#####6    | 1682/3000 [47:04<27:39,  1.26s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:  56%|#####6    | 1683/3000 [47:04<24:44,  1.13s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:  56%|#####6    | 1683/3000 [47:04<24:44,  1.13s/it, lr: 1.0e-04 loss: 3.009e-01]
a-cold-wall:  56%|#####6    | 1683/3000 [47:07<24:44,  1.13s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  56%|#####6    | 1683/3000 [47:07<24:44,  1.13s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  56%|#####6    | 1684/3000 [47:07<35:09,  1.60s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  56%|#####6    | 1684/3000 [47:07<35:09,  1.60s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  56%|#####6    | 1684/3000 [47:08<35:09,  1.60s/it, lr: 1.0e-04 loss: 4.214e-01]
a-cold-wall:  56%|#####6    | 1684/3000 [47:08<35:09,  1.60s/it, lr: 1.0e-04 loss: 4.214e-01]
a-cold-wall:  56%|#####6    | 1685/3000 [47:08<29:56,  1.37s/it, lr: 1.0e-04 loss: 4.214e-01]
a-cold-wall:  56%|#####6    | 1685/3000 [47:08<29:56,  1.37s/it, lr: 1.0e-04 loss: 4.214e-01]
a-cold-wall:  56%|#####6    | 1685/3000 [47:09<29:56,  1.37s/it, lr: 1.0e-04 loss: 1.258e-01]
a-cold-wall:  56%|#####6    | 1685/3000 [47:09<29:56,  1.37s/it, lr: 1.0e-04 loss: 1.258e-01]
a-cold-wall:  56%|#####6    | 1686/3000 [47:09<30:13,  1.38s/it, lr: 1.0e-04 loss: 1.258e-01]
a-cold-wall:  56%|#####6    | 1686/3000 [47:09<30:13,  1.38s/it, lr: 1.0e-04 loss: 1.258e-01]
a-cold-wall:  56%|#####6    | 1686/3000 [47:10<30:13,  1.38s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  56%|#####6    | 1686/3000 [47:10<30:13,  1.38s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  56%|#####6    | 1687/3000 [47:10<26:12,  1.20s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  56%|#####6    | 1687/3000 [47:10<26:12,  1.20s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  56%|#####6    | 1687/3000 [47:13<26:12,  1.20s/it, lr: 1.0e-04 loss: 3.650e-01]
a-cold-wall:  56%|#####6    | 1687/3000 [47:13<26:12,  1.20s/it, lr: 1.0e-04 loss: 3.650e-01]
a-cold-wall:  56%|#####6    | 1688/3000 [47:13<36:42,  1.68s/it, lr: 1.0e-04 loss: 3.650e-01]
a-cold-wall:  56%|#####6    | 1688/3000 [47:13<36:42,  1.68s/it, lr: 1.0e-04 loss: 3.650e-01]
a-cold-wall:  56%|#####6    | 1688/3000 [47:13<36:42,  1.68s/it, lr: 1.0e-04 loss: 6.320e-01]
a-cold-wall:  56%|#####6    | 1688/3000 [47:13<36:42,  1.68s/it, lr: 1.0e-04 loss: 6.320e-01]
a-cold-wall:  56%|#####6    | 1689/3000 [47:13<30:40,  1.40s/it, lr: 1.0e-04 loss: 6.320e-01]
a-cold-wall:  56%|#####6    | 1689/3000 [47:13<30:40,  1.40s/it, lr: 1.0e-04 loss: 6.320e-01]
a-cold-wall:  56%|#####6    | 1689/3000 [47:15<30:40,  1.40s/it, lr: 1.0e-04 loss: 5.327e-01]
a-cold-wall:  56%|#####6    | 1689/3000 [47:15<30:40,  1.40s/it, lr: 1.0e-04 loss: 5.327e-01]
a-cold-wall:  56%|#####6    | 1690/3000 [47:18<30:38,  1.40s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:  56%|#####6    | 1690/3000 [47:18<30:38,  1.40s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:  56%|#####6    | 1691/3000 [47:18<30:50,  1.41s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:  56%|#####6    | 1691/3000 [47:18<30:50,  1.41s/it, lr: 1.0e-04 loss: 6.883e-01]
a-cold-wall:  56%|#####6    | 1691/3000 [47:21<30:50,  1.41s/it, lr: 1.0e-04 loss: 2.699e-01]
a-cold-wall:  56%|#####6    | 1691/3000 [47:21<30:50,  1.41s/it, lr: 1.0e-04 loss: 2.699e-01]
a-cold-wall:  56%|#####6    | 1692/3000 [47:21<38:30,  1.77s/it, lr: 1.0e-04 loss: 2.699e-01]
a-cold-wall:  56%|#####6    | 1692/3000 [47:21<38:30,  1.77s/it, lr: 1.0e-04 loss: 2.699e-01]
a-cold-wall:  56%|#####6    | 1692/3000 [47:22<38:30,  1.77s/it, lr: 1.0e-04 loss: 4.179e-01]
a-cold-wall:  56%|#####6    | 1692/3000 [47:22<38:30,  1.77s/it, lr: 1.0e-04 loss: 4.179e-01]
a-cold-wall:  56%|#####6    | 1693/3000 [47:22<37:49,  1.74s/it, lr: 1.0e-04 loss: 4.179e-01]
a-cold-wall:  56%|#####6    | 1693/3000 [47:22<37:49,  1.74s/it, lr: 1.0e-04 loss: 4.179e-01]
a-cold-wall:  56%|#####6    | 1693/3000 [47:25<37:49,  1.74s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  56%|#####6    | 1693/3000 [47:25<37:49,  1.74s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  56%|#####6    | 1694/3000 [47:25<44:29,  2.04s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  56%|#####6    | 1694/3000 [47:25<44:29,  2.04s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  56%|#####6    | 1694/3000 [47:28<44:29,  2.04s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:  56%|#####6    | 1694/3000 [47:28<44:29,  2.04s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:  56%|#####6    | 1695/3000 [47:28<49:18,  2.27s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:  56%|#####6    | 1695/3000 [47:28<49:18,  2.27s/it, lr: 1.0e-04 loss: 5.557e-01]
a-cold-wall:  56%|#####6    | 1695/3000 [47:29<49:18,  2.27s/it, lr: 1.0e-04 loss: 5.049e-01]
a-cold-wall:  56%|#####6    | 1695/3000 [47:29<49:18,  2.27s/it, lr: 1.0e-04 loss: 5.049e-01]
a-cold-wall:  57%|#####6    | 1696/3000 [47:29<44:01,  2.03s/it, lr: 1.0e-04 loss: 5.049e-01]
a-cold-wall:  57%|#####6    | 1696/3000 [47:29<44:01,  2.03s/it, lr: 1.0e-04 loss: 5.049e-01]
a-cold-wall:  57%|#####6    | 1696/3000 [47:32<44:01,  2.03s/it, lr: 1.0e-04 loss: 3.222e-01]
a-cold-wall:  57%|#####6    | 1696/3000 [47:32<44:01,  2.03s/it, lr: 1.0e-04 loss: 3.222e-01]
a-cold-wall:  57%|#####6    | 1697/3000 [47:32<49:07,  2.26s/it, lr: 1.0e-04 loss: 3.222e-01]
a-cold-wall:  57%|#####6    | 1697/3000 [47:32<49:07,  2.26s/it, lr: 1.0e-04 loss: 3.222e-01]
a-cold-wall:  57%|#####6    | 1697/3000 [47:33<49:07,  2.26s/it, lr: 1.0e-04 loss: 2.350e-01]
a-cold-wall:  57%|#####6    | 1697/3000 [47:33<49:07,  2.26s/it, lr: 1.0e-04 loss: 2.350e-01]
a-cold-wall:  57%|#####6    | 1698/3000 [47:33<39:28,  1.82s/it, lr: 1.0e-04 loss: 2.350e-01]
a-cold-wall:  57%|#####6    | 1698/3000 [47:33<39:28,  1.82s/it, lr: 1.0e-04 loss: 2.350e-01]
a-cold-wall:  57%|#####6    | 1698/3000 [47:36<39:28,  1.82s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  57%|#####6    | 1698/3000 [47:36<39:28,  1.82s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  57%|#####6    | 1699/3000 [47:36<46:11,  2.13s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  57%|#####6    | 1699/3000 [47:36<46:11,  2.13s/it, lr: 1.0e-04 loss: 5.108e-01]
a-cold-wall:  57%|#####6    | 1699/3000 [47:37<46:11,  2.13s/it, lr: 1.0e-04 loss: 7.529e-01]
a-cold-wall:  57%|#####6    | 1699/3000 [47:37<46:11,  2.13s/it, lr: 1.0e-04 loss: 7.529e-01]
a-cold-wall:  57%|#####6    | 1700/3000 [47:39<46:08,  2.13s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  57%|#####6    | 1700/3000 [47:39<46:08,  2.13s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  57%|#####6    | 1701/3000 [47:39<39:15,  1.81s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  57%|#####6    | 1701/3000 [47:39<39:15,  1.81s/it, lr: 1.0e-04 loss: 1.304e-01]
a-cold-wall:  57%|#####6    | 1701/3000 [47:41<39:15,  1.81s/it, lr: 1.0e-04 loss: 5.405e-01]
a-cold-wall:  57%|#####6    | 1701/3000 [47:41<39:15,  1.81s/it, lr: 1.0e-04 loss: 5.405e-01]
a-cold-wall:  57%|#####6    | 1702/3000 [47:41<37:04,  1.71s/it, lr: 1.0e-04 loss: 5.405e-01]
a-cold-wall:  57%|#####6    | 1702/3000 [47:41<37:04,  1.71s/it, lr: 1.0e-04 loss: 5.405e-01]
a-cold-wall:  57%|#####6    | 1702/3000 [47:42<37:04,  1.71s/it, lr: 1.0e-04 loss: 2.642e-01]
a-cold-wall:  57%|#####6    | 1702/3000 [47:42<37:04,  1.71s/it, lr: 1.0e-04 loss: 2.642e-01]
a-cold-wall:  57%|#####6    | 1703/3000 [47:42<35:32,  1.64s/it, lr: 1.0e-04 loss: 2.642e-01]
a-cold-wall:  57%|#####6    | 1703/3000 [47:42<35:32,  1.64s/it, lr: 1.0e-04 loss: 2.642e-01]
a-cold-wall:  57%|#####6    | 1703/3000 [47:43<35:32,  1.64s/it, lr: 1.0e-04 loss: 2.540e-01]
a-cold-wall:  57%|#####6    | 1703/3000 [47:43<35:32,  1.64s/it, lr: 1.0e-04 loss: 2.540e-01]
a-cold-wall:  57%|#####6    | 1704/3000 [47:43<31:33,  1.46s/it, lr: 1.0e-04 loss: 2.540e-01]
a-cold-wall:  57%|#####6    | 1704/3000 [47:43<31:33,  1.46s/it, lr: 1.0e-04 loss: 2.540e-01]
a-cold-wall:  57%|#####6    | 1704/3000 [47:45<31:33,  1.46s/it, lr: 1.0e-04 loss: 2.059e-01]
a-cold-wall:  57%|#####6    | 1704/3000 [47:45<31:33,  1.46s/it, lr: 1.0e-04 loss: 2.059e-01]
a-cold-wall:  57%|#####6    | 1705/3000 [47:45<31:16,  1.45s/it, lr: 1.0e-04 loss: 2.059e-01]
a-cold-wall:  57%|#####6    | 1705/3000 [47:45<31:16,  1.45s/it, lr: 1.0e-04 loss: 2.059e-01]
a-cold-wall:  57%|#####6    | 1705/3000 [47:45<31:16,  1.45s/it, lr: 1.0e-04 loss: 6.360e-01]
a-cold-wall:  57%|#####6    | 1705/3000 [47:45<31:16,  1.45s/it, lr: 1.0e-04 loss: 6.360e-01]
a-cold-wall:  57%|#####6    | 1706/3000 [47:45<26:55,  1.25s/it, lr: 1.0e-04 loss: 6.360e-01]
a-cold-wall:  57%|#####6    | 1706/3000 [47:45<26:55,  1.25s/it, lr: 1.0e-04 loss: 6.360e-01]
a-cold-wall:  57%|#####6    | 1706/3000 [47:48<26:55,  1.25s/it, lr: 1.0e-04 loss: 3.012e-01]
a-cold-wall:  57%|#####6    | 1706/3000 [47:48<26:55,  1.25s/it, lr: 1.0e-04 loss: 3.012e-01]
a-cold-wall:  57%|#####6    | 1707/3000 [47:48<37:51,  1.76s/it, lr: 1.0e-04 loss: 3.012e-01]
a-cold-wall:  57%|#####6    | 1707/3000 [47:48<37:51,  1.76s/it, lr: 1.0e-04 loss: 3.012e-01]
a-cold-wall:  57%|#####6    | 1707/3000 [47:50<37:51,  1.76s/it, lr: 1.0e-04 loss: 5.631e-01]
a-cold-wall:  57%|#####6    | 1707/3000 [47:50<37:51,  1.76s/it, lr: 1.0e-04 loss: 5.631e-01]
a-cold-wall:  57%|#####6    | 1708/3000 [47:50<35:49,  1.66s/it, lr: 1.0e-04 loss: 5.631e-01]
a-cold-wall:  57%|#####6    | 1708/3000 [47:50<35:49,  1.66s/it, lr: 1.0e-04 loss: 5.631e-01]
a-cold-wall:  57%|#####6    | 1708/3000 [47:51<35:49,  1.66s/it, lr: 1.0e-04 loss: 3.646e-01]
a-cold-wall:  57%|#####6    | 1708/3000 [47:51<35:49,  1.66s/it, lr: 1.0e-04 loss: 3.646e-01]
a-cold-wall:  57%|#####6    | 1709/3000 [47:51<29:58,  1.39s/it, lr: 1.0e-04 loss: 3.646e-01]
a-cold-wall:  57%|#####6    | 1709/3000 [47:51<29:58,  1.39s/it, lr: 1.0e-04 loss: 3.646e-01]
a-cold-wall:  57%|#####6    | 1709/3000 [47:54<29:58,  1.39s/it, lr: 1.0e-04 loss: 7.596e-01]
a-cold-wall:  57%|#####6    | 1709/3000 [47:54<29:58,  1.39s/it, lr: 1.0e-04 loss: 7.596e-01]
a-cold-wall:  57%|#####6    | 1710/3000 [47:54<29:57,  1.39s/it, lr: 1.0e-04 loss: 5.162e-02]
a-cold-wall:  57%|#####6    | 1710/3000 [47:54<29:57,  1.39s/it, lr: 1.0e-04 loss: 5.162e-02]
a-cold-wall:  57%|#####7    | 1711/3000 [47:54<19:56,  1.08it/s, lr: 1.0e-04 loss: 5.162e-02]
a-cold-wall:  57%|#####7    | 1711/3000 [47:54<19:56,  1.08it/s, lr: 1.0e-04 loss: 5.162e-02]
a-cold-wall:  57%|#####7    | 1711/3000 [47:56<19:56,  1.08it/s, lr: 1.0e-04 loss: 7.071e-01]
a-cold-wall:  57%|#####7    | 1711/3000 [47:56<19:56,  1.08it/s, lr: 1.0e-04 loss: 7.071e-01]
a-cold-wall:  57%|#####7    | 1712/3000 [47:56<22:32,  1.05s/it, lr: 1.0e-04 loss: 7.071e-01]
a-cold-wall:  57%|#####7    | 1712/3000 [47:56<22:32,  1.05s/it, lr: 1.0e-04 loss: 7.071e-01]
a-cold-wall:  57%|#####7    | 1712/3000 [47:59<22:32,  1.05s/it, lr: 1.0e-04 loss: 8.258e-02]
a-cold-wall:  57%|#####7    | 1712/3000 [47:59<22:32,  1.05s/it, lr: 1.0e-04 loss: 8.258e-02]
a-cold-wall:  57%|#####7    | 1713/3000 [47:59<32:32,  1.52s/it, lr: 1.0e-04 loss: 8.258e-02]
a-cold-wall:  57%|#####7    | 1713/3000 [47:59<32:32,  1.52s/it, lr: 1.0e-04 loss: 8.258e-02]
a-cold-wall:  57%|#####7    | 1713/3000 [47:59<32:32,  1.52s/it, lr: 1.0e-04 loss: 5.146e-01]
a-cold-wall:  57%|#####7    | 1713/3000 [47:59<32:32,  1.52s/it, lr: 1.0e-04 loss: 5.146e-01]
a-cold-wall:  57%|#####7    | 1714/3000 [47:59<28:03,  1.31s/it, lr: 1.0e-04 loss: 5.146e-01]
a-cold-wall:  57%|#####7    | 1714/3000 [47:59<28:03,  1.31s/it, lr: 1.0e-04 loss: 5.146e-01]
a-cold-wall:  57%|#####7    | 1714/3000 [48:01<28:03,  1.31s/it, lr: 1.0e-04 loss: 6.758e-01]
a-cold-wall:  57%|#####7    | 1714/3000 [48:01<28:03,  1.31s/it, lr: 1.0e-04 loss: 6.758e-01]
a-cold-wall:  57%|#####7    | 1715/3000 [48:01<28:41,  1.34s/it, lr: 1.0e-04 loss: 6.758e-01]
a-cold-wall:  57%|#####7    | 1715/3000 [48:01<28:41,  1.34s/it, lr: 1.0e-04 loss: 6.758e-01]
a-cold-wall:  57%|#####7    | 1715/3000 [48:04<28:41,  1.34s/it, lr: 1.0e-04 loss: 1.736e-01]
a-cold-wall:  57%|#####7    | 1715/3000 [48:04<28:41,  1.34s/it, lr: 1.0e-04 loss: 1.736e-01]
a-cold-wall:  57%|#####7    | 1716/3000 [48:04<37:50,  1.77s/it, lr: 1.0e-04 loss: 1.736e-01]
a-cold-wall:  57%|#####7    | 1716/3000 [48:04<37:50,  1.77s/it, lr: 1.0e-04 loss: 1.736e-01]
a-cold-wall:  57%|#####7    | 1716/3000 [48:06<37:50,  1.77s/it, lr: 1.0e-04 loss: 9.625e-02]
a-cold-wall:  57%|#####7    | 1716/3000 [48:06<37:50,  1.77s/it, lr: 1.0e-04 loss: 9.625e-02]
a-cold-wall:  57%|#####7    | 1717/3000 [48:06<44:40,  2.09s/it, lr: 1.0e-04 loss: 9.625e-02]
a-cold-wall:  57%|#####7    | 1717/3000 [48:06<44:40,  2.09s/it, lr: 1.0e-04 loss: 9.625e-02]
a-cold-wall:  57%|#####7    | 1717/3000 [48:07<44:40,  2.09s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  57%|#####7    | 1717/3000 [48:07<44:40,  2.09s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  57%|#####7    | 1718/3000 [48:07<36:13,  1.70s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  57%|#####7    | 1718/3000 [48:07<36:13,  1.70s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  57%|#####7    | 1718/3000 [48:08<36:13,  1.70s/it, lr: 1.0e-04 loss: 5.378e-02]
a-cold-wall:  57%|#####7    | 1718/3000 [48:08<36:13,  1.70s/it, lr: 1.0e-04 loss: 5.378e-02]
a-cold-wall:  57%|#####7    | 1719/3000 [48:08<30:20,  1.42s/it, lr: 1.0e-04 loss: 5.378e-02]
a-cold-wall:  57%|#####7    | 1719/3000 [48:08<30:20,  1.42s/it, lr: 1.0e-04 loss: 5.378e-02]
a-cold-wall:  57%|#####7    | 1719/3000 [48:09<30:20,  1.42s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  57%|#####7    | 1719/3000 [48:09<30:20,  1.42s/it, lr: 1.0e-04 loss: 5.447e-01]
a-cold-wall:  57%|#####7    | 1720/3000 [48:10<30:19,  1.42s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  57%|#####7    | 1720/3000 [48:10<30:19,  1.42s/it, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  57%|#####7    | 1721/3000 [48:10<20:06,  1.06it/s, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  57%|#####7    | 1721/3000 [48:10<20:06,  1.06it/s, lr: 1.0e-04 loss: 3.602e-01]
a-cold-wall:  57%|#####7    | 1721/3000 [48:11<20:06,  1.06it/s, lr: 1.0e-04 loss: 8.222e-01]
a-cold-wall:  57%|#####7    | 1721/3000 [48:11<20:06,  1.06it/s, lr: 1.0e-04 loss: 8.222e-01]
a-cold-wall:  57%|#####7    | 1722/3000 [48:11<22:35,  1.06s/it, lr: 1.0e-04 loss: 8.222e-01]
a-cold-wall:  57%|#####7    | 1722/3000 [48:11<22:35,  1.06s/it, lr: 1.0e-04 loss: 8.222e-01]
a-cold-wall:  57%|#####7    | 1722/3000 [48:13<22:35,  1.06s/it, lr: 1.0e-04 loss: 4.405e-01]
a-cold-wall:  57%|#####7    | 1722/3000 [48:13<22:35,  1.06s/it, lr: 1.0e-04 loss: 4.405e-01]
a-cold-wall:  57%|#####7    | 1723/3000 [48:13<24:32,  1.15s/it, lr: 1.0e-04 loss: 4.405e-01]
a-cold-wall:  57%|#####7    | 1723/3000 [48:13<24:32,  1.15s/it, lr: 1.0e-04 loss: 4.405e-01]
a-cold-wall:  57%|#####7    | 1723/3000 [48:14<24:32,  1.15s/it, lr: 1.0e-04 loss: 3.375e-01]
a-cold-wall:  57%|#####7    | 1723/3000 [48:14<24:32,  1.15s/it, lr: 1.0e-04 loss: 3.375e-01]
a-cold-wall:  57%|#####7    | 1724/3000 [48:14<26:00,  1.22s/it, lr: 1.0e-04 loss: 3.375e-01]
a-cold-wall:  57%|#####7    | 1724/3000 [48:14<26:00,  1.22s/it, lr: 1.0e-04 loss: 3.375e-01]
a-cold-wall:  57%|#####7    | 1724/3000 [48:15<26:00,  1.22s/it, lr: 1.0e-04 loss: 5.342e-01]
a-cold-wall:  57%|#####7    | 1724/3000 [48:15<26:00,  1.22s/it, lr: 1.0e-04 loss: 5.342e-01]
a-cold-wall:  57%|#####7    | 1725/3000 [48:15<23:12,  1.09s/it, lr: 1.0e-04 loss: 5.342e-01]
a-cold-wall:  57%|#####7    | 1725/3000 [48:15<23:12,  1.09s/it, lr: 1.0e-04 loss: 5.342e-01]
a-cold-wall:  57%|#####7    | 1725/3000 [48:16<23:12,  1.09s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  57%|#####7    | 1725/3000 [48:16<23:12,  1.09s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  58%|#####7    | 1726/3000 [48:16<25:08,  1.18s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  58%|#####7    | 1726/3000 [48:16<25:08,  1.18s/it, lr: 1.0e-04 loss: 2.523e-01]
a-cold-wall:  58%|#####7    | 1726/3000 [48:19<25:08,  1.18s/it, lr: 1.0e-04 loss: 9.393e-02]
a-cold-wall:  58%|#####7    | 1726/3000 [48:19<25:08,  1.18s/it, lr: 1.0e-04 loss: 9.393e-02]
a-cold-wall:  58%|#####7    | 1727/3000 [48:19<35:48,  1.69s/it, lr: 1.0e-04 loss: 9.393e-02]
a-cold-wall:  58%|#####7    | 1727/3000 [48:19<35:48,  1.69s/it, lr: 1.0e-04 loss: 9.393e-02]
a-cold-wall:  58%|#####7    | 1727/3000 [48:20<35:48,  1.69s/it, lr: 1.0e-04 loss: 7.420e-01]
a-cold-wall:  58%|#####7    | 1727/3000 [48:20<35:48,  1.69s/it, lr: 1.0e-04 loss: 7.420e-01]
a-cold-wall:  58%|#####7    | 1728/3000 [48:20<30:03,  1.42s/it, lr: 1.0e-04 loss: 7.420e-01]
a-cold-wall:  58%|#####7    | 1728/3000 [48:20<30:03,  1.42s/it, lr: 1.0e-04 loss: 7.420e-01]
a-cold-wall:  58%|#####7    | 1728/3000 [48:21<30:03,  1.42s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  58%|#####7    | 1728/3000 [48:21<30:03,  1.42s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  58%|#####7    | 1729/3000 [48:21<30:10,  1.42s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  58%|#####7    | 1729/3000 [48:21<30:10,  1.42s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  58%|#####7    | 1729/3000 [48:22<30:10,  1.42s/it, lr: 1.0e-04 loss: 3.382e-01]
a-cold-wall:  58%|#####7    | 1729/3000 [48:22<30:10,  1.42s/it, lr: 1.0e-04 loss: 3.382e-01]
a-cold-wall:  58%|#####7    | 1730/3000 [48:25<30:09,  1.42s/it, lr: 1.0e-04 loss: 4.286e-01]
a-cold-wall:  58%|#####7    | 1730/3000 [48:25<30:09,  1.42s/it, lr: 1.0e-04 loss: 4.286e-01]
a-cold-wall:  58%|#####7    | 1731/3000 [48:25<30:16,  1.43s/it, lr: 1.0e-04 loss: 4.286e-01]
a-cold-wall:  58%|#####7    | 1731/3000 [48:25<30:16,  1.43s/it, lr: 1.0e-04 loss: 4.286e-01]
a-cold-wall:  58%|#####7    | 1731/3000 [48:26<30:16,  1.43s/it, lr: 1.0e-04 loss: 3.072e-01]
a-cold-wall:  58%|#####7    | 1731/3000 [48:26<30:16,  1.43s/it, lr: 1.0e-04 loss: 3.072e-01]
a-cold-wall:  58%|#####7    | 1732/3000 [48:26<30:45,  1.46s/it, lr: 1.0e-04 loss: 3.072e-01]
a-cold-wall:  58%|#####7    | 1732/3000 [48:26<30:45,  1.46s/it, lr: 1.0e-04 loss: 3.072e-01]
a-cold-wall:  58%|#####7    | 1732/3000 [48:29<30:45,  1.46s/it, lr: 1.0e-04 loss: 2.367e-01]
a-cold-wall:  58%|#####7    | 1732/3000 [48:29<30:45,  1.46s/it, lr: 1.0e-04 loss: 2.367e-01]
a-cold-wall:  58%|#####7    | 1733/3000 [48:29<38:55,  1.84s/it, lr: 1.0e-04 loss: 2.367e-01]
a-cold-wall:  58%|#####7    | 1733/3000 [48:29<38:55,  1.84s/it, lr: 1.0e-04 loss: 2.367e-01]
a-cold-wall:  58%|#####7    | 1733/3000 [48:32<38:55,  1.84s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  58%|#####7    | 1733/3000 [48:32<38:55,  1.84s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  58%|#####7    | 1734/3000 [48:32<44:40,  2.12s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  58%|#####7    | 1734/3000 [48:32<44:40,  2.12s/it, lr: 1.0e-04 loss: 4.082e-01]
a-cold-wall:  58%|#####7    | 1734/3000 [48:35<44:40,  2.12s/it, lr: 1.0e-04 loss: 6.595e-01]
a-cold-wall:  58%|#####7    | 1734/3000 [48:35<44:40,  2.12s/it, lr: 1.0e-04 loss: 6.595e-01]
a-cold-wall:  58%|#####7    | 1735/3000 [48:35<49:00,  2.32s/it, lr: 1.0e-04 loss: 6.595e-01]
a-cold-wall:  58%|#####7    | 1735/3000 [48:35<49:00,  2.32s/it, lr: 1.0e-04 loss: 6.595e-01]
a-cold-wall:  58%|#####7    | 1735/3000 [48:36<49:00,  2.32s/it, lr: 1.0e-04 loss: 3.569e-01]
a-cold-wall:  58%|#####7    | 1735/3000 [48:36<49:00,  2.32s/it, lr: 1.0e-04 loss: 3.569e-01]
a-cold-wall:  58%|#####7    | 1736/3000 [48:36<43:35,  2.07s/it, lr: 1.0e-04 loss: 3.569e-01]
a-cold-wall:  58%|#####7    | 1736/3000 [48:36<43:35,  2.07s/it, lr: 1.0e-04 loss: 3.569e-01]
a-cold-wall:  58%|#####7    | 1736/3000 [48:38<43:35,  2.07s/it, lr: 1.0e-04 loss: 3.674e-01]
a-cold-wall:  58%|#####7    | 1736/3000 [48:38<43:35,  2.07s/it, lr: 1.0e-04 loss: 3.674e-01]
a-cold-wall:  58%|#####7    | 1737/3000 [48:38<39:39,  1.88s/it, lr: 1.0e-04 loss: 3.674e-01]
a-cold-wall:  58%|#####7    | 1737/3000 [48:38<39:39,  1.88s/it, lr: 1.0e-04 loss: 3.674e-01]
a-cold-wall:  58%|#####7    | 1737/3000 [48:39<39:39,  1.88s/it, lr: 1.0e-04 loss: 6.125e-01]
a-cold-wall:  58%|#####7    | 1737/3000 [48:39<39:39,  1.88s/it, lr: 1.0e-04 loss: 6.125e-01]
a-cold-wall:  58%|#####7    | 1738/3000 [48:39<36:46,  1.75s/it, lr: 1.0e-04 loss: 6.125e-01]
a-cold-wall:  58%|#####7    | 1738/3000 [48:39<36:46,  1.75s/it, lr: 1.0e-04 loss: 6.125e-01]
a-cold-wall:  58%|#####7    | 1738/3000 [48:42<36:46,  1.75s/it, lr: 1.0e-04 loss: 1.684e-01]
a-cold-wall:  58%|#####7    | 1738/3000 [48:42<36:46,  1.75s/it, lr: 1.0e-04 loss: 1.684e-01]
a-cold-wall:  58%|#####7    | 1739/3000 [48:42<43:52,  2.09s/it, lr: 1.0e-04 loss: 1.684e-01]
a-cold-wall:  58%|#####7    | 1739/3000 [48:42<43:52,  2.09s/it, lr: 1.0e-04 loss: 1.684e-01]
a-cold-wall:  58%|#####7    | 1739/3000 [48:45<43:52,  2.09s/it, lr: 1.0e-04 loss: 6.832e-02]
a-cold-wall:  58%|#####7    | 1739/3000 [48:45<43:52,  2.09s/it, lr: 1.0e-04 loss: 6.832e-02]
a-cold-wall:  58%|#####8    | 1740/3000 [48:46<43:50,  2.09s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  58%|#####8    | 1740/3000 [48:46<43:50,  2.09s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  58%|#####8    | 1741/3000 [48:46<27:24,  1.31s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  58%|#####8    | 1741/3000 [48:46<27:24,  1.31s/it, lr: 1.0e-04 loss: 5.031e-01]
a-cold-wall:  58%|#####8    | 1741/3000 [48:47<27:24,  1.31s/it, lr: 1.0e-04 loss: 3.327e-01]
a-cold-wall:  58%|#####8    | 1741/3000 [48:47<27:24,  1.31s/it, lr: 1.0e-04 loss: 3.327e-01]
a-cold-wall:  58%|#####8    | 1742/3000 [48:47<28:01,  1.34s/it, lr: 1.0e-04 loss: 3.327e-01]
a-cold-wall:  58%|#####8    | 1742/3000 [48:47<28:01,  1.34s/it, lr: 1.0e-04 loss: 3.327e-01]
a-cold-wall:  58%|#####8    | 1742/3000 [48:48<28:01,  1.34s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  58%|#####8    | 1742/3000 [48:48<28:01,  1.34s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  58%|#####8    | 1743/3000 [48:48<24:51,  1.19s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  58%|#####8    | 1743/3000 [48:48<24:51,  1.19s/it, lr: 1.0e-04 loss: 1.514e-01]
a-cold-wall:  58%|#####8    | 1743/3000 [48:49<24:51,  1.19s/it, lr: 1.0e-04 loss: 4.098e-01]
a-cold-wall:  58%|#####8    | 1743/3000 [48:49<24:51,  1.19s/it, lr: 1.0e-04 loss: 4.098e-01]
a-cold-wall:  58%|#####8    | 1744/3000 [48:49<22:22,  1.07s/it, lr: 1.0e-04 loss: 4.098e-01]
a-cold-wall:  58%|#####8    | 1744/3000 [48:49<22:22,  1.07s/it, lr: 1.0e-04 loss: 4.098e-01]
a-cold-wall:  58%|#####8    | 1744/3000 [48:50<22:22,  1.07s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  58%|#####8    | 1744/3000 [48:50<22:22,  1.07s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  58%|#####8    | 1745/3000 [48:50<20:36,  1.02it/s, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  58%|#####8    | 1745/3000 [48:50<20:36,  1.02it/s, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  58%|#####8    | 1745/3000 [48:53<20:36,  1.02it/s, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  58%|#####8    | 1745/3000 [48:53<20:36,  1.02it/s, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  58%|#####8    | 1746/3000 [48:53<32:08,  1.54s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  58%|#####8    | 1746/3000 [48:53<32:08,  1.54s/it, lr: 1.0e-04 loss: 5.299e-01]
a-cold-wall:  58%|#####8    | 1746/3000 [48:54<32:08,  1.54s/it, lr: 1.0e-04 loss: 6.062e-01]
a-cold-wall:  58%|#####8    | 1746/3000 [48:54<32:08,  1.54s/it, lr: 1.0e-04 loss: 6.062e-01]
a-cold-wall:  58%|#####8    | 1747/3000 [48:54<31:33,  1.51s/it, lr: 1.0e-04 loss: 6.062e-01]
a-cold-wall:  58%|#####8    | 1747/3000 [48:54<31:33,  1.51s/it, lr: 1.0e-04 loss: 6.062e-01]
a-cold-wall:  58%|#####8    | 1747/3000 [48:55<31:33,  1.51s/it, lr: 1.0e-04 loss: 2.695e-01]
a-cold-wall:  58%|#####8    | 1747/3000 [48:55<31:33,  1.51s/it, lr: 1.0e-04 loss: 2.695e-01]
a-cold-wall:  58%|#####8    | 1748/3000 [48:55<28:15,  1.35s/it, lr: 1.0e-04 loss: 2.695e-01]
a-cold-wall:  58%|#####8    | 1748/3000 [48:55<28:15,  1.35s/it, lr: 1.0e-04 loss: 2.695e-01]
a-cold-wall:  58%|#####8    | 1748/3000 [48:58<28:15,  1.35s/it, lr: 1.0e-04 loss: 4.588e-01]
a-cold-wall:  58%|#####8    | 1748/3000 [48:58<28:15,  1.35s/it, lr: 1.0e-04 loss: 4.588e-01]
a-cold-wall:  58%|#####8    | 1749/3000 [48:58<37:46,  1.81s/it, lr: 1.0e-04 loss: 4.588e-01]
a-cold-wall:  58%|#####8    | 1749/3000 [48:58<37:46,  1.81s/it, lr: 1.0e-04 loss: 4.588e-01]
a-cold-wall:  58%|#####8    | 1749/3000 [48:59<37:46,  1.81s/it, lr: 1.0e-04 loss: 1.038e-01]
a-cold-wall:  58%|#####8    | 1749/3000 [48:59<37:46,  1.81s/it, lr: 1.0e-04 loss: 1.038e-01]
Saving at step 1750
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000001750.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000000750.safetensors

a-cold-wall:  58%|#####8    | 1750/3000 [49:00<37:45,  1.81s/it, lr: 1.0e-04 loss: 4.281e-01]
a-cold-wall:  58%|#####8    | 1750/3000 [49:00<37:45,  1.81s/it, lr: 1.0e-04 loss: 4.281e-01]
a-cold-wall:  58%|#####8    | 1751/3000 [49:00<28:18,  1.36s/it, lr: 1.0e-04 loss: 4.281e-01]
a-cold-wall:  58%|#####8    | 1751/3000 [49:00<28:18,  1.36s/it, lr: 1.0e-04 loss: 4.281e-01]
a-cold-wall:  58%|#####8    | 1751/3000 [49:01<28:18,  1.36s/it, lr: 1.0e-04 loss: 3.911e-01]
a-cold-wall:  58%|#####8    | 1751/3000 [49:01<28:18,  1.36s/it, lr: 1.0e-04 loss: 3.911e-01]
a-cold-wall:  58%|#####8    | 1752/3000 [49:01<25:07,  1.21s/it, lr: 1.0e-04 loss: 3.911e-01]
a-cold-wall:  58%|#####8    | 1752/3000 [49:01<25:07,  1.21s/it, lr: 1.0e-04 loss: 3.911e-01]
a-cold-wall:  58%|#####8    | 1752/3000 [49:02<25:07,  1.21s/it, lr: 1.0e-04 loss: 7.388e-01]
a-cold-wall:  58%|#####8    | 1752/3000 [49:02<25:07,  1.21s/it, lr: 1.0e-04 loss: 7.388e-01]
a-cold-wall:  58%|#####8    | 1753/3000 [49:02<26:19,  1.27s/it, lr: 1.0e-04 loss: 7.388e-01]
a-cold-wall:  58%|#####8    | 1753/3000 [49:02<26:19,  1.27s/it, lr: 1.0e-04 loss: 7.388e-01]
a-cold-wall:  58%|#####8    | 1753/3000 [49:05<26:19,  1.27s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  58%|#####8    | 1753/3000 [49:05<26:19,  1.27s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  58%|#####8    | 1754/3000 [49:05<35:27,  1.71s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  58%|#####8    | 1754/3000 [49:05<35:27,  1.71s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  58%|#####8    | 1754/3000 [49:06<35:27,  1.71s/it, lr: 1.0e-04 loss: 2.845e-01]
a-cold-wall:  58%|#####8    | 1754/3000 [49:06<35:27,  1.71s/it, lr: 1.0e-04 loss: 2.845e-01]
a-cold-wall:  58%|#####8    | 1755/3000 [49:06<29:52,  1.44s/it, lr: 1.0e-04 loss: 2.845e-01]
a-cold-wall:  58%|#####8    | 1755/3000 [49:06<29:52,  1.44s/it, lr: 1.0e-04 loss: 2.845e-01]
a-cold-wall:  58%|#####8    | 1755/3000 [49:07<29:52,  1.44s/it, lr: 1.0e-04 loss: 7.604e-01]
a-cold-wall:  58%|#####8    | 1755/3000 [49:07<29:52,  1.44s/it, lr: 1.0e-04 loss: 7.604e-01]
a-cold-wall:  59%|#####8    | 1756/3000 [49:07<25:47,  1.24s/it, lr: 1.0e-04 loss: 7.604e-01]
a-cold-wall:  59%|#####8    | 1756/3000 [49:07<25:47,  1.24s/it, lr: 1.0e-04 loss: 7.604e-01]
a-cold-wall:  59%|#####8    | 1756/3000 [49:08<25:47,  1.24s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  59%|#####8    | 1756/3000 [49:08<25:47,  1.24s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  59%|#####8    | 1757/3000 [49:08<26:51,  1.30s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  59%|#####8    | 1757/3000 [49:08<26:51,  1.30s/it, lr: 1.0e-04 loss: 1.965e-01]
a-cold-wall:  59%|#####8    | 1757/3000 [49:11<26:51,  1.30s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  59%|#####8    | 1757/3000 [49:11<26:51,  1.30s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  59%|#####8    | 1758/3000 [49:11<36:09,  1.75s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  59%|#####8    | 1758/3000 [49:11<36:09,  1.75s/it, lr: 1.0e-04 loss: 4.402e-01]
a-cold-wall:  59%|#####8    | 1758/3000 [49:12<36:09,  1.75s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  59%|#####8    | 1758/3000 [49:12<36:09,  1.75s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  59%|#####8    | 1759/3000 [49:12<31:22,  1.52s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  59%|#####8    | 1759/3000 [49:12<31:22,  1.52s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  59%|#####8    | 1759/3000 [49:14<31:22,  1.52s/it, lr: 1.0e-04 loss: 3.094e-02]
a-cold-wall:  59%|#####8    | 1759/3000 [49:14<31:22,  1.52s/it, lr: 1.0e-04 loss: 3.094e-02]
a-cold-wall:  59%|#####8    | 1760/3000 [49:14<31:20,  1.52s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  59%|#####8    | 1760/3000 [49:14<31:20,  1.52s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  59%|#####8    | 1761/3000 [49:14<20:32,  1.01it/s, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  59%|#####8    | 1761/3000 [49:14<20:32,  1.01it/s, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  59%|#####8    | 1761/3000 [49:17<20:32,  1.01it/s, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  59%|#####8    | 1761/3000 [49:17<20:32,  1.01it/s, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  59%|#####8    | 1762/3000 [49:17<29:56,  1.45s/it, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  59%|#####8    | 1762/3000 [49:17<29:56,  1.45s/it, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  59%|#####8    | 1762/3000 [49:18<29:56,  1.45s/it, lr: 1.0e-04 loss: 4.303e-01]
a-cold-wall:  59%|#####8    | 1762/3000 [49:18<29:56,  1.45s/it, lr: 1.0e-04 loss: 4.303e-01]
a-cold-wall:  59%|#####8    | 1763/3000 [49:18<27:21,  1.33s/it, lr: 1.0e-04 loss: 4.303e-01]
a-cold-wall:  59%|#####8    | 1763/3000 [49:18<27:21,  1.33s/it, lr: 1.0e-04 loss: 4.303e-01]
a-cold-wall:  59%|#####8    | 1763/3000 [49:21<27:21,  1.33s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  59%|#####8    | 1763/3000 [49:21<27:21,  1.33s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  59%|#####8    | 1764/3000 [49:21<35:44,  1.73s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  59%|#####8    | 1764/3000 [49:21<35:44,  1.73s/it, lr: 1.0e-04 loss: 7.371e-01]
a-cold-wall:  59%|#####8    | 1764/3000 [49:22<35:44,  1.73s/it, lr: 1.0e-04 loss: 1.195e-01]
a-cold-wall:  59%|#####8    | 1764/3000 [49:22<35:44,  1.73s/it, lr: 1.0e-04 loss: 1.195e-01]
a-cold-wall:  59%|#####8    | 1765/3000 [49:22<33:54,  1.65s/it, lr: 1.0e-04 loss: 1.195e-01]
a-cold-wall:  59%|#####8    | 1765/3000 [49:22<33:54,  1.65s/it, lr: 1.0e-04 loss: 1.195e-01]
a-cold-wall:  59%|#####8    | 1765/3000 [49:25<33:54,  1.65s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  59%|#####8    | 1765/3000 [49:25<33:54,  1.65s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  59%|#####8    | 1766/3000 [49:25<41:03,  2.00s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  59%|#####8    | 1766/3000 [49:25<41:03,  2.00s/it, lr: 1.0e-04 loss: 5.906e-01]
a-cold-wall:  59%|#####8    | 1766/3000 [49:28<41:03,  2.00s/it, lr: 1.0e-04 loss: 5.761e-01]
a-cold-wall:  59%|#####8    | 1766/3000 [49:28<41:03,  2.00s/it, lr: 1.0e-04 loss: 5.761e-01]
a-cold-wall:  59%|#####8    | 1767/3000 [49:28<46:17,  2.25s/it, lr: 1.0e-04 loss: 5.761e-01]
a-cold-wall:  59%|#####8    | 1767/3000 [49:28<46:17,  2.25s/it, lr: 1.0e-04 loss: 5.761e-01]
a-cold-wall:  59%|#####8    | 1767/3000 [49:29<46:17,  2.25s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  59%|#####8    | 1767/3000 [49:29<46:17,  2.25s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  59%|#####8    | 1768/3000 [49:29<37:43,  1.84s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  59%|#####8    | 1768/3000 [49:29<37:43,  1.84s/it, lr: 1.0e-04 loss: 2.145e-01]
a-cold-wall:  59%|#####8    | 1768/3000 [49:30<37:43,  1.84s/it, lr: 1.0e-04 loss: 4.696e-01]
a-cold-wall:  59%|#####8    | 1768/3000 [49:30<37:43,  1.84s/it, lr: 1.0e-04 loss: 4.696e-01]
a-cold-wall:  59%|#####8    | 1769/3000 [49:30<31:08,  1.52s/it, lr: 1.0e-04 loss: 4.696e-01]
a-cold-wall:  59%|#####8    | 1769/3000 [49:30<31:08,  1.52s/it, lr: 1.0e-04 loss: 4.696e-01]
a-cold-wall:  59%|#####8    | 1769/3000 [49:30<31:08,  1.52s/it, lr: 1.0e-04 loss: 4.355e-01]
a-cold-wall:  59%|#####8    | 1769/3000 [49:30<31:08,  1.52s/it, lr: 1.0e-04 loss: 4.355e-01]
a-cold-wall:  59%|#####8    | 1770/3000 [49:31<31:06,  1.52s/it, lr: 1.0e-04 loss: 3.948e-01]
a-cold-wall:  59%|#####8    | 1770/3000 [49:31<31:06,  1.52s/it, lr: 1.0e-04 loss: 3.948e-01]
a-cold-wall:  59%|#####9    | 1771/3000 [49:31<20:26,  1.00it/s, lr: 1.0e-04 loss: 3.948e-01]
a-cold-wall:  59%|#####9    | 1771/3000 [49:31<20:26,  1.00it/s, lr: 1.0e-04 loss: 3.948e-01]
a-cold-wall:  59%|#####9    | 1771/3000 [49:34<20:26,  1.00it/s, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  59%|#####9    | 1771/3000 [49:34<20:26,  1.00it/s, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  59%|#####9    | 1772/3000 [49:34<29:54,  1.46s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  59%|#####9    | 1772/3000 [49:34<29:54,  1.46s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  59%|#####9    | 1772/3000 [49:35<29:54,  1.46s/it, lr: 1.0e-04 loss: 1.051e-01]
a-cold-wall:  59%|#####9    | 1772/3000 [49:35<29:54,  1.46s/it, lr: 1.0e-04 loss: 1.051e-01]
a-cold-wall:  59%|#####9    | 1773/3000 [49:35<29:36,  1.45s/it, lr: 1.0e-04 loss: 1.051e-01]
a-cold-wall:  59%|#####9    | 1773/3000 [49:35<29:36,  1.45s/it, lr: 1.0e-04 loss: 1.051e-01]
a-cold-wall:  59%|#####9    | 1773/3000 [49:36<29:36,  1.45s/it, lr: 1.0e-04 loss: 1.575e-01]
a-cold-wall:  59%|#####9    | 1773/3000 [49:36<29:36,  1.45s/it, lr: 1.0e-04 loss: 1.575e-01]
a-cold-wall:  59%|#####9    | 1774/3000 [49:36<25:40,  1.26s/it, lr: 1.0e-04 loss: 1.575e-01]
a-cold-wall:  59%|#####9    | 1774/3000 [49:36<25:40,  1.26s/it, lr: 1.0e-04 loss: 1.575e-01]
a-cold-wall:  59%|#####9    | 1774/3000 [49:39<25:40,  1.26s/it, lr: 1.0e-04 loss: 4.050e-01]
a-cold-wall:  59%|#####9    | 1774/3000 [49:39<25:40,  1.26s/it, lr: 1.0e-04 loss: 4.050e-01]
a-cold-wall:  59%|#####9    | 1775/3000 [49:39<34:42,  1.70s/it, lr: 1.0e-04 loss: 4.050e-01]
a-cold-wall:  59%|#####9    | 1775/3000 [49:39<34:42,  1.70s/it, lr: 1.0e-04 loss: 4.050e-01]
a-cold-wall:  59%|#####9    | 1775/3000 [49:40<34:42,  1.70s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  59%|#####9    | 1775/3000 [49:40<34:42,  1.70s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  59%|#####9    | 1776/3000 [49:40<33:04,  1.62s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  59%|#####9    | 1776/3000 [49:40<33:04,  1.62s/it, lr: 1.0e-04 loss: 7.725e-01]
a-cold-wall:  59%|#####9    | 1776/3000 [49:42<33:04,  1.62s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  59%|#####9    | 1776/3000 [49:42<33:04,  1.62s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  59%|#####9    | 1777/3000 [49:42<31:53,  1.56s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  59%|#####9    | 1777/3000 [49:42<31:53,  1.56s/it, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  59%|#####9    | 1777/3000 [49:45<31:53,  1.56s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  59%|#####9    | 1777/3000 [49:45<31:53,  1.56s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  59%|#####9    | 1778/3000 [49:45<40:15,  1.98s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  59%|#####9    | 1778/3000 [49:45<40:15,  1.98s/it, lr: 1.0e-04 loss: 5.769e-01]
a-cold-wall:  59%|#####9    | 1778/3000 [49:48<40:15,  1.98s/it, lr: 1.0e-04 loss: 1.977e-01]
a-cold-wall:  59%|#####9    | 1778/3000 [49:48<40:15,  1.98s/it, lr: 1.0e-04 loss: 1.977e-01]
a-cold-wall:  59%|#####9    | 1779/3000 [49:48<45:36,  2.24s/it, lr: 1.0e-04 loss: 1.977e-01]
a-cold-wall:  59%|#####9    | 1779/3000 [49:48<45:36,  2.24s/it, lr: 1.0e-04 loss: 1.977e-01]
a-cold-wall:  59%|#####9    | 1779/3000 [49:49<45:36,  2.24s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  59%|#####9    | 1779/3000 [49:49<45:36,  2.24s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  59%|#####9    | 1780/3000 [49:52<45:34,  2.24s/it, lr: 1.0e-04 loss: 4.107e-01]
a-cold-wall:  59%|#####9    | 1780/3000 [49:52<45:34,  2.24s/it, lr: 1.0e-04 loss: 4.107e-01]
a-cold-wall:  59%|#####9    | 1781/3000 [49:52<37:55,  1.87s/it, lr: 1.0e-04 loss: 4.107e-01]
a-cold-wall:  59%|#####9    | 1781/3000 [49:52<37:55,  1.87s/it, lr: 1.0e-04 loss: 4.107e-01]
a-cold-wall:  59%|#####9    | 1781/3000 [49:53<37:55,  1.87s/it, lr: 1.0e-04 loss: 4.788e-01]
a-cold-wall:  59%|#####9    | 1781/3000 [49:53<37:55,  1.87s/it, lr: 1.0e-04 loss: 4.788e-01]
a-cold-wall:  59%|#####9    | 1782/3000 [49:53<32:16,  1.59s/it, lr: 1.0e-04 loss: 4.788e-01]
a-cold-wall:  59%|#####9    | 1782/3000 [49:53<32:16,  1.59s/it, lr: 1.0e-04 loss: 4.788e-01]
a-cold-wall:  59%|#####9    | 1782/3000 [49:54<32:16,  1.59s/it, lr: 1.0e-04 loss: 2.373e-01]
a-cold-wall:  59%|#####9    | 1782/3000 [49:54<32:16,  1.59s/it, lr: 1.0e-04 loss: 2.373e-01]
a-cold-wall:  59%|#####9    | 1783/3000 [49:54<31:17,  1.54s/it, lr: 1.0e-04 loss: 2.373e-01]
a-cold-wall:  59%|#####9    | 1783/3000 [49:54<31:17,  1.54s/it, lr: 1.0e-04 loss: 2.373e-01]
a-cold-wall:  59%|#####9    | 1783/3000 [49:56<31:17,  1.54s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  59%|#####9    | 1783/3000 [49:56<31:17,  1.54s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  59%|#####9    | 1784/3000 [49:56<30:36,  1.51s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  59%|#####9    | 1784/3000 [49:56<30:36,  1.51s/it, lr: 1.0e-04 loss: 3.242e-01]
a-cold-wall:  59%|#####9    | 1784/3000 [49:57<30:36,  1.51s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:  59%|#####9    | 1784/3000 [49:57<30:36,  1.51s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:  60%|#####9    | 1785/3000 [49:57<30:21,  1.50s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:  60%|#####9    | 1785/3000 [49:57<30:21,  1.50s/it, lr: 1.0e-04 loss: 4.723e-01]
a-cold-wall:  60%|#####9    | 1785/3000 [50:00<30:21,  1.50s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  60%|#####9    | 1785/3000 [50:00<30:21,  1.50s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  60%|#####9    | 1786/3000 [50:00<38:06,  1.88s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  60%|#####9    | 1786/3000 [50:00<38:06,  1.88s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  60%|#####9    | 1786/3000 [50:03<38:06,  1.88s/it, lr: 1.0e-04 loss: 1.730e-01]
a-cold-wall:  60%|#####9    | 1786/3000 [50:03<38:06,  1.88s/it, lr: 1.0e-04 loss: 1.730e-01]
a-cold-wall:  60%|#####9    | 1787/3000 [50:03<43:56,  2.17s/it, lr: 1.0e-04 loss: 1.730e-01]
a-cold-wall:  60%|#####9    | 1787/3000 [50:03<43:56,  2.17s/it, lr: 1.0e-04 loss: 1.730e-01]
a-cold-wall:  60%|#####9    | 1787/3000 [50:05<43:56,  2.17s/it, lr: 1.0e-04 loss: 4.431e-02]
a-cold-wall:  60%|#####9    | 1787/3000 [50:05<43:56,  2.17s/it, lr: 1.0e-04 loss: 4.431e-02]
a-cold-wall:  60%|#####9    | 1788/3000 [50:05<39:30,  1.96s/it, lr: 1.0e-04 loss: 4.431e-02]
a-cold-wall:  60%|#####9    | 1788/3000 [50:05<39:30,  1.96s/it, lr: 1.0e-04 loss: 4.431e-02]
a-cold-wall:  60%|#####9    | 1788/3000 [50:06<39:30,  1.96s/it, lr: 1.0e-04 loss: 6.143e-01]
a-cold-wall:  60%|#####9    | 1788/3000 [50:06<39:30,  1.96s/it, lr: 1.0e-04 loss: 6.143e-01]
a-cold-wall:  60%|#####9    | 1789/3000 [50:06<36:15,  1.80s/it, lr: 1.0e-04 loss: 6.143e-01]
a-cold-wall:  60%|#####9    | 1789/3000 [50:06<36:15,  1.80s/it, lr: 1.0e-04 loss: 6.143e-01]
a-cold-wall:  60%|#####9    | 1789/3000 [50:08<36:15,  1.80s/it, lr: 1.0e-04 loss: 4.068e-01]
a-cold-wall:  60%|#####9    | 1789/3000 [50:08<36:15,  1.80s/it, lr: 1.0e-04 loss: 4.068e-01]
a-cold-wall:  60%|#####9    | 1790/3000 [50:08<36:14,  1.80s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  60%|#####9    | 1790/3000 [50:08<36:14,  1.80s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  60%|#####9    | 1791/3000 [50:08<23:08,  1.15s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  60%|#####9    | 1791/3000 [50:08<23:08,  1.15s/it, lr: 1.0e-04 loss: 1.269e-01]
a-cold-wall:  60%|#####9    | 1791/3000 [50:11<23:08,  1.15s/it, lr: 1.0e-04 loss: 1.548e-01]
a-cold-wall:  60%|#####9    | 1791/3000 [50:11<23:08,  1.15s/it, lr: 1.0e-04 loss: 1.548e-01]
a-cold-wall:  60%|#####9    | 1792/3000 [50:11<32:47,  1.63s/it, lr: 1.0e-04 loss: 1.548e-01]
a-cold-wall:  60%|#####9    | 1792/3000 [50:11<32:47,  1.63s/it, lr: 1.0e-04 loss: 1.548e-01]
a-cold-wall:  60%|#####9    | 1792/3000 [50:12<32:47,  1.63s/it, lr: 1.0e-04 loss: 6.905e-01]
a-cold-wall:  60%|#####9    | 1792/3000 [50:12<32:47,  1.63s/it, lr: 1.0e-04 loss: 6.905e-01]
a-cold-wall:  60%|#####9    | 1793/3000 [50:12<28:10,  1.40s/it, lr: 1.0e-04 loss: 6.905e-01]
a-cold-wall:  60%|#####9    | 1793/3000 [50:12<28:10,  1.40s/it, lr: 1.0e-04 loss: 6.905e-01]
a-cold-wall:  60%|#####9    | 1793/3000 [50:14<28:10,  1.40s/it, lr: 1.0e-04 loss: 5.020e-02]
a-cold-wall:  60%|#####9    | 1793/3000 [50:14<28:10,  1.40s/it, lr: 1.0e-04 loss: 5.020e-02]
a-cold-wall:  60%|#####9    | 1794/3000 [50:14<28:18,  1.41s/it, lr: 1.0e-04 loss: 5.020e-02]
a-cold-wall:  60%|#####9    | 1794/3000 [50:14<28:18,  1.41s/it, lr: 1.0e-04 loss: 5.020e-02]
a-cold-wall:  60%|#####9    | 1794/3000 [50:15<28:18,  1.41s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  60%|#####9    | 1794/3000 [50:15<28:18,  1.41s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  60%|#####9    | 1795/3000 [50:15<28:22,  1.41s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  60%|#####9    | 1795/3000 [50:15<28:22,  1.41s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  60%|#####9    | 1795/3000 [50:16<28:22,  1.41s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  60%|#####9    | 1795/3000 [50:16<28:22,  1.41s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  60%|#####9    | 1796/3000 [50:16<24:35,  1.23s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  60%|#####9    | 1796/3000 [50:16<24:35,  1.23s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  60%|#####9    | 1796/3000 [50:17<24:35,  1.23s/it, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  60%|#####9    | 1796/3000 [50:17<24:35,  1.23s/it, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  60%|#####9    | 1797/3000 [50:17<25:45,  1.28s/it, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  60%|#####9    | 1797/3000 [50:17<25:45,  1.28s/it, lr: 1.0e-04 loss: 3.285e-01]
a-cold-wall:  60%|#####9    | 1797/3000 [50:18<25:45,  1.28s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  60%|#####9    | 1797/3000 [50:18<25:45,  1.28s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  60%|#####9    | 1798/3000 [50:18<22:39,  1.13s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  60%|#####9    | 1798/3000 [50:18<22:39,  1.13s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  60%|#####9    | 1798/3000 [50:19<22:39,  1.13s/it, lr: 1.0e-04 loss: 1.446e-01]
a-cold-wall:  60%|#####9    | 1798/3000 [50:19<22:39,  1.13s/it, lr: 1.0e-04 loss: 1.446e-01]
a-cold-wall:  60%|#####9    | 1799/3000 [50:19<24:23,  1.22s/it, lr: 1.0e-04 loss: 1.446e-01]
a-cold-wall:  60%|#####9    | 1799/3000 [50:19<24:23,  1.22s/it, lr: 1.0e-04 loss: 1.446e-01]
a-cold-wall:  60%|#####9    | 1799/3000 [50:21<24:23,  1.22s/it, lr: 1.0e-04 loss: 3.080e-01]
a-cold-wall:  60%|#####9    | 1799/3000 [50:21<24:23,  1.22s/it, lr: 1.0e-04 loss: 3.080e-01]
a-cold-wall:  60%|######    | 1800/3000 [50:22<24:22,  1.22s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  60%|######    | 1800/3000 [50:22<24:22,  1.22s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  60%|######    | 1801/3000 [50:22<16:44,  1.19it/s, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  60%|######    | 1801/3000 [50:22<16:44,  1.19it/s, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  60%|######    | 1801/3000 [50:22<16:44,  1.19it/s, lr: 1.0e-04 loss: 1.098e-01]
a-cold-wall:  60%|######    | 1801/3000 [50:22<16:44,  1.19it/s, lr: 1.0e-04 loss: 1.098e-01]
a-cold-wall:  60%|######    | 1802/3000 [50:22<16:17,  1.23it/s, lr: 1.0e-04 loss: 1.098e-01]
a-cold-wall:  60%|######    | 1802/3000 [50:22<16:17,  1.23it/s, lr: 1.0e-04 loss: 1.098e-01]
a-cold-wall:  60%|######    | 1802/3000 [50:23<16:17,  1.23it/s, lr: 1.0e-04 loss: 3.191e-01]
a-cold-wall:  60%|######    | 1802/3000 [50:23<16:17,  1.23it/s, lr: 1.0e-04 loss: 3.191e-01]
a-cold-wall:  60%|######    | 1803/3000 [50:23<16:00,  1.25it/s, lr: 1.0e-04 loss: 3.191e-01]
a-cold-wall:  60%|######    | 1803/3000 [50:23<16:00,  1.25it/s, lr: 1.0e-04 loss: 3.191e-01]
a-cold-wall:  60%|######    | 1803/3000 [50:24<16:00,  1.25it/s, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  60%|######    | 1803/3000 [50:24<16:00,  1.25it/s, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  60%|######    | 1804/3000 [50:24<16:55,  1.18it/s, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  60%|######    | 1804/3000 [50:24<16:55,  1.18it/s, lr: 1.0e-04 loss: 3.977e-01]
a-cold-wall:  60%|######    | 1804/3000 [50:27<16:55,  1.18it/s, lr: 1.0e-04 loss: 3.094e-01]
a-cold-wall:  60%|######    | 1804/3000 [50:27<16:55,  1.18it/s, lr: 1.0e-04 loss: 3.094e-01]
a-cold-wall:  60%|######    | 1805/3000 [50:27<29:29,  1.48s/it, lr: 1.0e-04 loss: 3.094e-01]
a-cold-wall:  60%|######    | 1805/3000 [50:27<29:29,  1.48s/it, lr: 1.0e-04 loss: 3.094e-01]
a-cold-wall:  60%|######    | 1805/3000 [50:30<29:29,  1.48s/it, lr: 1.0e-04 loss: 4.284e-01]
a-cold-wall:  60%|######    | 1805/3000 [50:30<29:29,  1.48s/it, lr: 1.0e-04 loss: 4.284e-01]
a-cold-wall:  60%|######    | 1806/3000 [50:30<37:38,  1.89s/it, lr: 1.0e-04 loss: 4.284e-01]
a-cold-wall:  60%|######    | 1806/3000 [50:30<37:38,  1.89s/it, lr: 1.0e-04 loss: 4.284e-01]
a-cold-wall:  60%|######    | 1806/3000 [50:33<37:38,  1.89s/it, lr: 1.0e-04 loss: 4.378e-01]
a-cold-wall:  60%|######    | 1806/3000 [50:33<37:38,  1.89s/it, lr: 1.0e-04 loss: 4.378e-01]
a-cold-wall:  60%|######    | 1807/3000 [50:33<43:03,  2.17s/it, lr: 1.0e-04 loss: 4.378e-01]
a-cold-wall:  60%|######    | 1807/3000 [50:33<43:03,  2.17s/it, lr: 1.0e-04 loss: 4.378e-01]
a-cold-wall:  60%|######    | 1807/3000 [50:34<43:03,  2.17s/it, lr: 1.0e-04 loss: 5.335e-01]
a-cold-wall:  60%|######    | 1807/3000 [50:34<43:03,  2.17s/it, lr: 1.0e-04 loss: 5.335e-01]
a-cold-wall:  60%|######    | 1808/3000 [50:34<38:37,  1.94s/it, lr: 1.0e-04 loss: 5.335e-01]
a-cold-wall:  60%|######    | 1808/3000 [50:34<38:37,  1.94s/it, lr: 1.0e-04 loss: 5.335e-01]
a-cold-wall:  60%|######    | 1808/3000 [50:35<38:37,  1.94s/it, lr: 1.0e-04 loss: 1.704e-01]
a-cold-wall:  60%|######    | 1808/3000 [50:35<38:37,  1.94s/it, lr: 1.0e-04 loss: 1.704e-01]
a-cold-wall:  60%|######    | 1809/3000 [50:35<31:37,  1.59s/it, lr: 1.0e-04 loss: 1.704e-01]
a-cold-wall:  60%|######    | 1809/3000 [50:35<31:37,  1.59s/it, lr: 1.0e-04 loss: 1.704e-01]
a-cold-wall:  60%|######    | 1809/3000 [50:36<31:37,  1.59s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  60%|######    | 1809/3000 [50:36<31:37,  1.59s/it, lr: 1.0e-04 loss: 5.168e-01]
a-cold-wall:  60%|######    | 1810/3000 [50:37<31:36,  1.59s/it, lr: 1.0e-04 loss: 6.927e-01]
a-cold-wall:  60%|######    | 1810/3000 [50:37<31:36,  1.59s/it, lr: 1.0e-04 loss: 6.927e-01]
a-cold-wall:  60%|######    | 1811/3000 [50:37<20:35,  1.04s/it, lr: 1.0e-04 loss: 6.927e-01]
a-cold-wall:  60%|######    | 1811/3000 [50:37<20:35,  1.04s/it, lr: 1.0e-04 loss: 6.927e-01]
a-cold-wall:  60%|######    | 1811/3000 [50:38<20:35,  1.04s/it, lr: 1.0e-04 loss: 6.291e-01]
a-cold-wall:  60%|######    | 1811/3000 [50:38<20:35,  1.04s/it, lr: 1.0e-04 loss: 6.291e-01]
a-cold-wall:  60%|######    | 1812/3000 [50:38<22:31,  1.14s/it, lr: 1.0e-04 loss: 6.291e-01]
a-cold-wall:  60%|######    | 1812/3000 [50:38<22:31,  1.14s/it, lr: 1.0e-04 loss: 6.291e-01]
a-cold-wall:  60%|######    | 1812/3000 [50:39<22:31,  1.14s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  60%|######    | 1812/3000 [50:39<22:31,  1.14s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  60%|######    | 1813/3000 [50:39<20:34,  1.04s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  60%|######    | 1813/3000 [50:39<20:34,  1.04s/it, lr: 1.0e-04 loss: 5.211e-01]
a-cold-wall:  60%|######    | 1813/3000 [50:40<20:34,  1.04s/it, lr: 1.0e-04 loss: 2.025e-01]
a-cold-wall:  60%|######    | 1813/3000 [50:40<20:34,  1.04s/it, lr: 1.0e-04 loss: 2.025e-01]
a-cold-wall:  60%|######    | 1814/3000 [50:40<19:03,  1.04it/s, lr: 1.0e-04 loss: 2.025e-01]
a-cold-wall:  60%|######    | 1814/3000 [50:40<19:03,  1.04it/s, lr: 1.0e-04 loss: 2.025e-01]
a-cold-wall:  60%|######    | 1814/3000 [50:42<19:03,  1.04it/s, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  60%|######    | 1814/3000 [50:42<19:03,  1.04it/s, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  60%|######    | 1815/3000 [50:42<29:33,  1.50s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  60%|######    | 1815/3000 [50:42<29:33,  1.50s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  60%|######    | 1815/3000 [50:43<29:33,  1.50s/it, lr: 1.0e-04 loss: 5.731e-01]
a-cold-wall:  60%|######    | 1815/3000 [50:43<29:33,  1.50s/it, lr: 1.0e-04 loss: 5.731e-01]
a-cold-wall:  61%|######    | 1816/3000 [50:43<25:20,  1.28s/it, lr: 1.0e-04 loss: 5.731e-01]
a-cold-wall:  61%|######    | 1816/3000 [50:43<25:20,  1.28s/it, lr: 1.0e-04 loss: 5.731e-01]
a-cold-wall:  61%|######    | 1816/3000 [50:46<25:20,  1.28s/it, lr: 1.0e-04 loss: 5.803e-01]
a-cold-wall:  61%|######    | 1816/3000 [50:46<25:20,  1.28s/it, lr: 1.0e-04 loss: 5.803e-01]
a-cold-wall:  61%|######    | 1817/3000 [50:46<34:27,  1.75s/it, lr: 1.0e-04 loss: 5.803e-01]
a-cold-wall:  61%|######    | 1817/3000 [50:46<34:27,  1.75s/it, lr: 1.0e-04 loss: 5.803e-01]
a-cold-wall:  61%|######    | 1817/3000 [50:49<34:27,  1.75s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  61%|######    | 1817/3000 [50:49<34:27,  1.75s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  61%|######    | 1818/3000 [50:49<41:16,  2.10s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  61%|######    | 1818/3000 [50:49<41:16,  2.10s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  61%|######    | 1818/3000 [50:50<41:16,  2.10s/it, lr: 1.0e-04 loss: 5.455e-01]
a-cold-wall:  61%|######    | 1818/3000 [50:50<41:16,  2.10s/it, lr: 1.0e-04 loss: 5.455e-01]
a-cold-wall:  61%|######    | 1819/3000 [50:50<37:22,  1.90s/it, lr: 1.0e-04 loss: 5.455e-01]
a-cold-wall:  61%|######    | 1819/3000 [50:50<37:22,  1.90s/it, lr: 1.0e-04 loss: 5.455e-01]
a-cold-wall:  61%|######    | 1819/3000 [50:52<37:22,  1.90s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  61%|######    | 1819/3000 [50:52<37:22,  1.90s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  61%|######    | 1820/3000 [50:53<37:20,  1.90s/it, lr: 1.0e-04 loss: 6.109e-01]
a-cold-wall:  61%|######    | 1820/3000 [50:53<37:20,  1.90s/it, lr: 1.0e-04 loss: 6.109e-01]
a-cold-wall:  61%|######    | 1821/3000 [50:53<23:41,  1.21s/it, lr: 1.0e-04 loss: 6.109e-01]
a-cold-wall:  61%|######    | 1821/3000 [50:53<23:41,  1.21s/it, lr: 1.0e-04 loss: 6.109e-01]
a-cold-wall:  61%|######    | 1821/3000 [50:55<23:41,  1.21s/it, lr: 1.0e-04 loss: 5.662e-01]
a-cold-wall:  61%|######    | 1821/3000 [50:55<23:41,  1.21s/it, lr: 1.0e-04 loss: 5.662e-01]
a-cold-wall:  61%|######    | 1822/3000 [50:55<31:42,  1.61s/it, lr: 1.0e-04 loss: 5.662e-01]
a-cold-wall:  61%|######    | 1822/3000 [50:55<31:42,  1.61s/it, lr: 1.0e-04 loss: 5.662e-01]
a-cold-wall:  61%|######    | 1822/3000 [50:58<31:42,  1.61s/it, lr: 1.0e-04 loss: 3.216e-01]
a-cold-wall:  61%|######    | 1822/3000 [50:58<31:42,  1.61s/it, lr: 1.0e-04 loss: 3.216e-01]
a-cold-wall:  61%|######    | 1823/3000 [50:58<38:05,  1.94s/it, lr: 1.0e-04 loss: 3.216e-01]
a-cold-wall:  61%|######    | 1823/3000 [50:58<38:05,  1.94s/it, lr: 1.0e-04 loss: 3.216e-01]
a-cold-wall:  61%|######    | 1823/3000 [51:01<38:05,  1.94s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:  61%|######    | 1823/3000 [51:01<38:05,  1.94s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:  61%|######    | 1824/3000 [51:01<42:47,  2.18s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:  61%|######    | 1824/3000 [51:01<42:47,  2.18s/it, lr: 1.0e-04 loss: 5.144e-01]
a-cold-wall:  61%|######    | 1824/3000 [51:02<42:47,  2.18s/it, lr: 1.0e-04 loss: 1.106e-01]
a-cold-wall:  61%|######    | 1824/3000 [51:02<42:47,  2.18s/it, lr: 1.0e-04 loss: 1.106e-01]
a-cold-wall:  61%|######    | 1825/3000 [51:02<34:57,  1.78s/it, lr: 1.0e-04 loss: 1.106e-01]
a-cold-wall:  61%|######    | 1825/3000 [51:02<34:57,  1.78s/it, lr: 1.0e-04 loss: 1.106e-01]
a-cold-wall:  61%|######    | 1825/3000 [51:03<34:57,  1.78s/it, lr: 1.0e-04 loss: 2.732e-01]
a-cold-wall:  61%|######    | 1825/3000 [51:03<34:57,  1.78s/it, lr: 1.0e-04 loss: 2.732e-01]
a-cold-wall:  61%|######    | 1826/3000 [51:03<29:07,  1.49s/it, lr: 1.0e-04 loss: 2.732e-01]
a-cold-wall:  61%|######    | 1826/3000 [51:03<29:07,  1.49s/it, lr: 1.0e-04 loss: 2.732e-01]
a-cold-wall:  61%|######    | 1826/3000 [51:03<29:07,  1.49s/it, lr: 1.0e-04 loss: 3.025e-01]
a-cold-wall:  61%|######    | 1826/3000 [51:03<29:07,  1.49s/it, lr: 1.0e-04 loss: 3.025e-01]
a-cold-wall:  61%|######    | 1827/3000 [51:03<24:48,  1.27s/it, lr: 1.0e-04 loss: 3.025e-01]
a-cold-wall:  61%|######    | 1827/3000 [51:03<24:48,  1.27s/it, lr: 1.0e-04 loss: 3.025e-01]
a-cold-wall:  61%|######    | 1827/3000 [51:04<24:48,  1.27s/it, lr: 1.0e-04 loss: 5.120e-01]
a-cold-wall:  61%|######    | 1827/3000 [51:04<24:48,  1.27s/it, lr: 1.0e-04 loss: 5.120e-01]
a-cold-wall:  61%|######    | 1828/3000 [51:04<21:46,  1.11s/it, lr: 1.0e-04 loss: 5.120e-01]
a-cold-wall:  61%|######    | 1828/3000 [51:04<21:46,  1.11s/it, lr: 1.0e-04 loss: 5.120e-01]
a-cold-wall:  61%|######    | 1828/3000 [51:06<21:46,  1.11s/it, lr: 1.0e-04 loss: 5.699e-01]
a-cold-wall:  61%|######    | 1828/3000 [51:06<21:46,  1.11s/it, lr: 1.0e-04 loss: 5.699e-01]
a-cold-wall:  61%|######    | 1829/3000 [51:06<23:30,  1.20s/it, lr: 1.0e-04 loss: 5.699e-01]
a-cold-wall:  61%|######    | 1829/3000 [51:06<23:30,  1.20s/it, lr: 1.0e-04 loss: 5.699e-01]
a-cold-wall:  61%|######    | 1829/3000 [51:06<23:30,  1.20s/it, lr: 1.0e-04 loss: 7.829e-02]
a-cold-wall:  61%|######    | 1829/3000 [51:06<23:30,  1.20s/it, lr: 1.0e-04 loss: 7.829e-02]
a-cold-wall:  61%|######1   | 1830/3000 [51:09<23:28,  1.20s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  61%|######1   | 1830/3000 [51:09<23:28,  1.20s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  61%|######1   | 1831/3000 [51:09<25:30,  1.31s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  61%|######1   | 1831/3000 [51:09<25:30,  1.31s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  61%|######1   | 1831/3000 [51:10<25:30,  1.31s/it, lr: 1.0e-04 loss: 6.610e-01]
a-cold-wall:  61%|######1   | 1831/3000 [51:10<25:30,  1.31s/it, lr: 1.0e-04 loss: 6.610e-01]
a-cold-wall:  61%|######1   | 1832/3000 [51:10<22:48,  1.17s/it, lr: 1.0e-04 loss: 6.610e-01]
a-cold-wall:  61%|######1   | 1832/3000 [51:10<22:48,  1.17s/it, lr: 1.0e-04 loss: 6.610e-01]
a-cold-wall:  61%|######1   | 1832/3000 [51:13<22:48,  1.17s/it, lr: 1.0e-04 loss: 3.878e-02]
a-cold-wall:  61%|######1   | 1832/3000 [51:13<22:48,  1.17s/it, lr: 1.0e-04 loss: 3.878e-02]
a-cold-wall:  61%|######1   | 1833/3000 [51:13<31:50,  1.64s/it, lr: 1.0e-04 loss: 3.878e-02]
a-cold-wall:  61%|######1   | 1833/3000 [51:13<31:50,  1.64s/it, lr: 1.0e-04 loss: 3.878e-02]
a-cold-wall:  61%|######1   | 1833/3000 [51:14<31:50,  1.64s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  61%|######1   | 1833/3000 [51:14<31:50,  1.64s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  61%|######1   | 1834/3000 [51:14<30:41,  1.58s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  61%|######1   | 1834/3000 [51:14<30:41,  1.58s/it, lr: 1.0e-04 loss: 3.779e-01]
a-cold-wall:  61%|######1   | 1834/3000 [51:16<30:41,  1.58s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  61%|######1   | 1834/3000 [51:16<30:41,  1.58s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  61%|######1   | 1835/3000 [51:16<29:45,  1.53s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  61%|######1   | 1835/3000 [51:16<29:45,  1.53s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  61%|######1   | 1835/3000 [51:16<29:45,  1.53s/it, lr: 1.0e-04 loss: 1.743e-01]
a-cold-wall:  61%|######1   | 1835/3000 [51:16<29:45,  1.53s/it, lr: 1.0e-04 loss: 1.743e-01]
a-cold-wall:  61%|######1   | 1836/3000 [51:16<25:23,  1.31s/it, lr: 1.0e-04 loss: 1.743e-01]
a-cold-wall:  61%|######1   | 1836/3000 [51:16<25:23,  1.31s/it, lr: 1.0e-04 loss: 1.743e-01]
a-cold-wall:  61%|######1   | 1836/3000 [51:17<25:23,  1.31s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  61%|######1   | 1836/3000 [51:17<25:23,  1.31s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  61%|######1   | 1837/3000 [51:17<22:14,  1.15s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  61%|######1   | 1837/3000 [51:17<22:14,  1.15s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  61%|######1   | 1837/3000 [51:20<22:14,  1.15s/it, lr: 1.0e-04 loss: 4.226e-01]
a-cold-wall:  61%|######1   | 1837/3000 [51:20<22:14,  1.15s/it, lr: 1.0e-04 loss: 4.226e-01]
a-cold-wall:  61%|######1   | 1838/3000 [51:20<31:48,  1.64s/it, lr: 1.0e-04 loss: 4.226e-01]
a-cold-wall:  61%|######1   | 1838/3000 [51:20<31:48,  1.64s/it, lr: 1.0e-04 loss: 4.226e-01]
a-cold-wall:  61%|######1   | 1838/3000 [51:21<31:48,  1.64s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  61%|######1   | 1838/3000 [51:21<31:48,  1.64s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  61%|######1   | 1839/3000 [51:21<26:42,  1.38s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  61%|######1   | 1839/3000 [51:21<26:42,  1.38s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  61%|######1   | 1839/3000 [51:24<26:42,  1.38s/it, lr: 1.0e-04 loss: 5.514e-01]
a-cold-wall:  61%|######1   | 1839/3000 [51:24<26:42,  1.38s/it, lr: 1.0e-04 loss: 5.514e-01]
a-cold-wall:  61%|######1   | 1840/3000 [51:25<26:41,  1.38s/it, lr: 1.0e-04 loss: 7.385e-01]
a-cold-wall:  61%|######1   | 1840/3000 [51:25<26:41,  1.38s/it, lr: 1.0e-04 loss: 7.385e-01]
a-cold-wall:  61%|######1   | 1841/3000 [51:25<20:40,  1.07s/it, lr: 1.0e-04 loss: 7.385e-01]
a-cold-wall:  61%|######1   | 1841/3000 [51:25<20:40,  1.07s/it, lr: 1.0e-04 loss: 7.385e-01]
a-cold-wall:  61%|######1   | 1841/3000 [51:26<20:40,  1.07s/it, lr: 1.0e-04 loss: 3.046e-01]
a-cold-wall:  61%|######1   | 1841/3000 [51:26<20:40,  1.07s/it, lr: 1.0e-04 loss: 3.046e-01]
a-cold-wall:  61%|######1   | 1842/3000 [51:26<19:30,  1.01s/it, lr: 1.0e-04 loss: 3.046e-01]
a-cold-wall:  61%|######1   | 1842/3000 [51:26<19:30,  1.01s/it, lr: 1.0e-04 loss: 3.046e-01]
a-cold-wall:  61%|######1   | 1842/3000 [51:27<19:30,  1.01s/it, lr: 1.0e-04 loss: 1.156e-01]
a-cold-wall:  61%|######1   | 1842/3000 [51:27<19:30,  1.01s/it, lr: 1.0e-04 loss: 1.156e-01]
a-cold-wall:  61%|######1   | 1843/3000 [51:27<21:32,  1.12s/it, lr: 1.0e-04 loss: 1.156e-01]
a-cold-wall:  61%|######1   | 1843/3000 [51:27<21:32,  1.12s/it, lr: 1.0e-04 loss: 1.156e-01]
a-cold-wall:  61%|######1   | 1843/3000 [51:29<21:32,  1.12s/it, lr: 1.0e-04 loss: 6.248e-01]
a-cold-wall:  61%|######1   | 1843/3000 [51:29<21:32,  1.12s/it, lr: 1.0e-04 loss: 6.248e-01]
a-cold-wall:  61%|######1   | 1844/3000 [51:29<23:03,  1.20s/it, lr: 1.0e-04 loss: 6.248e-01]
a-cold-wall:  61%|######1   | 1844/3000 [51:29<23:03,  1.20s/it, lr: 1.0e-04 loss: 6.248e-01]
a-cold-wall:  61%|######1   | 1844/3000 [51:29<23:03,  1.20s/it, lr: 1.0e-04 loss: 1.212e-02]
a-cold-wall:  61%|######1   | 1844/3000 [51:29<23:03,  1.20s/it, lr: 1.0e-04 loss: 1.212e-02]
a-cold-wall:  62%|######1   | 1845/3000 [51:29<20:37,  1.07s/it, lr: 1.0e-04 loss: 1.212e-02]
a-cold-wall:  62%|######1   | 1845/3000 [51:29<20:37,  1.07s/it, lr: 1.0e-04 loss: 1.212e-02]
a-cold-wall:  62%|######1   | 1845/3000 [51:31<20:37,  1.07s/it, lr: 1.0e-04 loss: 3.130e-01]
a-cold-wall:  62%|######1   | 1845/3000 [51:31<20:37,  1.07s/it, lr: 1.0e-04 loss: 3.130e-01]
a-cold-wall:  62%|######1   | 1846/3000 [51:31<22:30,  1.17s/it, lr: 1.0e-04 loss: 3.130e-01]
a-cold-wall:  62%|######1   | 1846/3000 [51:31<22:30,  1.17s/it, lr: 1.0e-04 loss: 3.130e-01]
a-cold-wall:  62%|######1   | 1846/3000 [51:32<22:30,  1.17s/it, lr: 1.0e-04 loss: 1.113e-01]
a-cold-wall:  62%|######1   | 1846/3000 [51:32<22:30,  1.17s/it, lr: 1.0e-04 loss: 1.113e-01]
a-cold-wall:  62%|######1   | 1847/3000 [51:32<21:29,  1.12s/it, lr: 1.0e-04 loss: 1.113e-01]
a-cold-wall:  62%|######1   | 1847/3000 [51:32<21:29,  1.12s/it, lr: 1.0e-04 loss: 1.113e-01]
a-cold-wall:  62%|######1   | 1847/3000 [51:35<21:29,  1.12s/it, lr: 1.0e-04 loss: 2.758e-01]
a-cold-wall:  62%|######1   | 1847/3000 [51:35<21:29,  1.12s/it, lr: 1.0e-04 loss: 2.758e-01]
a-cold-wall:  62%|######1   | 1848/3000 [51:35<31:19,  1.63s/it, lr: 1.0e-04 loss: 2.758e-01]
a-cold-wall:  62%|######1   | 1848/3000 [51:35<31:19,  1.63s/it, lr: 1.0e-04 loss: 2.758e-01]
a-cold-wall:  62%|######1   | 1848/3000 [51:36<31:19,  1.63s/it, lr: 1.0e-04 loss: 6.439e-01]
a-cold-wall:  62%|######1   | 1848/3000 [51:36<31:19,  1.63s/it, lr: 1.0e-04 loss: 6.439e-01]
a-cold-wall:  62%|######1   | 1849/3000 [51:36<30:06,  1.57s/it, lr: 1.0e-04 loss: 6.439e-01]
a-cold-wall:  62%|######1   | 1849/3000 [51:36<30:06,  1.57s/it, lr: 1.0e-04 loss: 6.439e-01]
a-cold-wall:  62%|######1   | 1849/3000 [51:37<30:06,  1.57s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  62%|######1   | 1849/3000 [51:37<30:06,  1.57s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  62%|######1   | 1850/3000 [51:38<30:04,  1.57s/it, lr: 1.0e-04 loss: 4.870e-01]
a-cold-wall:  62%|######1   | 1850/3000 [51:38<30:04,  1.57s/it, lr: 1.0e-04 loss: 4.870e-01]
a-cold-wall:  62%|######1   | 1851/3000 [51:38<22:33,  1.18s/it, lr: 1.0e-04 loss: 4.870e-01]
a-cold-wall:  62%|######1   | 1851/3000 [51:38<22:33,  1.18s/it, lr: 1.0e-04 loss: 4.870e-01]
a-cold-wall:  62%|######1   | 1851/3000 [51:41<22:33,  1.18s/it, lr: 1.0e-04 loss: 2.968e-01]
a-cold-wall:  62%|######1   | 1851/3000 [51:41<22:33,  1.18s/it, lr: 1.0e-04 loss: 2.968e-01]
a-cold-wall:  62%|######1   | 1852/3000 [51:41<30:30,  1.59s/it, lr: 1.0e-04 loss: 2.968e-01]
a-cold-wall:  62%|######1   | 1852/3000 [51:41<30:30,  1.59s/it, lr: 1.0e-04 loss: 2.968e-01]
a-cold-wall:  62%|######1   | 1852/3000 [51:44<30:30,  1.59s/it, lr: 1.0e-04 loss: 6.110e-01]
a-cold-wall:  62%|######1   | 1852/3000 [51:44<30:30,  1.59s/it, lr: 1.0e-04 loss: 6.110e-01]
a-cold-wall:  62%|######1   | 1853/3000 [51:44<36:55,  1.93s/it, lr: 1.0e-04 loss: 6.110e-01]
a-cold-wall:  62%|######1   | 1853/3000 [51:44<36:55,  1.93s/it, lr: 1.0e-04 loss: 6.110e-01]
a-cold-wall:  62%|######1   | 1853/3000 [51:46<36:55,  1.93s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  62%|######1   | 1853/3000 [51:46<36:55,  1.93s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  62%|######1   | 1854/3000 [51:46<34:17,  1.80s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  62%|######1   | 1854/3000 [51:46<34:17,  1.80s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  62%|######1   | 1854/3000 [51:48<34:17,  1.80s/it, lr: 1.0e-04 loss: 7.287e-01]
a-cold-wall:  62%|######1   | 1854/3000 [51:48<34:17,  1.80s/it, lr: 1.0e-04 loss: 7.287e-01]
a-cold-wall:  62%|######1   | 1855/3000 [51:48<39:53,  2.09s/it, lr: 1.0e-04 loss: 7.287e-01]
a-cold-wall:  62%|######1   | 1855/3000 [51:48<39:53,  2.09s/it, lr: 1.0e-04 loss: 7.287e-01]
a-cold-wall:  62%|######1   | 1855/3000 [51:51<39:53,  2.09s/it, lr: 1.0e-04 loss: 5.464e-01]
a-cold-wall:  62%|######1   | 1855/3000 [51:51<39:53,  2.09s/it, lr: 1.0e-04 loss: 5.464e-01]
a-cold-wall:  62%|######1   | 1856/3000 [51:51<44:10,  2.32s/it, lr: 1.0e-04 loss: 5.464e-01]
a-cold-wall:  62%|######1   | 1856/3000 [51:51<44:10,  2.32s/it, lr: 1.0e-04 loss: 5.464e-01]
a-cold-wall:  62%|######1   | 1856/3000 [51:53<44:10,  2.32s/it, lr: 1.0e-04 loss: 2.516e-01]
a-cold-wall:  62%|######1   | 1856/3000 [51:53<44:10,  2.32s/it, lr: 1.0e-04 loss: 2.516e-01]
a-cold-wall:  62%|######1   | 1857/3000 [51:53<39:14,  2.06s/it, lr: 1.0e-04 loss: 2.516e-01]
a-cold-wall:  62%|######1   | 1857/3000 [51:53<39:14,  2.06s/it, lr: 1.0e-04 loss: 2.516e-01]
a-cold-wall:  62%|######1   | 1857/3000 [51:56<39:14,  2.06s/it, lr: 1.0e-04 loss: 1.808e-01]
a-cold-wall:  62%|######1   | 1857/3000 [51:56<39:14,  2.06s/it, lr: 1.0e-04 loss: 1.808e-01]
a-cold-wall:  62%|######1   | 1858/3000 [51:56<43:49,  2.30s/it, lr: 1.0e-04 loss: 1.808e-01]
a-cold-wall:  62%|######1   | 1858/3000 [51:56<43:49,  2.30s/it, lr: 1.0e-04 loss: 1.808e-01]
a-cold-wall:  62%|######1   | 1858/3000 [51:56<43:49,  2.30s/it, lr: 1.0e-04 loss: 4.753e-01]
a-cold-wall:  62%|######1   | 1858/3000 [51:56<43:49,  2.30s/it, lr: 1.0e-04 loss: 4.753e-01]
a-cold-wall:  62%|######1   | 1859/3000 [51:56<35:00,  1.84s/it, lr: 1.0e-04 loss: 4.753e-01]
a-cold-wall:  62%|######1   | 1859/3000 [51:56<35:00,  1.84s/it, lr: 1.0e-04 loss: 4.753e-01]
a-cold-wall:  62%|######1   | 1859/3000 [51:59<35:00,  1.84s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  62%|######1   | 1859/3000 [51:59<35:00,  1.84s/it, lr: 1.0e-04 loss: 5.859e-01]
a-cold-wall:  62%|######2   | 1860/3000 [52:01<34:58,  1.84s/it, lr: 1.0e-04 loss: 5.190e-01]
a-cold-wall:  62%|######2   | 1860/3000 [52:01<34:58,  1.84s/it, lr: 1.0e-04 loss: 5.190e-01]
a-cold-wall:  62%|######2   | 1861/3000 [52:01<25:07,  1.32s/it, lr: 1.0e-04 loss: 5.190e-01]
a-cold-wall:  62%|######2   | 1861/3000 [52:01<25:07,  1.32s/it, lr: 1.0e-04 loss: 5.190e-01]
a-cold-wall:  62%|######2   | 1861/3000 [52:04<25:07,  1.32s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  62%|######2   | 1861/3000 [52:04<25:07,  1.32s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  62%|######2   | 1862/3000 [52:04<32:20,  1.70s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  62%|######2   | 1862/3000 [52:04<32:20,  1.70s/it, lr: 1.0e-04 loss: 7.135e-01]
a-cold-wall:  62%|######2   | 1862/3000 [52:07<32:20,  1.70s/it, lr: 1.0e-04 loss: 1.025e-01]
a-cold-wall:  62%|######2   | 1862/3000 [52:07<32:20,  1.70s/it, lr: 1.0e-04 loss: 1.025e-01]
a-cold-wall:  62%|######2   | 1863/3000 [52:07<38:02,  2.01s/it, lr: 1.0e-04 loss: 1.025e-01]
a-cold-wall:  62%|######2   | 1863/3000 [52:07<38:02,  2.01s/it, lr: 1.0e-04 loss: 1.025e-01]
a-cold-wall:  62%|######2   | 1863/3000 [52:09<38:02,  2.01s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  62%|######2   | 1863/3000 [52:09<38:02,  2.01s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  62%|######2   | 1864/3000 [52:10<42:34,  2.25s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  62%|######2   | 1864/3000 [52:10<42:34,  2.25s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  62%|######2   | 1864/3000 [52:10<42:34,  2.25s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  62%|######2   | 1864/3000 [52:10<42:34,  2.25s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  62%|######2   | 1865/3000 [52:10<34:38,  1.83s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  62%|######2   | 1865/3000 [52:10<34:38,  1.83s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  62%|######2   | 1865/3000 [52:12<34:38,  1.83s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:  62%|######2   | 1865/3000 [52:12<34:38,  1.83s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:  62%|######2   | 1866/3000 [52:12<32:27,  1.72s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:  62%|######2   | 1866/3000 [52:12<32:27,  1.72s/it, lr: 1.0e-04 loss: 6.484e-01]
a-cold-wall:  62%|######2   | 1866/3000 [52:13<32:27,  1.72s/it, lr: 1.0e-04 loss: 8.001e-02]
a-cold-wall:  62%|######2   | 1866/3000 [52:13<32:27,  1.72s/it, lr: 1.0e-04 loss: 8.001e-02]
a-cold-wall:  62%|######2   | 1867/3000 [52:13<28:23,  1.50s/it, lr: 1.0e-04 loss: 8.001e-02]
a-cold-wall:  62%|######2   | 1867/3000 [52:13<28:23,  1.50s/it, lr: 1.0e-04 loss: 8.001e-02]
a-cold-wall:  62%|######2   | 1867/3000 [52:13<28:23,  1.50s/it, lr: 1.0e-04 loss: 4.165e-01]
a-cold-wall:  62%|######2   | 1867/3000 [52:13<28:23,  1.50s/it, lr: 1.0e-04 loss: 4.165e-01]
a-cold-wall:  62%|######2   | 1868/3000 [52:13<24:14,  1.28s/it, lr: 1.0e-04 loss: 4.165e-01]
a-cold-wall:  62%|######2   | 1868/3000 [52:13<24:14,  1.28s/it, lr: 1.0e-04 loss: 4.165e-01]
a-cold-wall:  62%|######2   | 1868/3000 [52:15<24:14,  1.28s/it, lr: 1.0e-04 loss: 1.294e-01]
a-cold-wall:  62%|######2   | 1868/3000 [52:15<24:14,  1.28s/it, lr: 1.0e-04 loss: 1.294e-01]
a-cold-wall:  62%|######2   | 1869/3000 [52:15<25:02,  1.33s/it, lr: 1.0e-04 loss: 1.294e-01]
a-cold-wall:  62%|######2   | 1869/3000 [52:15<25:02,  1.33s/it, lr: 1.0e-04 loss: 1.294e-01]
a-cold-wall:  62%|######2   | 1869/3000 [52:16<25:02,  1.33s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  62%|######2   | 1869/3000 [52:16<25:02,  1.33s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  62%|######2   | 1870/3000 [52:17<25:00,  1.33s/it, lr: 1.0e-04 loss: 4.680e-01]
a-cold-wall:  62%|######2   | 1870/3000 [52:17<25:00,  1.33s/it, lr: 1.0e-04 loss: 4.680e-01]
a-cold-wall:  62%|######2   | 1871/3000 [52:17<19:49,  1.05s/it, lr: 1.0e-04 loss: 4.680e-01]
a-cold-wall:  62%|######2   | 1871/3000 [52:17<19:49,  1.05s/it, lr: 1.0e-04 loss: 4.680e-01]
a-cold-wall:  62%|######2   | 1871/3000 [52:20<19:49,  1.05s/it, lr: 1.0e-04 loss: 2.742e-01]
a-cold-wall:  62%|######2   | 1871/3000 [52:20<19:49,  1.05s/it, lr: 1.0e-04 loss: 2.742e-01]
a-cold-wall:  62%|######2   | 1872/3000 [52:20<28:19,  1.51s/it, lr: 1.0e-04 loss: 2.742e-01]
a-cold-wall:  62%|######2   | 1872/3000 [52:20<28:19,  1.51s/it, lr: 1.0e-04 loss: 2.742e-01]
a-cold-wall:  62%|######2   | 1872/3000 [52:22<28:19,  1.51s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  62%|######2   | 1872/3000 [52:22<28:19,  1.51s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  62%|######2   | 1873/3000 [52:22<28:50,  1.54s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  62%|######2   | 1873/3000 [52:22<28:50,  1.54s/it, lr: 1.0e-04 loss: 6.891e-01]
a-cold-wall:  62%|######2   | 1873/3000 [52:22<28:50,  1.54s/it, lr: 1.0e-04 loss: 1.029e-01]
a-cold-wall:  62%|######2   | 1873/3000 [52:22<28:50,  1.54s/it, lr: 1.0e-04 loss: 1.029e-01]
a-cold-wall:  62%|######2   | 1874/3000 [52:22<24:47,  1.32s/it, lr: 1.0e-04 loss: 1.029e-01]
a-cold-wall:  62%|######2   | 1874/3000 [52:22<24:47,  1.32s/it, lr: 1.0e-04 loss: 1.029e-01]
a-cold-wall:  62%|######2   | 1874/3000 [52:24<24:47,  1.32s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  62%|######2   | 1874/3000 [52:24<24:47,  1.32s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  62%|######2   | 1875/3000 [52:24<25:55,  1.38s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  62%|######2   | 1875/3000 [52:24<25:55,  1.38s/it, lr: 1.0e-04 loss: 5.085e-01]
a-cold-wall:  62%|######2   | 1875/3000 [52:25<25:55,  1.38s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  62%|######2   | 1875/3000 [52:25<25:55,  1.38s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  63%|######2   | 1876/3000 [52:25<22:33,  1.20s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  63%|######2   | 1876/3000 [52:25<22:33,  1.20s/it, lr: 1.0e-04 loss: 3.081e-01]
a-cold-wall:  63%|######2   | 1876/3000 [52:26<22:33,  1.20s/it, lr: 1.0e-04 loss: 5.542e-01]
a-cold-wall:  63%|######2   | 1876/3000 [52:26<22:33,  1.20s/it, lr: 1.0e-04 loss: 5.542e-01]
a-cold-wall:  63%|######2   | 1877/3000 [52:26<23:42,  1.27s/it, lr: 1.0e-04 loss: 5.542e-01]
a-cold-wall:  63%|######2   | 1877/3000 [52:26<23:42,  1.27s/it, lr: 1.0e-04 loss: 5.542e-01]
a-cold-wall:  63%|######2   | 1877/3000 [52:27<23:42,  1.27s/it, lr: 1.0e-04 loss: 7.208e-01]
a-cold-wall:  63%|######2   | 1877/3000 [52:27<23:42,  1.27s/it, lr: 1.0e-04 loss: 7.208e-01]
a-cold-wall:  63%|######2   | 1878/3000 [52:27<24:35,  1.32s/it, lr: 1.0e-04 loss: 7.208e-01]
a-cold-wall:  63%|######2   | 1878/3000 [52:27<24:35,  1.32s/it, lr: 1.0e-04 loss: 7.208e-01]
a-cold-wall:  63%|######2   | 1878/3000 [52:29<24:35,  1.32s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  63%|######2   | 1878/3000 [52:29<24:35,  1.32s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  63%|######2   | 1879/3000 [52:29<25:07,  1.35s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  63%|######2   | 1879/3000 [52:29<25:07,  1.35s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  63%|######2   | 1879/3000 [52:32<25:07,  1.35s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  63%|######2   | 1879/3000 [52:32<25:07,  1.35s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  63%|######2   | 1880/3000 [52:35<25:06,  1.35s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  63%|######2   | 1880/3000 [52:35<25:06,  1.35s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  63%|######2   | 1881/3000 [52:35<25:57,  1.39s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  63%|######2   | 1881/3000 [52:35<25:57,  1.39s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  63%|######2   | 1881/3000 [52:38<25:57,  1.39s/it, lr: 1.0e-04 loss: 2.064e-01]
a-cold-wall:  63%|######2   | 1881/3000 [52:38<25:57,  1.39s/it, lr: 1.0e-04 loss: 2.064e-01]
a-cold-wall:  63%|######2   | 1882/3000 [52:38<32:50,  1.76s/it, lr: 1.0e-04 loss: 2.064e-01]
a-cold-wall:  63%|######2   | 1882/3000 [52:38<32:50,  1.76s/it, lr: 1.0e-04 loss: 2.064e-01]
a-cold-wall:  63%|######2   | 1882/3000 [52:40<32:50,  1.76s/it, lr: 1.0e-04 loss: 6.298e-02]
a-cold-wall:  63%|######2   | 1882/3000 [52:40<32:50,  1.76s/it, lr: 1.0e-04 loss: 6.298e-02]
a-cold-wall:  63%|######2   | 1883/3000 [52:40<38:09,  2.05s/it, lr: 1.0e-04 loss: 6.298e-02]
a-cold-wall:  63%|######2   | 1883/3000 [52:40<38:09,  2.05s/it, lr: 1.0e-04 loss: 6.298e-02]
a-cold-wall:  63%|######2   | 1883/3000 [52:42<38:09,  2.05s/it, lr: 1.0e-04 loss: 5.482e-01]
a-cold-wall:  63%|######2   | 1883/3000 [52:42<38:09,  2.05s/it, lr: 1.0e-04 loss: 5.482e-01]
a-cold-wall:  63%|######2   | 1884/3000 [52:42<35:02,  1.88s/it, lr: 1.0e-04 loss: 5.482e-01]
a-cold-wall:  63%|######2   | 1884/3000 [52:42<35:02,  1.88s/it, lr: 1.0e-04 loss: 5.482e-01]
a-cold-wall:  63%|######2   | 1884/3000 [52:45<35:02,  1.88s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  63%|######2   | 1884/3000 [52:45<35:02,  1.88s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  63%|######2   | 1885/3000 [52:45<40:06,  2.16s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  63%|######2   | 1885/3000 [52:45<40:06,  2.16s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  63%|######2   | 1885/3000 [52:48<40:06,  2.16s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  63%|######2   | 1885/3000 [52:48<40:06,  2.16s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  63%|######2   | 1886/3000 [52:48<43:50,  2.36s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  63%|######2   | 1886/3000 [52:48<43:50,  2.36s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  63%|######2   | 1886/3000 [52:48<43:50,  2.36s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  63%|######2   | 1886/3000 [52:48<43:50,  2.36s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  63%|######2   | 1887/3000 [52:48<35:10,  1.90s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  63%|######2   | 1887/3000 [52:48<35:10,  1.90s/it, lr: 1.0e-04 loss: 1.227e-01]
a-cold-wall:  63%|######2   | 1887/3000 [52:51<35:10,  1.90s/it, lr: 1.0e-04 loss: 2.399e-01]
a-cold-wall:  63%|######2   | 1887/3000 [52:51<35:10,  1.90s/it, lr: 1.0e-04 loss: 2.399e-01]
a-cold-wall:  63%|######2   | 1888/3000 [52:51<40:54,  2.21s/it, lr: 1.0e-04 loss: 2.399e-01]
a-cold-wall:  63%|######2   | 1888/3000 [52:51<40:54,  2.21s/it, lr: 1.0e-04 loss: 2.399e-01]
a-cold-wall:  63%|######2   | 1888/3000 [52:52<40:54,  2.21s/it, lr: 1.0e-04 loss: 5.530e-01]
a-cold-wall:  63%|######2   | 1888/3000 [52:52<40:54,  2.21s/it, lr: 1.0e-04 loss: 5.530e-01]
a-cold-wall:  63%|######2   | 1889/3000 [52:52<32:51,  1.77s/it, lr: 1.0e-04 loss: 5.530e-01]
a-cold-wall:  63%|######2   | 1889/3000 [52:52<32:51,  1.77s/it, lr: 1.0e-04 loss: 5.530e-01]
a-cold-wall:  63%|######2   | 1889/3000 [52:54<32:51,  1.77s/it, lr: 1.0e-04 loss: 5.781e-01]
a-cold-wall:  63%|######2   | 1889/3000 [52:54<32:51,  1.77s/it, lr: 1.0e-04 loss: 5.781e-01]
a-cold-wall:  63%|######3   | 1890/3000 [52:57<32:49,  1.77s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  63%|######3   | 1890/3000 [52:57<32:49,  1.77s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  63%|######3   | 1891/3000 [52:57<29:54,  1.62s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  63%|######3   | 1891/3000 [52:57<29:54,  1.62s/it, lr: 1.0e-04 loss: 6.329e-01]
a-cold-wall:  63%|######3   | 1891/3000 [53:00<29:54,  1.62s/it, lr: 1.0e-04 loss: 1.700e-01]
a-cold-wall:  63%|######3   | 1891/3000 [53:00<29:54,  1.62s/it, lr: 1.0e-04 loss: 1.700e-01]
a-cold-wall:  63%|######3   | 1892/3000 [53:00<35:37,  1.93s/it, lr: 1.0e-04 loss: 1.700e-01]
a-cold-wall:  63%|######3   | 1892/3000 [53:00<35:37,  1.93s/it, lr: 1.0e-04 loss: 1.700e-01]
a-cold-wall:  63%|######3   | 1892/3000 [53:01<35:37,  1.93s/it, lr: 1.0e-04 loss: 8.853e-02]
a-cold-wall:  63%|######3   | 1892/3000 [53:01<35:37,  1.93s/it, lr: 1.0e-04 loss: 8.853e-02]
a-cold-wall:  63%|######3   | 1893/3000 [53:01<30:03,  1.63s/it, lr: 1.0e-04 loss: 8.853e-02]
a-cold-wall:  63%|######3   | 1893/3000 [53:01<30:03,  1.63s/it, lr: 1.0e-04 loss: 8.853e-02]
a-cold-wall:  63%|######3   | 1893/3000 [53:03<30:03,  1.63s/it, lr: 1.0e-04 loss: 4.043e-01]
a-cold-wall:  63%|######3   | 1893/3000 [53:03<30:03,  1.63s/it, lr: 1.0e-04 loss: 4.043e-01]
a-cold-wall:  63%|######3   | 1894/3000 [53:03<36:17,  1.97s/it, lr: 1.0e-04 loss: 4.043e-01]
a-cold-wall:  63%|######3   | 1894/3000 [53:03<36:17,  1.97s/it, lr: 1.0e-04 loss: 4.043e-01]
a-cold-wall:  63%|######3   | 1894/3000 [53:05<36:17,  1.97s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  63%|######3   | 1894/3000 [53:05<36:17,  1.97s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  63%|######3   | 1895/3000 [53:05<33:30,  1.82s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  63%|######3   | 1895/3000 [53:05<33:30,  1.82s/it, lr: 1.0e-04 loss: 7.302e-01]
a-cold-wall:  63%|######3   | 1895/3000 [53:08<33:30,  1.82s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  63%|######3   | 1895/3000 [53:08<33:30,  1.82s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  63%|######3   | 1896/3000 [53:08<39:04,  2.12s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  63%|######3   | 1896/3000 [53:08<39:04,  2.12s/it, lr: 1.0e-04 loss: 4.403e-01]
a-cold-wall:  63%|######3   | 1896/3000 [53:11<39:04,  2.12s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  63%|######3   | 1896/3000 [53:11<39:04,  2.12s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  63%|######3   | 1897/3000 [53:11<43:17,  2.36s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  63%|######3   | 1897/3000 [53:11<43:17,  2.36s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  63%|######3   | 1897/3000 [53:14<43:17,  2.36s/it, lr: 1.0e-04 loss: 4.066e-01]
a-cold-wall:  63%|######3   | 1897/3000 [53:14<43:17,  2.36s/it, lr: 1.0e-04 loss: 4.066e-01]
a-cold-wall:  63%|######3   | 1898/3000 [53:14<46:15,  2.52s/it, lr: 1.0e-04 loss: 4.066e-01]
a-cold-wall:  63%|######3   | 1898/3000 [53:14<46:15,  2.52s/it, lr: 1.0e-04 loss: 4.066e-01]
a-cold-wall:  63%|######3   | 1898/3000 [53:14<46:15,  2.52s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  63%|######3   | 1898/3000 [53:14<46:15,  2.52s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  63%|######3   | 1899/3000 [53:14<36:45,  2.00s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  63%|######3   | 1899/3000 [53:14<36:45,  2.00s/it, lr: 1.0e-04 loss: 1.300e-01]
a-cold-wall:  63%|######3   | 1899/3000 [53:15<36:45,  2.00s/it, lr: 1.0e-04 loss: 1.086e-01]
a-cold-wall:  63%|######3   | 1899/3000 [53:15<36:45,  2.00s/it, lr: 1.0e-04 loss: 1.086e-01]
a-cold-wall:  63%|######3   | 1900/3000 [53:17<36:43,  2.00s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  63%|######3   | 1900/3000 [53:17<36:43,  2.00s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  63%|######3   | 1901/3000 [53:17<25:57,  1.42s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  63%|######3   | 1901/3000 [53:17<25:57,  1.42s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  63%|######3   | 1901/3000 [53:20<25:57,  1.42s/it, lr: 1.0e-04 loss: 3.350e-01]
a-cold-wall:  63%|######3   | 1901/3000 [53:20<25:57,  1.42s/it, lr: 1.0e-04 loss: 3.350e-01]
a-cold-wall:  63%|######3   | 1902/3000 [53:20<33:23,  1.82s/it, lr: 1.0e-04 loss: 3.350e-01]
a-cold-wall:  63%|######3   | 1902/3000 [53:20<33:23,  1.82s/it, lr: 1.0e-04 loss: 3.350e-01]
a-cold-wall:  63%|######3   | 1902/3000 [53:23<33:23,  1.82s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:  63%|######3   | 1902/3000 [53:23<33:23,  1.82s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:  63%|######3   | 1903/3000 [53:23<38:25,  2.10s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:  63%|######3   | 1903/3000 [53:23<38:25,  2.10s/it, lr: 1.0e-04 loss: 6.869e-01]
a-cold-wall:  63%|######3   | 1903/3000 [53:25<38:25,  2.10s/it, lr: 1.0e-04 loss: 6.640e-01]
a-cold-wall:  63%|######3   | 1903/3000 [53:25<38:25,  2.10s/it, lr: 1.0e-04 loss: 6.640e-01]
a-cold-wall:  63%|######3   | 1904/3000 [53:25<42:04,  2.30s/it, lr: 1.0e-04 loss: 6.640e-01]
a-cold-wall:  63%|######3   | 1904/3000 [53:25<42:04,  2.30s/it, lr: 1.0e-04 loss: 6.640e-01]
a-cold-wall:  63%|######3   | 1904/3000 [53:28<42:04,  2.30s/it, lr: 1.0e-04 loss: 1.635e-01]
a-cold-wall:  63%|######3   | 1904/3000 [53:28<42:04,  2.30s/it, lr: 1.0e-04 loss: 1.635e-01]
a-cold-wall:  64%|######3   | 1905/3000 [53:28<44:57,  2.46s/it, lr: 1.0e-04 loss: 1.635e-01]
a-cold-wall:  64%|######3   | 1905/3000 [53:28<44:57,  2.46s/it, lr: 1.0e-04 loss: 1.635e-01]
a-cold-wall:  64%|######3   | 1905/3000 [53:29<44:57,  2.46s/it, lr: 1.0e-04 loss: 5.905e-02]
a-cold-wall:  64%|######3   | 1905/3000 [53:29<44:57,  2.46s/it, lr: 1.0e-04 loss: 5.905e-02]
a-cold-wall:  64%|######3   | 1906/3000 [53:29<35:58,  1.97s/it, lr: 1.0e-04 loss: 5.905e-02]
a-cold-wall:  64%|######3   | 1906/3000 [53:29<35:58,  1.97s/it, lr: 1.0e-04 loss: 5.905e-02]
a-cold-wall:  64%|######3   | 1906/3000 [53:30<35:58,  1.97s/it, lr: 1.0e-04 loss: 1.218e-01]
a-cold-wall:  64%|######3   | 1906/3000 [53:30<35:58,  1.97s/it, lr: 1.0e-04 loss: 1.218e-01]
a-cold-wall:  64%|######3   | 1907/3000 [53:30<29:29,  1.62s/it, lr: 1.0e-04 loss: 1.218e-01]
a-cold-wall:  64%|######3   | 1907/3000 [53:30<29:29,  1.62s/it, lr: 1.0e-04 loss: 1.218e-01]
a-cold-wall:  64%|######3   | 1907/3000 [53:31<29:29,  1.62s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  64%|######3   | 1907/3000 [53:31<29:29,  1.62s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  64%|######3   | 1908/3000 [53:31<24:49,  1.36s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  64%|######3   | 1908/3000 [53:31<24:49,  1.36s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  64%|######3   | 1908/3000 [53:33<24:49,  1.36s/it, lr: 1.0e-04 loss: 2.341e-01]
a-cold-wall:  64%|######3   | 1908/3000 [53:33<24:49,  1.36s/it, lr: 1.0e-04 loss: 2.341e-01]
a-cold-wall:  64%|######3   | 1909/3000 [53:33<32:55,  1.81s/it, lr: 1.0e-04 loss: 2.341e-01]
a-cold-wall:  64%|######3   | 1909/3000 [53:33<32:55,  1.81s/it, lr: 1.0e-04 loss: 2.341e-01]
a-cold-wall:  64%|######3   | 1909/3000 [53:36<32:55,  1.81s/it, lr: 1.0e-04 loss: 7.268e-02]
a-cold-wall:  64%|######3   | 1909/3000 [53:36<32:55,  1.81s/it, lr: 1.0e-04 loss: 7.268e-02]
a-cold-wall:  64%|######3   | 1910/3000 [53:37<32:53,  1.81s/it, lr: 1.0e-04 loss: 4.092e-01]
a-cold-wall:  64%|######3   | 1910/3000 [53:37<32:53,  1.81s/it, lr: 1.0e-04 loss: 4.092e-01]
a-cold-wall:  64%|######3   | 1911/3000 [53:37<21:16,  1.17s/it, lr: 1.0e-04 loss: 4.092e-01]
a-cold-wall:  64%|######3   | 1911/3000 [53:37<21:16,  1.17s/it, lr: 1.0e-04 loss: 4.092e-01]
a-cold-wall:  64%|######3   | 1911/3000 [53:38<21:16,  1.17s/it, lr: 1.0e-04 loss: 6.834e-01]
a-cold-wall:  64%|######3   | 1911/3000 [53:38<21:16,  1.17s/it, lr: 1.0e-04 loss: 6.834e-01]
a-cold-wall:  64%|######3   | 1912/3000 [53:38<19:20,  1.07s/it, lr: 1.0e-04 loss: 6.834e-01]
a-cold-wall:  64%|######3   | 1912/3000 [53:38<19:20,  1.07s/it, lr: 1.0e-04 loss: 6.834e-01]
a-cold-wall:  64%|######3   | 1912/3000 [53:41<19:20,  1.07s/it, lr: 1.0e-04 loss: 9.699e-02]
a-cold-wall:  64%|######3   | 1912/3000 [53:41<19:20,  1.07s/it, lr: 1.0e-04 loss: 9.699e-02]
a-cold-wall:  64%|######3   | 1913/3000 [53:41<27:50,  1.54s/it, lr: 1.0e-04 loss: 9.699e-02]
a-cold-wall:  64%|######3   | 1913/3000 [53:41<27:50,  1.54s/it, lr: 1.0e-04 loss: 9.699e-02]
a-cold-wall:  64%|######3   | 1913/3000 [53:44<27:50,  1.54s/it, lr: 1.0e-04 loss: 1.250e-01]
a-cold-wall:  64%|######3   | 1913/3000 [53:44<27:50,  1.54s/it, lr: 1.0e-04 loss: 1.250e-01]
a-cold-wall:  64%|######3   | 1914/3000 [53:44<34:11,  1.89s/it, lr: 1.0e-04 loss: 1.250e-01]
a-cold-wall:  64%|######3   | 1914/3000 [53:44<34:11,  1.89s/it, lr: 1.0e-04 loss: 1.250e-01]
a-cold-wall:  64%|######3   | 1914/3000 [53:45<34:11,  1.89s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  64%|######3   | 1914/3000 [53:45<34:11,  1.89s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  64%|######3   | 1915/3000 [53:45<32:58,  1.82s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  64%|######3   | 1915/3000 [53:45<32:58,  1.82s/it, lr: 1.0e-04 loss: 2.377e-01]
a-cold-wall:  64%|######3   | 1915/3000 [53:47<32:58,  1.82s/it, lr: 1.0e-04 loss: 1.142e-01]
a-cold-wall:  64%|######3   | 1915/3000 [53:47<32:58,  1.82s/it, lr: 1.0e-04 loss: 1.142e-01]
a-cold-wall:  64%|######3   | 1916/3000 [53:47<30:48,  1.70s/it, lr: 1.0e-04 loss: 1.142e-01]
a-cold-wall:  64%|######3   | 1916/3000 [53:47<30:48,  1.70s/it, lr: 1.0e-04 loss: 1.142e-01]
a-cold-wall:  64%|######3   | 1916/3000 [53:49<30:48,  1.70s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  64%|######3   | 1916/3000 [53:49<30:48,  1.70s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  64%|######3   | 1917/3000 [53:49<36:40,  2.03s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  64%|######3   | 1917/3000 [53:49<36:40,  2.03s/it, lr: 1.0e-04 loss: 4.067e-01]
a-cold-wall:  64%|######3   | 1917/3000 [53:51<36:40,  2.03s/it, lr: 1.0e-04 loss: 9.415e-02]
a-cold-wall:  64%|######3   | 1917/3000 [53:51<36:40,  2.03s/it, lr: 1.0e-04 loss: 9.415e-02]
a-cold-wall:  64%|######3   | 1918/3000 [53:51<33:24,  1.85s/it, lr: 1.0e-04 loss: 9.415e-02]
a-cold-wall:  64%|######3   | 1918/3000 [53:51<33:24,  1.85s/it, lr: 1.0e-04 loss: 9.415e-02]
a-cold-wall:  64%|######3   | 1918/3000 [53:52<33:24,  1.85s/it, lr: 1.0e-04 loss: 6.575e-01]
a-cold-wall:  64%|######3   | 1918/3000 [53:52<33:24,  1.85s/it, lr: 1.0e-04 loss: 6.575e-01]
a-cold-wall:  64%|######3   | 1919/3000 [53:52<27:30,  1.53s/it, lr: 1.0e-04 loss: 6.575e-01]
a-cold-wall:  64%|######3   | 1919/3000 [53:52<27:30,  1.53s/it, lr: 1.0e-04 loss: 6.575e-01]
a-cold-wall:  64%|######3   | 1919/3000 [53:52<27:30,  1.53s/it, lr: 1.0e-04 loss: 6.135e-01]
a-cold-wall:  64%|######3   | 1919/3000 [53:52<27:30,  1.53s/it, lr: 1.0e-04 loss: 6.135e-01]
a-cold-wall:  64%|######4   | 1920/3000 [53:53<27:29,  1.53s/it, lr: 1.0e-04 loss: 2.448e-01]
a-cold-wall:  64%|######4   | 1920/3000 [53:53<27:29,  1.53s/it, lr: 1.0e-04 loss: 2.448e-01]
a-cold-wall:  64%|######4   | 1921/3000 [53:53<17:57,  1.00it/s, lr: 1.0e-04 loss: 2.448e-01]
a-cold-wall:  64%|######4   | 1921/3000 [53:53<17:57,  1.00it/s, lr: 1.0e-04 loss: 2.448e-01]
a-cold-wall:  64%|######4   | 1921/3000 [53:56<17:57,  1.00it/s, lr: 1.0e-04 loss: 6.065e-01]
a-cold-wall:  64%|######4   | 1921/3000 [53:56<17:57,  1.00it/s, lr: 1.0e-04 loss: 6.065e-01]
a-cold-wall:  64%|######4   | 1922/3000 [53:56<26:05,  1.45s/it, lr: 1.0e-04 loss: 6.065e-01]
a-cold-wall:  64%|######4   | 1922/3000 [53:56<26:05,  1.45s/it, lr: 1.0e-04 loss: 6.065e-01]
a-cold-wall:  64%|######4   | 1922/3000 [53:57<26:05,  1.45s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  64%|######4   | 1922/3000 [53:57<26:05,  1.45s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  64%|######4   | 1923/3000 [53:57<22:48,  1.27s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  64%|######4   | 1923/3000 [53:57<22:48,  1.27s/it, lr: 1.0e-04 loss: 4.224e-01]
a-cold-wall:  64%|######4   | 1923/3000 [54:00<22:48,  1.27s/it, lr: 1.0e-04 loss: 6.514e-01]
a-cold-wall:  64%|######4   | 1923/3000 [54:00<22:48,  1.27s/it, lr: 1.0e-04 loss: 6.514e-01]
a-cold-wall:  64%|######4   | 1924/3000 [54:00<30:30,  1.70s/it, lr: 1.0e-04 loss: 6.514e-01]
a-cold-wall:  64%|######4   | 1924/3000 [54:00<30:30,  1.70s/it, lr: 1.0e-04 loss: 6.514e-01]
a-cold-wall:  64%|######4   | 1924/3000 [54:02<30:30,  1.70s/it, lr: 1.0e-04 loss: 6.058e-01]
a-cold-wall:  64%|######4   | 1924/3000 [54:02<30:30,  1.70s/it, lr: 1.0e-04 loss: 6.058e-01]
a-cold-wall:  64%|######4   | 1925/3000 [54:02<36:16,  2.02s/it, lr: 1.0e-04 loss: 6.058e-01]
a-cold-wall:  64%|######4   | 1925/3000 [54:02<36:16,  2.02s/it, lr: 1.0e-04 loss: 6.058e-01]
a-cold-wall:  64%|######4   | 1925/3000 [54:04<36:16,  2.02s/it, lr: 1.0e-04 loss: 4.508e-01]
a-cold-wall:  64%|######4   | 1925/3000 [54:04<36:16,  2.02s/it, lr: 1.0e-04 loss: 4.508e-01]
a-cold-wall:  64%|######4   | 1926/3000 [54:04<33:08,  1.85s/it, lr: 1.0e-04 loss: 4.508e-01]
a-cold-wall:  64%|######4   | 1926/3000 [54:04<33:08,  1.85s/it, lr: 1.0e-04 loss: 4.508e-01]
a-cold-wall:  64%|######4   | 1926/3000 [54:07<33:08,  1.85s/it, lr: 1.0e-04 loss: 1.053e-01]
a-cold-wall:  64%|######4   | 1926/3000 [54:07<33:08,  1.85s/it, lr: 1.0e-04 loss: 1.053e-01]
a-cold-wall:  64%|######4   | 1927/3000 [54:07<38:09,  2.13s/it, lr: 1.0e-04 loss: 1.053e-01]
a-cold-wall:  64%|######4   | 1927/3000 [54:07<38:09,  2.13s/it, lr: 1.0e-04 loss: 1.053e-01]
a-cold-wall:  64%|######4   | 1927/3000 [54:08<38:09,  2.13s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  64%|######4   | 1927/3000 [54:08<38:09,  2.13s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  64%|######4   | 1928/3000 [54:08<32:05,  1.80s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  64%|######4   | 1928/3000 [54:08<32:05,  1.80s/it, lr: 1.0e-04 loss: 2.243e-01]
a-cold-wall:  64%|######4   | 1928/3000 [54:11<32:05,  1.80s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  64%|######4   | 1928/3000 [54:11<32:05,  1.80s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  64%|######4   | 1929/3000 [54:11<37:40,  2.11s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  64%|######4   | 1929/3000 [54:11<37:40,  2.11s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  64%|######4   | 1929/3000 [54:11<37:40,  2.11s/it, lr: 1.0e-04 loss: 7.207e-02]
a-cold-wall:  64%|######4   | 1929/3000 [54:11<37:40,  2.11s/it, lr: 1.0e-04 loss: 7.207e-02]
a-cold-wall:  64%|######4   | 1930/3000 [54:14<37:38,  2.11s/it, lr: 1.0e-04 loss: 3.936e-02]
a-cold-wall:  64%|######4   | 1930/3000 [54:14<37:38,  2.11s/it, lr: 1.0e-04 loss: 3.936e-02]
a-cold-wall:  64%|######4   | 1931/3000 [54:14<31:56,  1.79s/it, lr: 1.0e-04 loss: 3.936e-02]
a-cold-wall:  64%|######4   | 1931/3000 [54:14<31:56,  1.79s/it, lr: 1.0e-04 loss: 3.936e-02]
a-cold-wall:  64%|######4   | 1931/3000 [54:17<31:56,  1.79s/it, lr: 1.0e-04 loss: 5.242e-01]
a-cold-wall:  64%|######4   | 1931/3000 [54:17<31:56,  1.79s/it, lr: 1.0e-04 loss: 5.242e-01]
a-cold-wall:  64%|######4   | 1932/3000 [54:17<36:37,  2.06s/it, lr: 1.0e-04 loss: 5.242e-01]
a-cold-wall:  64%|######4   | 1932/3000 [54:17<36:37,  2.06s/it, lr: 1.0e-04 loss: 5.242e-01]
a-cold-wall:  64%|######4   | 1932/3000 [54:18<36:37,  2.06s/it, lr: 1.0e-04 loss: 6.734e-01]
a-cold-wall:  64%|######4   | 1932/3000 [54:18<36:37,  2.06s/it, lr: 1.0e-04 loss: 6.734e-01]
a-cold-wall:  64%|######4   | 1933/3000 [54:18<33:36,  1.89s/it, lr: 1.0e-04 loss: 6.734e-01]
a-cold-wall:  64%|######4   | 1933/3000 [54:18<33:36,  1.89s/it, lr: 1.0e-04 loss: 6.734e-01]
a-cold-wall:  64%|######4   | 1933/3000 [54:20<33:36,  1.89s/it, lr: 1.0e-04 loss: 3.698e-01]
a-cold-wall:  64%|######4   | 1933/3000 [54:20<33:36,  1.89s/it, lr: 1.0e-04 loss: 3.698e-01]
a-cold-wall:  64%|######4   | 1934/3000 [54:20<31:17,  1.76s/it, lr: 1.0e-04 loss: 3.698e-01]
a-cold-wall:  64%|######4   | 1934/3000 [54:20<31:17,  1.76s/it, lr: 1.0e-04 loss: 3.698e-01]
a-cold-wall:  64%|######4   | 1934/3000 [54:21<31:17,  1.76s/it, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  64%|######4   | 1934/3000 [54:21<31:17,  1.76s/it, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  64%|######4   | 1935/3000 [54:21<26:13,  1.48s/it, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  64%|######4   | 1935/3000 [54:21<26:13,  1.48s/it, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  64%|######4   | 1935/3000 [54:22<26:13,  1.48s/it, lr: 1.0e-04 loss: 3.270e-01]
a-cold-wall:  64%|######4   | 1935/3000 [54:22<26:13,  1.48s/it, lr: 1.0e-04 loss: 3.270e-01]
a-cold-wall:  65%|######4   | 1936/3000 [54:22<25:58,  1.46s/it, lr: 1.0e-04 loss: 3.270e-01]
a-cold-wall:  65%|######4   | 1936/3000 [54:22<25:58,  1.46s/it, lr: 1.0e-04 loss: 3.270e-01]
a-cold-wall:  65%|######4   | 1936/3000 [54:25<25:58,  1.46s/it, lr: 1.0e-04 loss: 5.114e-01]
a-cold-wall:  65%|######4   | 1936/3000 [54:25<25:58,  1.46s/it, lr: 1.0e-04 loss: 5.114e-01]
a-cold-wall:  65%|######4   | 1937/3000 [54:25<33:05,  1.87s/it, lr: 1.0e-04 loss: 5.114e-01]
a-cold-wall:  65%|######4   | 1937/3000 [54:25<33:05,  1.87s/it, lr: 1.0e-04 loss: 5.114e-01]
a-cold-wall:  65%|######4   | 1937/3000 [54:26<33:05,  1.87s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:  65%|######4   | 1937/3000 [54:26<33:05,  1.87s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:  65%|######4   | 1938/3000 [54:26<27:15,  1.54s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:  65%|######4   | 1938/3000 [54:26<27:15,  1.54s/it, lr: 1.0e-04 loss: 6.161e-01]
a-cold-wall:  65%|######4   | 1938/3000 [54:27<27:15,  1.54s/it, lr: 1.0e-04 loss: 2.012e-02]
a-cold-wall:  65%|######4   | 1938/3000 [54:27<27:15,  1.54s/it, lr: 1.0e-04 loss: 2.012e-02]
a-cold-wall:  65%|######4   | 1939/3000 [54:27<26:31,  1.50s/it, lr: 1.0e-04 loss: 2.012e-02]
a-cold-wall:  65%|######4   | 1939/3000 [54:27<26:31,  1.50s/it, lr: 1.0e-04 loss: 2.012e-02]
a-cold-wall:  65%|######4   | 1939/3000 [54:28<26:31,  1.50s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:  65%|######4   | 1939/3000 [54:28<26:31,  1.50s/it, lr: 1.0e-04 loss: 1.480e-01]
a-cold-wall:  65%|######4   | 1940/3000 [54:30<26:29,  1.50s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  65%|######4   | 1940/3000 [54:30<26:29,  1.50s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  65%|######4   | 1941/3000 [54:30<20:04,  1.14s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  65%|######4   | 1941/3000 [54:30<20:04,  1.14s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  65%|######4   | 1941/3000 [54:33<20:04,  1.14s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  65%|######4   | 1941/3000 [54:33<20:04,  1.14s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  65%|######4   | 1942/3000 [54:33<27:23,  1.55s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  65%|######4   | 1942/3000 [54:33<27:23,  1.55s/it, lr: 1.0e-04 loss: 1.601e-01]
a-cold-wall:  65%|######4   | 1942/3000 [54:34<27:23,  1.55s/it, lr: 1.0e-04 loss: 6.431e-01]
a-cold-wall:  65%|######4   | 1942/3000 [54:34<27:23,  1.55s/it, lr: 1.0e-04 loss: 6.431e-01]
a-cold-wall:  65%|######4   | 1943/3000 [54:34<24:44,  1.40s/it, lr: 1.0e-04 loss: 6.431e-01]
a-cold-wall:  65%|######4   | 1943/3000 [54:34<24:44,  1.40s/it, lr: 1.0e-04 loss: 6.431e-01]
a-cold-wall:  65%|######4   | 1943/3000 [54:34<24:44,  1.40s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  65%|######4   | 1943/3000 [54:34<24:44,  1.40s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  65%|######4   | 1944/3000 [54:34<21:33,  1.22s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  65%|######4   | 1944/3000 [54:34<21:33,  1.22s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  65%|######4   | 1944/3000 [54:36<21:33,  1.22s/it, lr: 1.0e-04 loss: 7.178e-01]
a-cold-wall:  65%|######4   | 1944/3000 [54:36<21:33,  1.22s/it, lr: 1.0e-04 loss: 7.178e-01]
a-cold-wall:  65%|######4   | 1945/3000 [54:36<22:24,  1.27s/it, lr: 1.0e-04 loss: 7.178e-01]
a-cold-wall:  65%|######4   | 1945/3000 [54:36<22:24,  1.27s/it, lr: 1.0e-04 loss: 7.178e-01]
a-cold-wall:  65%|######4   | 1945/3000 [54:37<22:24,  1.27s/it, lr: 1.0e-04 loss: 6.004e-02]
a-cold-wall:  65%|######4   | 1945/3000 [54:37<22:24,  1.27s/it, lr: 1.0e-04 loss: 6.004e-02]
a-cold-wall:  65%|######4   | 1946/3000 [54:37<19:43,  1.12s/it, lr: 1.0e-04 loss: 6.004e-02]
a-cold-wall:  65%|######4   | 1946/3000 [54:37<19:43,  1.12s/it, lr: 1.0e-04 loss: 6.004e-02]
a-cold-wall:  65%|######4   | 1946/3000 [54:39<19:43,  1.12s/it, lr: 1.0e-04 loss: 4.259e-01]
a-cold-wall:  65%|######4   | 1946/3000 [54:39<19:43,  1.12s/it, lr: 1.0e-04 loss: 4.259e-01]
a-cold-wall:  65%|######4   | 1947/3000 [54:39<28:32,  1.63s/it, lr: 1.0e-04 loss: 4.259e-01]
a-cold-wall:  65%|######4   | 1947/3000 [54:39<28:32,  1.63s/it, lr: 1.0e-04 loss: 4.259e-01]
a-cold-wall:  65%|######4   | 1947/3000 [54:41<28:32,  1.63s/it, lr: 1.0e-04 loss: 1.100e-01]
a-cold-wall:  65%|######4   | 1947/3000 [54:41<28:32,  1.63s/it, lr: 1.0e-04 loss: 1.100e-01]
a-cold-wall:  65%|######4   | 1948/3000 [54:41<27:31,  1.57s/it, lr: 1.0e-04 loss: 1.100e-01]
a-cold-wall:  65%|######4   | 1948/3000 [54:41<27:31,  1.57s/it, lr: 1.0e-04 loss: 1.100e-01]
a-cold-wall:  65%|######4   | 1948/3000 [54:42<27:31,  1.57s/it, lr: 1.0e-04 loss: 4.747e-01]
a-cold-wall:  65%|######4   | 1948/3000 [54:42<27:31,  1.57s/it, lr: 1.0e-04 loss: 4.747e-01]
a-cold-wall:  65%|######4   | 1949/3000 [54:42<23:15,  1.33s/it, lr: 1.0e-04 loss: 4.747e-01]
a-cold-wall:  65%|######4   | 1949/3000 [54:42<23:15,  1.33s/it, lr: 1.0e-04 loss: 4.747e-01]
a-cold-wall:  65%|######4   | 1949/3000 [54:43<23:15,  1.33s/it, lr: 1.0e-04 loss: 4.901e-01]
a-cold-wall:  65%|######4   | 1949/3000 [54:43<23:15,  1.33s/it, lr: 1.0e-04 loss: 4.901e-01]
a-cold-wall:  65%|######5   | 1950/3000 [54:44<23:14,  1.33s/it, lr: 1.0e-04 loss: 8.408e-01]
a-cold-wall:  65%|######5   | 1950/3000 [54:44<23:14,  1.33s/it, lr: 1.0e-04 loss: 8.408e-01]
a-cold-wall:  65%|######5   | 1951/3000 [54:44<18:15,  1.04s/it, lr: 1.0e-04 loss: 8.408e-01]
a-cold-wall:  65%|######5   | 1951/3000 [54:44<18:15,  1.04s/it, lr: 1.0e-04 loss: 8.408e-01]
a-cold-wall:  65%|######5   | 1951/3000 [54:47<18:15,  1.04s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  65%|######5   | 1951/3000 [54:47<18:15,  1.04s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  65%|######5   | 1952/3000 [54:47<26:16,  1.50s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  65%|######5   | 1952/3000 [54:47<26:16,  1.50s/it, lr: 1.0e-04 loss: 4.713e-01]
a-cold-wall:  65%|######5   | 1952/3000 [54:49<26:16,  1.50s/it, lr: 1.0e-04 loss: 7.510e-01]
a-cold-wall:  65%|######5   | 1952/3000 [54:49<26:16,  1.50s/it, lr: 1.0e-04 loss: 7.510e-01]
a-cold-wall:  65%|######5   | 1953/3000 [54:49<25:52,  1.48s/it, lr: 1.0e-04 loss: 7.510e-01]
a-cold-wall:  65%|######5   | 1953/3000 [54:49<25:52,  1.48s/it, lr: 1.0e-04 loss: 7.510e-01]
a-cold-wall:  65%|######5   | 1953/3000 [54:50<25:52,  1.48s/it, lr: 1.0e-04 loss: 1.307e-01]
a-cold-wall:  65%|######5   | 1953/3000 [54:50<25:52,  1.48s/it, lr: 1.0e-04 loss: 1.307e-01]
a-cold-wall:  65%|######5   | 1954/3000 [54:50<25:38,  1.47s/it, lr: 1.0e-04 loss: 1.307e-01]
a-cold-wall:  65%|######5   | 1954/3000 [54:50<25:38,  1.47s/it, lr: 1.0e-04 loss: 1.307e-01]
a-cold-wall:  65%|######5   | 1954/3000 [54:51<25:38,  1.47s/it, lr: 1.0e-04 loss: 4.837e-01]
a-cold-wall:  65%|######5   | 1954/3000 [54:51<25:38,  1.47s/it, lr: 1.0e-04 loss: 4.837e-01]
a-cold-wall:  65%|######5   | 1955/3000 [54:51<22:07,  1.27s/it, lr: 1.0e-04 loss: 4.837e-01]
a-cold-wall:  65%|######5   | 1955/3000 [54:51<22:07,  1.27s/it, lr: 1.0e-04 loss: 4.837e-01]
a-cold-wall:  65%|######5   | 1955/3000 [54:52<22:07,  1.27s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  65%|######5   | 1955/3000 [54:52<22:07,  1.27s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  65%|######5   | 1956/3000 [54:52<19:34,  1.13s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  65%|######5   | 1956/3000 [54:52<19:34,  1.13s/it, lr: 1.0e-04 loss: 6.904e-01]
a-cold-wall:  65%|######5   | 1956/3000 [54:53<19:34,  1.13s/it, lr: 1.0e-04 loss: 3.228e-01]
a-cold-wall:  65%|######5   | 1956/3000 [54:53<19:34,  1.13s/it, lr: 1.0e-04 loss: 3.228e-01]
a-cold-wall:  65%|######5   | 1957/3000 [54:53<18:51,  1.08s/it, lr: 1.0e-04 loss: 3.228e-01]
a-cold-wall:  65%|######5   | 1957/3000 [54:53<18:51,  1.08s/it, lr: 1.0e-04 loss: 3.228e-01]
a-cold-wall:  65%|######5   | 1957/3000 [54:54<18:51,  1.08s/it, lr: 1.0e-04 loss: 2.274e-01]
a-cold-wall:  65%|######5   | 1957/3000 [54:54<18:51,  1.08s/it, lr: 1.0e-04 loss: 2.274e-01]
a-cold-wall:  65%|######5   | 1958/3000 [54:54<20:31,  1.18s/it, lr: 1.0e-04 loss: 2.274e-01]
a-cold-wall:  65%|######5   | 1958/3000 [54:54<20:31,  1.18s/it, lr: 1.0e-04 loss: 2.274e-01]
a-cold-wall:  65%|######5   | 1958/3000 [54:57<20:31,  1.18s/it, lr: 1.0e-04 loss: 2.775e-01]
a-cold-wall:  65%|######5   | 1958/3000 [54:57<20:31,  1.18s/it, lr: 1.0e-04 loss: 2.775e-01]
a-cold-wall:  65%|######5   | 1959/3000 [54:57<29:06,  1.68s/it, lr: 1.0e-04 loss: 2.775e-01]
a-cold-wall:  65%|######5   | 1959/3000 [54:57<29:06,  1.68s/it, lr: 1.0e-04 loss: 2.775e-01]
a-cold-wall:  65%|######5   | 1959/3000 [54:58<29:06,  1.68s/it, lr: 1.0e-04 loss: 7.334e-01]
a-cold-wall:  65%|######5   | 1959/3000 [54:58<29:06,  1.68s/it, lr: 1.0e-04 loss: 7.334e-01]
a-cold-wall:  65%|######5   | 1960/3000 [54:59<29:04,  1.68s/it, lr: 1.0e-04 loss: 8.846e-02]
a-cold-wall:  65%|######5   | 1960/3000 [54:59<29:04,  1.68s/it, lr: 1.0e-04 loss: 8.846e-02]
a-cold-wall:  65%|######5   | 1961/3000 [54:59<21:22,  1.23s/it, lr: 1.0e-04 loss: 8.846e-02]
a-cold-wall:  65%|######5   | 1961/3000 [54:59<21:22,  1.23s/it, lr: 1.0e-04 loss: 8.846e-02]
a-cold-wall:  65%|######5   | 1961/3000 [55:00<21:22,  1.23s/it, lr: 1.0e-04 loss: 7.704e-01]
a-cold-wall:  65%|######5   | 1961/3000 [55:00<21:22,  1.23s/it, lr: 1.0e-04 loss: 7.704e-01]
a-cold-wall:  65%|######5   | 1962/3000 [55:00<19:17,  1.12s/it, lr: 1.0e-04 loss: 7.704e-01]
a-cold-wall:  65%|######5   | 1962/3000 [55:00<19:17,  1.12s/it, lr: 1.0e-04 loss: 7.704e-01]
a-cold-wall:  65%|######5   | 1962/3000 [55:01<19:17,  1.12s/it, lr: 1.0e-04 loss: 5.125e-01]
a-cold-wall:  65%|######5   | 1962/3000 [55:01<19:17,  1.12s/it, lr: 1.0e-04 loss: 5.125e-01]
a-cold-wall:  65%|######5   | 1963/3000 [55:01<18:36,  1.08s/it, lr: 1.0e-04 loss: 5.125e-01]
a-cold-wall:  65%|######5   | 1963/3000 [55:01<18:36,  1.08s/it, lr: 1.0e-04 loss: 5.125e-01]
a-cold-wall:  65%|######5   | 1963/3000 [55:02<18:36,  1.08s/it, lr: 1.0e-04 loss: 7.092e-01]
a-cold-wall:  65%|######5   | 1963/3000 [55:02<18:36,  1.08s/it, lr: 1.0e-04 loss: 7.092e-01]
a-cold-wall:  65%|######5   | 1964/3000 [55:02<17:04,  1.01it/s, lr: 1.0e-04 loss: 7.092e-01]
a-cold-wall:  65%|######5   | 1964/3000 [55:02<17:04,  1.01it/s, lr: 1.0e-04 loss: 7.092e-01]
a-cold-wall:  65%|######5   | 1964/3000 [55:03<17:04,  1.01it/s, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  65%|######5   | 1964/3000 [55:03<17:04,  1.01it/s, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  66%|######5   | 1965/3000 [55:03<19:04,  1.11s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  66%|######5   | 1965/3000 [55:03<19:04,  1.11s/it, lr: 1.0e-04 loss: 1.292e-01]
a-cold-wall:  66%|######5   | 1965/3000 [55:04<19:04,  1.11s/it, lr: 1.0e-04 loss: 8.187e-02]
a-cold-wall:  66%|######5   | 1965/3000 [55:04<19:04,  1.11s/it, lr: 1.0e-04 loss: 8.187e-02]
a-cold-wall:  66%|######5   | 1966/3000 [55:04<20:32,  1.19s/it, lr: 1.0e-04 loss: 8.187e-02]
a-cold-wall:  66%|######5   | 1966/3000 [55:04<20:32,  1.19s/it, lr: 1.0e-04 loss: 8.187e-02]
a-cold-wall:  66%|######5   | 1966/3000 [55:06<20:32,  1.19s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  66%|######5   | 1966/3000 [55:06<20:32,  1.19s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  66%|######5   | 1967/3000 [55:06<21:38,  1.26s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  66%|######5   | 1967/3000 [55:06<21:38,  1.26s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  66%|######5   | 1967/3000 [55:07<21:38,  1.26s/it, lr: 1.0e-04 loss: 6.085e-02]
a-cold-wall:  66%|######5   | 1967/3000 [55:07<21:38,  1.26s/it, lr: 1.0e-04 loss: 6.085e-02]
a-cold-wall:  66%|######5   | 1968/3000 [55:07<19:03,  1.11s/it, lr: 1.0e-04 loss: 6.085e-02]
a-cold-wall:  66%|######5   | 1968/3000 [55:07<19:03,  1.11s/it, lr: 1.0e-04 loss: 6.085e-02]
a-cold-wall:  66%|######5   | 1968/3000 [55:08<19:03,  1.11s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  66%|######5   | 1968/3000 [55:08<19:03,  1.11s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  66%|######5   | 1969/3000 [55:08<20:41,  1.20s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  66%|######5   | 1969/3000 [55:08<20:41,  1.20s/it, lr: 1.0e-04 loss: 5.598e-01]
a-cold-wall:  66%|######5   | 1969/3000 [55:11<20:41,  1.20s/it, lr: 1.0e-04 loss: 4.041e-01]
a-cold-wall:  66%|######5   | 1969/3000 [55:11<20:41,  1.20s/it, lr: 1.0e-04 loss: 4.041e-01]
a-cold-wall:  66%|######5   | 1970/3000 [55:12<20:40,  1.20s/it, lr: 1.0e-04 loss: 4.372e-01]
a-cold-wall:  66%|######5   | 1970/3000 [55:12<20:40,  1.20s/it, lr: 1.0e-04 loss: 4.372e-01]
a-cold-wall:  66%|######5   | 1971/3000 [55:12<14:07,  1.21it/s, lr: 1.0e-04 loss: 4.372e-01]
a-cold-wall:  66%|######5   | 1971/3000 [55:12<14:07,  1.21it/s, lr: 1.0e-04 loss: 4.372e-01]
a-cold-wall:  66%|######5   | 1971/3000 [55:13<14:07,  1.21it/s, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  66%|######5   | 1971/3000 [55:13<14:07,  1.21it/s, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  66%|######5   | 1972/3000 [55:13<13:47,  1.24it/s, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  66%|######5   | 1972/3000 [55:13<13:47,  1.24it/s, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  66%|######5   | 1972/3000 [55:13<13:47,  1.24it/s, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  66%|######5   | 1972/3000 [55:13<13:47,  1.24it/s, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  66%|######5   | 1973/3000 [55:13<13:24,  1.28it/s, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  66%|######5   | 1973/3000 [55:13<13:24,  1.28it/s, lr: 1.0e-04 loss: 2.924e-01]
a-cold-wall:  66%|######5   | 1973/3000 [55:14<13:24,  1.28it/s, lr: 1.0e-04 loss: 3.837e-01]
a-cold-wall:  66%|######5   | 1973/3000 [55:14<13:24,  1.28it/s, lr: 1.0e-04 loss: 3.837e-01]
a-cold-wall:  66%|######5   | 1974/3000 [55:14<13:11,  1.30it/s, lr: 1.0e-04 loss: 3.837e-01]
a-cold-wall:  66%|######5   | 1974/3000 [55:14<13:11,  1.30it/s, lr: 1.0e-04 loss: 3.837e-01]
a-cold-wall:  66%|######5   | 1974/3000 [55:15<13:11,  1.30it/s, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  66%|######5   | 1974/3000 [55:15<13:11,  1.30it/s, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  66%|######5   | 1975/3000 [55:15<13:01,  1.31it/s, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  66%|######5   | 1975/3000 [55:15<13:01,  1.31it/s, lr: 1.0e-04 loss: 1.664e-01]
a-cold-wall:  66%|######5   | 1975/3000 [55:16<13:01,  1.31it/s, lr: 1.0e-04 loss: 5.705e-01]
a-cold-wall:  66%|######5   | 1975/3000 [55:16<13:01,  1.31it/s, lr: 1.0e-04 loss: 5.705e-01]
a-cold-wall:  66%|######5   | 1976/3000 [55:16<16:09,  1.06it/s, lr: 1.0e-04 loss: 5.705e-01]
a-cold-wall:  66%|######5   | 1976/3000 [55:16<16:09,  1.06it/s, lr: 1.0e-04 loss: 5.705e-01]
a-cold-wall:  66%|######5   | 1976/3000 [55:18<16:09,  1.06it/s, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  66%|######5   | 1976/3000 [55:18<16:09,  1.06it/s, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  66%|######5   | 1977/3000 [55:18<18:27,  1.08s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  66%|######5   | 1977/3000 [55:18<18:27,  1.08s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  66%|######5   | 1977/3000 [55:20<18:27,  1.08s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  66%|######5   | 1977/3000 [55:20<18:27,  1.08s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  66%|######5   | 1978/3000 [55:20<27:10,  1.60s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  66%|######5   | 1978/3000 [55:20<27:10,  1.60s/it, lr: 1.0e-04 loss: 3.917e-01]
a-cold-wall:  66%|######5   | 1978/3000 [55:22<27:10,  1.60s/it, lr: 1.0e-04 loss: 4.947e-01]
a-cold-wall:  66%|######5   | 1978/3000 [55:22<27:10,  1.60s/it, lr: 1.0e-04 loss: 4.947e-01]
a-cold-wall:  66%|######5   | 1979/3000 [55:22<26:16,  1.54s/it, lr: 1.0e-04 loss: 4.947e-01]
a-cold-wall:  66%|######5   | 1979/3000 [55:22<26:16,  1.54s/it, lr: 1.0e-04 loss: 4.947e-01]
a-cold-wall:  66%|######5   | 1979/3000 [55:25<26:16,  1.54s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  66%|######5   | 1979/3000 [55:25<26:16,  1.54s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  66%|######6   | 1980/3000 [55:25<26:15,  1.54s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  66%|######6   | 1980/3000 [55:25<26:15,  1.54s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  66%|######6   | 1981/3000 [55:25<17:07,  1.01s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  66%|######6   | 1981/3000 [55:25<17:07,  1.01s/it, lr: 1.0e-04 loss: 4.512e-01]
a-cold-wall:  66%|######6   | 1981/3000 [55:26<17:07,  1.01s/it, lr: 1.0e-04 loss: 1.948e-01]
a-cold-wall:  66%|######6   | 1981/3000 [55:26<17:07,  1.01s/it, lr: 1.0e-04 loss: 1.948e-01]
a-cold-wall:  66%|######6   | 1982/3000 [55:26<15:59,  1.06it/s, lr: 1.0e-04 loss: 1.948e-01]
a-cold-wall:  66%|######6   | 1982/3000 [55:26<15:59,  1.06it/s, lr: 1.0e-04 loss: 1.948e-01]
a-cold-wall:  66%|######6   | 1982/3000 [55:29<15:59,  1.06it/s, lr: 1.0e-04 loss: 3.446e-02]
a-cold-wall:  66%|######6   | 1982/3000 [55:29<15:59,  1.06it/s, lr: 1.0e-04 loss: 3.446e-02]
a-cold-wall:  66%|######6   | 1983/3000 [55:29<24:55,  1.47s/it, lr: 1.0e-04 loss: 3.446e-02]
a-cold-wall:  66%|######6   | 1983/3000 [55:29<24:55,  1.47s/it, lr: 1.0e-04 loss: 3.446e-02]
a-cold-wall:  66%|######6   | 1983/3000 [55:32<24:55,  1.47s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  66%|######6   | 1983/3000 [55:32<24:55,  1.47s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  66%|######6   | 1984/3000 [55:32<31:20,  1.85s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  66%|######6   | 1984/3000 [55:32<31:20,  1.85s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  66%|######6   | 1984/3000 [55:34<31:20,  1.85s/it, lr: 1.0e-04 loss: 5.126e-01]
a-cold-wall:  66%|######6   | 1984/3000 [55:34<31:20,  1.85s/it, lr: 1.0e-04 loss: 5.126e-01]
a-cold-wall:  66%|######6   | 1985/3000 [55:34<29:48,  1.76s/it, lr: 1.0e-04 loss: 5.126e-01]
a-cold-wall:  66%|######6   | 1985/3000 [55:34<29:48,  1.76s/it, lr: 1.0e-04 loss: 5.126e-01]
a-cold-wall:  66%|######6   | 1985/3000 [55:35<29:48,  1.76s/it, lr: 1.0e-04 loss: 5.167e-01]
a-cold-wall:  66%|######6   | 1985/3000 [55:35<29:48,  1.76s/it, lr: 1.0e-04 loss: 5.167e-01]
a-cold-wall:  66%|######6   | 1986/3000 [55:35<28:05,  1.66s/it, lr: 1.0e-04 loss: 5.167e-01]
a-cold-wall:  66%|######6   | 1986/3000 [55:35<28:05,  1.66s/it, lr: 1.0e-04 loss: 5.167e-01]
a-cold-wall:  66%|######6   | 1986/3000 [55:36<28:05,  1.66s/it, lr: 1.0e-04 loss: 2.204e-01]
a-cold-wall:  66%|######6   | 1986/3000 [55:36<28:05,  1.66s/it, lr: 1.0e-04 loss: 2.204e-01]
a-cold-wall:  66%|######6   | 1987/3000 [55:36<23:42,  1.40s/it, lr: 1.0e-04 loss: 2.204e-01]
a-cold-wall:  66%|######6   | 1987/3000 [55:36<23:42,  1.40s/it, lr: 1.0e-04 loss: 2.204e-01]
a-cold-wall:  66%|######6   | 1987/3000 [55:37<23:42,  1.40s/it, lr: 1.0e-04 loss: 6.418e-02]
a-cold-wall:  66%|######6   | 1987/3000 [55:37<23:42,  1.40s/it, lr: 1.0e-04 loss: 6.418e-02]
a-cold-wall:  66%|######6   | 1988/3000 [55:37<23:45,  1.41s/it, lr: 1.0e-04 loss: 6.418e-02]
a-cold-wall:  66%|######6   | 1988/3000 [55:37<23:45,  1.41s/it, lr: 1.0e-04 loss: 6.418e-02]
a-cold-wall:  66%|######6   | 1988/3000 [55:39<23:45,  1.41s/it, lr: 1.0e-04 loss: 5.160e-01]
a-cold-wall:  66%|######6   | 1988/3000 [55:39<23:45,  1.41s/it, lr: 1.0e-04 loss: 5.160e-01]
a-cold-wall:  66%|######6   | 1989/3000 [55:39<23:45,  1.41s/it, lr: 1.0e-04 loss: 5.160e-01]
a-cold-wall:  66%|######6   | 1989/3000 [55:39<23:45,  1.41s/it, lr: 1.0e-04 loss: 5.160e-01]
a-cold-wall:  66%|######6   | 1989/3000 [55:41<23:45,  1.41s/it, lr: 1.0e-04 loss: 4.108e-01]
a-cold-wall:  66%|######6   | 1989/3000 [55:41<23:45,  1.41s/it, lr: 1.0e-04 loss: 4.108e-01]
a-cold-wall:  66%|######6   | 1990/3000 [55:43<23:43,  1.41s/it, lr: 1.0e-04 loss: 1.076e-01]
a-cold-wall:  66%|######6   | 1990/3000 [55:43<23:43,  1.41s/it, lr: 1.0e-04 loss: 1.076e-01]
a-cold-wall:  66%|######6   | 1991/3000 [55:43<18:18,  1.09s/it, lr: 1.0e-04 loss: 1.076e-01]
a-cold-wall:  66%|######6   | 1991/3000 [55:43<18:18,  1.09s/it, lr: 1.0e-04 loss: 1.076e-01]
a-cold-wall:  66%|######6   | 1991/3000 [55:44<18:18,  1.09s/it, lr: 1.0e-04 loss: 4.187e-01]
a-cold-wall:  66%|######6   | 1991/3000 [55:44<18:18,  1.09s/it, lr: 1.0e-04 loss: 4.187e-01]
a-cold-wall:  66%|######6   | 1992/3000 [55:44<19:37,  1.17s/it, lr: 1.0e-04 loss: 4.187e-01]
a-cold-wall:  66%|######6   | 1992/3000 [55:44<19:37,  1.17s/it, lr: 1.0e-04 loss: 4.187e-01]
a-cold-wall:  66%|######6   | 1992/3000 [55:47<19:37,  1.17s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  66%|######6   | 1992/3000 [55:47<19:37,  1.17s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  66%|######6   | 1993/3000 [55:47<27:09,  1.62s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  66%|######6   | 1993/3000 [55:47<27:09,  1.62s/it, lr: 1.0e-04 loss: 5.809e-01]
a-cold-wall:  66%|######6   | 1993/3000 [55:48<27:09,  1.62s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  66%|######6   | 1993/3000 [55:48<27:09,  1.62s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  66%|######6   | 1994/3000 [55:48<24:10,  1.44s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  66%|######6   | 1994/3000 [55:48<24:10,  1.44s/it, lr: 1.0e-04 loss: 5.670e-01]
a-cold-wall:  66%|######6   | 1994/3000 [55:49<24:10,  1.44s/it, lr: 1.0e-04 loss: 2.681e-01]
a-cold-wall:  66%|######6   | 1994/3000 [55:49<24:10,  1.44s/it, lr: 1.0e-04 loss: 2.681e-01]
a-cold-wall:  66%|######6   | 1995/3000 [55:49<21:12,  1.27s/it, lr: 1.0e-04 loss: 2.681e-01]
a-cold-wall:  66%|######6   | 1995/3000 [55:49<21:12,  1.27s/it, lr: 1.0e-04 loss: 2.681e-01]
a-cold-wall:  66%|######6   | 1995/3000 [55:52<21:12,  1.27s/it, lr: 1.0e-04 loss: 7.473e-01]
a-cold-wall:  66%|######6   | 1995/3000 [55:52<21:12,  1.27s/it, lr: 1.0e-04 loss: 7.473e-01]
a-cold-wall:  67%|######6   | 1996/3000 [55:52<28:50,  1.72s/it, lr: 1.0e-04 loss: 7.473e-01]
a-cold-wall:  67%|######6   | 1996/3000 [55:52<28:50,  1.72s/it, lr: 1.0e-04 loss: 7.473e-01]
a-cold-wall:  67%|######6   | 1996/3000 [55:54<28:50,  1.72s/it, lr: 1.0e-04 loss: 2.585e-01]
a-cold-wall:  67%|######6   | 1996/3000 [55:54<28:50,  1.72s/it, lr: 1.0e-04 loss: 2.585e-01]
a-cold-wall:  67%|######6   | 1997/3000 [55:54<27:21,  1.64s/it, lr: 1.0e-04 loss: 2.585e-01]
a-cold-wall:  67%|######6   | 1997/3000 [55:54<27:21,  1.64s/it, lr: 1.0e-04 loss: 2.585e-01]
a-cold-wall:  67%|######6   | 1997/3000 [55:55<27:21,  1.64s/it, lr: 1.0e-04 loss: 6.870e-01]
a-cold-wall:  67%|######6   | 1997/3000 [55:55<27:21,  1.64s/it, lr: 1.0e-04 loss: 6.870e-01]
a-cold-wall:  67%|######6   | 1998/3000 [55:55<27:38,  1.65s/it, lr: 1.0e-04 loss: 6.870e-01]
a-cold-wall:  67%|######6   | 1998/3000 [55:55<27:38,  1.65s/it, lr: 1.0e-04 loss: 6.870e-01]
a-cold-wall:  67%|######6   | 1998/3000 [55:57<27:38,  1.65s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  67%|######6   | 1998/3000 [55:57<27:38,  1.65s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  67%|######6   | 1999/3000 [55:57<26:31,  1.59s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  67%|######6   | 1999/3000 [55:57<26:31,  1.59s/it, lr: 1.0e-04 loss: 1.685e-01]
a-cold-wall:  67%|######6   | 1999/3000 [55:58<26:31,  1.59s/it, lr: 1.0e-04 loss: 1.616e-01]
a-cold-wall:  67%|######6   | 1999/3000 [55:58<26:31,  1.59s/it, lr: 1.0e-04 loss: 1.616e-01]
Saving at step 2000
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000002000.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000001000.safetensors

a-cold-wall:  67%|######6   | 2000/3000 [55:59<26:29,  1.59s/it, lr: 1.0e-04 loss: 4.287e-01]
a-cold-wall:  67%|######6   | 2000/3000 [55:59<26:29,  1.59s/it, lr: 1.0e-04 loss: 4.287e-01]
a-cold-wall:  67%|######6   | 2001/3000 [55:59<18:11,  1.09s/it, lr: 1.0e-04 loss: 4.287e-01]
a-cold-wall:  67%|######6   | 2001/3000 [55:59<18:11,  1.09s/it, lr: 1.0e-04 loss: 4.287e-01]
a-cold-wall:  67%|######6   | 2001/3000 [56:01<18:11,  1.09s/it, lr: 1.0e-04 loss: 6.691e-01]
a-cold-wall:  67%|######6   | 2001/3000 [56:01<18:11,  1.09s/it, lr: 1.0e-04 loss: 6.691e-01]
a-cold-wall:  67%|######6   | 2002/3000 [56:01<19:35,  1.18s/it, lr: 1.0e-04 loss: 6.691e-01]
a-cold-wall:  67%|######6   | 2002/3000 [56:01<19:35,  1.18s/it, lr: 1.0e-04 loss: 6.691e-01]
a-cold-wall:  67%|######6   | 2002/3000 [56:02<19:35,  1.18s/it, lr: 1.0e-04 loss: 1.045e-02]
a-cold-wall:  67%|######6   | 2002/3000 [56:02<19:35,  1.18s/it, lr: 1.0e-04 loss: 1.045e-02]
a-cold-wall:  67%|######6   | 2003/3000 [56:02<20:37,  1.24s/it, lr: 1.0e-04 loss: 1.045e-02]
a-cold-wall:  67%|######6   | 2003/3000 [56:02<20:37,  1.24s/it, lr: 1.0e-04 loss: 1.045e-02]
a-cold-wall:  67%|######6   | 2003/3000 [56:04<20:37,  1.24s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  67%|######6   | 2003/3000 [56:04<20:37,  1.24s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  67%|######6   | 2004/3000 [56:04<21:24,  1.29s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  67%|######6   | 2004/3000 [56:04<21:24,  1.29s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  67%|######6   | 2004/3000 [56:06<21:24,  1.29s/it, lr: 1.0e-04 loss: 5.202e-01]
a-cold-wall:  67%|######6   | 2004/3000 [56:06<21:24,  1.29s/it, lr: 1.0e-04 loss: 5.202e-01]
a-cold-wall:  67%|######6   | 2005/3000 [56:06<28:54,  1.74s/it, lr: 1.0e-04 loss: 5.202e-01]
a-cold-wall:  67%|######6   | 2005/3000 [56:06<28:54,  1.74s/it, lr: 1.0e-04 loss: 5.202e-01]
a-cold-wall:  67%|######6   | 2005/3000 [56:09<28:54,  1.74s/it, lr: 1.0e-04 loss: 4.139e-01]
a-cold-wall:  67%|######6   | 2005/3000 [56:09<28:54,  1.74s/it, lr: 1.0e-04 loss: 4.139e-01]
a-cold-wall:  67%|######6   | 2006/3000 [56:09<34:27,  2.08s/it, lr: 1.0e-04 loss: 4.139e-01]
a-cold-wall:  67%|######6   | 2006/3000 [56:09<34:27,  2.08s/it, lr: 1.0e-04 loss: 4.139e-01]
a-cold-wall:  67%|######6   | 2006/3000 [56:10<34:27,  2.08s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  67%|######6   | 2006/3000 [56:10<34:27,  2.08s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  67%|######6   | 2007/3000 [56:10<29:08,  1.76s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  67%|######6   | 2007/3000 [56:10<29:08,  1.76s/it, lr: 1.0e-04 loss: 6.116e-01]
a-cold-wall:  67%|######6   | 2007/3000 [56:12<29:08,  1.76s/it, lr: 1.0e-04 loss: 5.444e-01]
a-cold-wall:  67%|######6   | 2007/3000 [56:12<29:08,  1.76s/it, lr: 1.0e-04 loss: 5.444e-01]
a-cold-wall:  67%|######6   | 2008/3000 [56:12<27:34,  1.67s/it, lr: 1.0e-04 loss: 5.444e-01]
a-cold-wall:  67%|######6   | 2008/3000 [56:12<27:34,  1.67s/it, lr: 1.0e-04 loss: 5.444e-01]
a-cold-wall:  67%|######6   | 2008/3000 [56:15<27:34,  1.67s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  67%|######6   | 2008/3000 [56:15<27:34,  1.67s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  67%|######6   | 2009/3000 [56:15<33:26,  2.02s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  67%|######6   | 2009/3000 [56:15<33:26,  2.02s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  67%|######6   | 2009/3000 [56:16<33:26,  2.02s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  67%|######6   | 2009/3000 [56:16<33:26,  2.02s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  67%|######7   | 2010/3000 [56:17<33:24,  2.02s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  67%|######7   | 2010/3000 [56:17<33:24,  2.02s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  67%|######7   | 2011/3000 [56:17<20:57,  1.27s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  67%|######7   | 2011/3000 [56:17<20:57,  1.27s/it, lr: 1.0e-04 loss: 5.474e-01]
a-cold-wall:  67%|######7   | 2011/3000 [56:20<20:57,  1.27s/it, lr: 1.0e-04 loss: 3.192e-01]
a-cold-wall:  67%|######7   | 2011/3000 [56:20<20:57,  1.27s/it, lr: 1.0e-04 loss: 3.192e-01]
a-cold-wall:  67%|######7   | 2012/3000 [56:20<27:22,  1.66s/it, lr: 1.0e-04 loss: 3.192e-01]
a-cold-wall:  67%|######7   | 2012/3000 [56:20<27:22,  1.66s/it, lr: 1.0e-04 loss: 3.192e-01]
a-cold-wall:  67%|######7   | 2012/3000 [56:23<27:22,  1.66s/it, lr: 1.0e-04 loss: 6.144e-01]
a-cold-wall:  67%|######7   | 2012/3000 [56:23<27:22,  1.66s/it, lr: 1.0e-04 loss: 6.144e-01]
a-cold-wall:  67%|######7   | 2013/3000 [56:23<33:00,  2.01s/it, lr: 1.0e-04 loss: 6.144e-01]
a-cold-wall:  67%|######7   | 2013/3000 [56:23<33:00,  2.01s/it, lr: 1.0e-04 loss: 6.144e-01]
a-cold-wall:  67%|######7   | 2013/3000 [56:26<33:00,  2.01s/it, lr: 1.0e-04 loss: 6.862e-01]
a-cold-wall:  67%|######7   | 2013/3000 [56:26<33:00,  2.01s/it, lr: 1.0e-04 loss: 6.862e-01]
a-cold-wall:  67%|######7   | 2014/3000 [56:26<36:59,  2.25s/it, lr: 1.0e-04 loss: 6.862e-01]
a-cold-wall:  67%|######7   | 2014/3000 [56:26<36:59,  2.25s/it, lr: 1.0e-04 loss: 6.862e-01]
a-cold-wall:  67%|######7   | 2014/3000 [56:27<36:59,  2.25s/it, lr: 1.0e-04 loss: 4.111e-01]
a-cold-wall:  67%|######7   | 2014/3000 [56:27<36:59,  2.25s/it, lr: 1.0e-04 loss: 4.111e-01]
a-cold-wall:  67%|######7   | 2015/3000 [56:27<33:06,  2.02s/it, lr: 1.0e-04 loss: 4.111e-01]
a-cold-wall:  67%|######7   | 2015/3000 [56:27<33:06,  2.02s/it, lr: 1.0e-04 loss: 4.111e-01]
a-cold-wall:  67%|######7   | 2015/3000 [56:28<33:06,  2.02s/it, lr: 1.0e-04 loss: 4.102e-01]
a-cold-wall:  67%|######7   | 2015/3000 [56:28<33:06,  2.02s/it, lr: 1.0e-04 loss: 4.102e-01]
a-cold-wall:  67%|######7   | 2016/3000 [56:28<30:16,  1.85s/it, lr: 1.0e-04 loss: 4.102e-01]
a-cold-wall:  67%|######7   | 2016/3000 [56:28<30:16,  1.85s/it, lr: 1.0e-04 loss: 4.102e-01]
a-cold-wall:  67%|######7   | 2016/3000 [56:31<30:16,  1.85s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  67%|######7   | 2016/3000 [56:31<30:16,  1.85s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  67%|######7   | 2017/3000 [56:31<35:07,  2.14s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  67%|######7   | 2017/3000 [56:31<35:07,  2.14s/it, lr: 1.0e-04 loss: 2.372e-01]
a-cold-wall:  67%|######7   | 2017/3000 [56:34<35:07,  2.14s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  67%|######7   | 2017/3000 [56:34<35:07,  2.14s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  67%|######7   | 2018/3000 [56:34<38:39,  2.36s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  67%|######7   | 2018/3000 [56:34<38:39,  2.36s/it, lr: 1.0e-04 loss: 6.447e-01]
a-cold-wall:  67%|######7   | 2018/3000 [56:35<38:39,  2.36s/it, lr: 1.0e-04 loss: 3.038e-01]
a-cold-wall:  67%|######7   | 2018/3000 [56:35<38:39,  2.36s/it, lr: 1.0e-04 loss: 3.038e-01]
a-cold-wall:  67%|######7   | 2019/3000 [56:35<30:49,  1.89s/it, lr: 1.0e-04 loss: 3.038e-01]
a-cold-wall:  67%|######7   | 2019/3000 [56:35<30:49,  1.89s/it, lr: 1.0e-04 loss: 3.038e-01]
a-cold-wall:  67%|######7   | 2019/3000 [56:36<30:49,  1.89s/it, lr: 1.0e-04 loss: 4.662e-01]
a-cold-wall:  67%|######7   | 2019/3000 [56:36<30:49,  1.89s/it, lr: 1.0e-04 loss: 4.662e-01]
a-cold-wall:  67%|######7   | 2020/3000 [56:36<30:47,  1.89s/it, lr: 1.0e-04 loss: 9.302e-02]
a-cold-wall:  67%|######7   | 2020/3000 [56:36<30:47,  1.89s/it, lr: 1.0e-04 loss: 9.302e-02]
a-cold-wall:  67%|######7   | 2021/3000 [56:36<19:31,  1.20s/it, lr: 1.0e-04 loss: 9.302e-02]
a-cold-wall:  67%|######7   | 2021/3000 [56:36<19:31,  1.20s/it, lr: 1.0e-04 loss: 9.302e-02]
a-cold-wall:  67%|######7   | 2021/3000 [56:38<19:31,  1.20s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  67%|######7   | 2021/3000 [56:38<19:31,  1.20s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  67%|######7   | 2022/3000 [56:38<20:21,  1.25s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  67%|######7   | 2022/3000 [56:38<20:21,  1.25s/it, lr: 1.0e-04 loss: 1.777e-01]
a-cold-wall:  67%|######7   | 2022/3000 [56:39<20:21,  1.25s/it, lr: 1.0e-04 loss: 3.057e-02]
a-cold-wall:  67%|######7   | 2022/3000 [56:39<20:21,  1.25s/it, lr: 1.0e-04 loss: 3.057e-02]
a-cold-wall:  67%|######7   | 2023/3000 [56:39<21:02,  1.29s/it, lr: 1.0e-04 loss: 3.057e-02]
a-cold-wall:  67%|######7   | 2023/3000 [56:39<21:02,  1.29s/it, lr: 1.0e-04 loss: 3.057e-02]
a-cold-wall:  67%|######7   | 2023/3000 [56:42<21:02,  1.29s/it, lr: 1.0e-04 loss: 4.926e-01]
a-cold-wall:  67%|######7   | 2023/3000 [56:42<21:02,  1.29s/it, lr: 1.0e-04 loss: 4.926e-01]
a-cold-wall:  67%|######7   | 2024/3000 [56:42<27:58,  1.72s/it, lr: 1.0e-04 loss: 4.926e-01]
a-cold-wall:  67%|######7   | 2024/3000 [56:42<27:58,  1.72s/it, lr: 1.0e-04 loss: 4.926e-01]
a-cold-wall:  67%|######7   | 2024/3000 [56:45<27:58,  1.72s/it, lr: 1.0e-04 loss: 2.435e-01]
a-cold-wall:  67%|######7   | 2024/3000 [56:45<27:58,  1.72s/it, lr: 1.0e-04 loss: 2.435e-01]
a-cold-wall:  68%|######7   | 2025/3000 [56:45<33:01,  2.03s/it, lr: 1.0e-04 loss: 2.435e-01]
a-cold-wall:  68%|######7   | 2025/3000 [56:45<33:01,  2.03s/it, lr: 1.0e-04 loss: 2.435e-01]
a-cold-wall:  68%|######7   | 2025/3000 [56:48<33:01,  2.03s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  68%|######7   | 2025/3000 [56:48<33:01,  2.03s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  68%|######7   | 2026/3000 [56:48<36:43,  2.26s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  68%|######7   | 2026/3000 [56:48<36:43,  2.26s/it, lr: 1.0e-04 loss: 4.850e-01]
a-cold-wall:  68%|######7   | 2026/3000 [56:49<36:43,  2.26s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  68%|######7   | 2026/3000 [56:49<36:43,  2.26s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  68%|######7   | 2027/3000 [56:49<32:43,  2.02s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  68%|######7   | 2027/3000 [56:49<32:43,  2.02s/it, lr: 1.0e-04 loss: 2.144e-01]
a-cold-wall:  68%|######7   | 2027/3000 [56:52<32:43,  2.02s/it, lr: 1.0e-04 loss: 6.395e-01]
a-cold-wall:  68%|######7   | 2027/3000 [56:52<32:43,  2.02s/it, lr: 1.0e-04 loss: 6.395e-01]
a-cold-wall:  68%|######7   | 2028/3000 [56:52<37:15,  2.30s/it, lr: 1.0e-04 loss: 6.395e-01]
a-cold-wall:  68%|######7   | 2028/3000 [56:52<37:15,  2.30s/it, lr: 1.0e-04 loss: 6.395e-01]
a-cold-wall:  68%|######7   | 2028/3000 [56:54<37:15,  2.30s/it, lr: 1.0e-04 loss: 6.510e-02]
a-cold-wall:  68%|######7   | 2028/3000 [56:54<37:15,  2.30s/it, lr: 1.0e-04 loss: 6.510e-02]
a-cold-wall:  68%|######7   | 2029/3000 [56:54<32:57,  2.04s/it, lr: 1.0e-04 loss: 6.510e-02]
a-cold-wall:  68%|######7   | 2029/3000 [56:54<32:57,  2.04s/it, lr: 1.0e-04 loss: 6.510e-02]
a-cold-wall:  68%|######7   | 2029/3000 [56:54<32:57,  2.04s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  68%|######7   | 2029/3000 [56:54<32:57,  2.04s/it, lr: 1.0e-04 loss: 1.312e-01]
a-cold-wall:  68%|######7   | 2030/3000 [56:56<32:55,  2.04s/it, lr: 1.0e-04 loss: 1.904e-01]
a-cold-wall:  68%|######7   | 2030/3000 [56:56<32:55,  2.04s/it, lr: 1.0e-04 loss: 1.904e-01]
a-cold-wall:  68%|######7   | 2031/3000 [56:56<23:03,  1.43s/it, lr: 1.0e-04 loss: 1.904e-01]
a-cold-wall:  68%|######7   | 2031/3000 [56:56<23:03,  1.43s/it, lr: 1.0e-04 loss: 1.904e-01]
a-cold-wall:  68%|######7   | 2031/3000 [56:59<23:03,  1.43s/it, lr: 1.0e-04 loss: 4.136e-02]
a-cold-wall:  68%|######7   | 2031/3000 [56:59<23:03,  1.43s/it, lr: 1.0e-04 loss: 4.136e-02]
a-cold-wall:  68%|######7   | 2032/3000 [56:59<28:47,  1.78s/it, lr: 1.0e-04 loss: 4.136e-02]
a-cold-wall:  68%|######7   | 2032/3000 [56:59<28:47,  1.78s/it, lr: 1.0e-04 loss: 4.136e-02]
a-cold-wall:  68%|######7   | 2032/3000 [57:00<28:47,  1.78s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  68%|######7   | 2032/3000 [57:00<28:47,  1.78s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  68%|######7   | 2033/3000 [57:00<27:14,  1.69s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  68%|######7   | 2033/3000 [57:00<27:14,  1.69s/it, lr: 1.0e-04 loss: 2.433e-01]
a-cold-wall:  68%|######7   | 2033/3000 [57:03<27:14,  1.69s/it, lr: 1.0e-04 loss: 6.058e-02]
a-cold-wall:  68%|######7   | 2033/3000 [57:03<27:14,  1.69s/it, lr: 1.0e-04 loss: 6.058e-02]
a-cold-wall:  68%|######7   | 2034/3000 [57:03<32:21,  2.01s/it, lr: 1.0e-04 loss: 6.058e-02]
a-cold-wall:  68%|######7   | 2034/3000 [57:03<32:21,  2.01s/it, lr: 1.0e-04 loss: 6.058e-02]
a-cold-wall:  68%|######7   | 2034/3000 [57:04<32:21,  2.01s/it, lr: 1.0e-04 loss: 5.833e-01]
a-cold-wall:  68%|######7   | 2034/3000 [57:04<32:21,  2.01s/it, lr: 1.0e-04 loss: 5.833e-01]
a-cold-wall:  68%|######7   | 2035/3000 [57:04<29:41,  1.85s/it, lr: 1.0e-04 loss: 5.833e-01]
a-cold-wall:  68%|######7   | 2035/3000 [57:04<29:41,  1.85s/it, lr: 1.0e-04 loss: 5.833e-01]
a-cold-wall:  68%|######7   | 2035/3000 [57:06<29:41,  1.85s/it, lr: 1.0e-04 loss: 4.678e-01]
a-cold-wall:  68%|######7   | 2035/3000 [57:06<29:41,  1.85s/it, lr: 1.0e-04 loss: 4.678e-01]
a-cold-wall:  68%|######7   | 2036/3000 [57:06<27:38,  1.72s/it, lr: 1.0e-04 loss: 4.678e-01]
a-cold-wall:  68%|######7   | 2036/3000 [57:06<27:38,  1.72s/it, lr: 1.0e-04 loss: 4.678e-01]
a-cold-wall:  68%|######7   | 2036/3000 [57:07<27:38,  1.72s/it, lr: 1.0e-04 loss: 5.643e-01]
a-cold-wall:  68%|######7   | 2036/3000 [57:07<27:38,  1.72s/it, lr: 1.0e-04 loss: 5.643e-01]
a-cold-wall:  68%|######7   | 2037/3000 [57:07<23:06,  1.44s/it, lr: 1.0e-04 loss: 5.643e-01]
a-cold-wall:  68%|######7   | 2037/3000 [57:07<23:06,  1.44s/it, lr: 1.0e-04 loss: 5.643e-01]
a-cold-wall:  68%|######7   | 2037/3000 [57:07<23:06,  1.44s/it, lr: 1.0e-04 loss: 6.533e-01]
a-cold-wall:  68%|######7   | 2037/3000 [57:07<23:06,  1.44s/it, lr: 1.0e-04 loss: 6.533e-01]
a-cold-wall:  68%|######7   | 2038/3000 [57:07<19:49,  1.24s/it, lr: 1.0e-04 loss: 6.533e-01]
a-cold-wall:  68%|######7   | 2038/3000 [57:07<19:49,  1.24s/it, lr: 1.0e-04 loss: 6.533e-01]
a-cold-wall:  68%|######7   | 2038/3000 [57:08<19:49,  1.24s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  68%|######7   | 2038/3000 [57:08<19:49,  1.24s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  68%|######7   | 2039/3000 [57:08<17:29,  1.09s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  68%|######7   | 2039/3000 [57:08<17:29,  1.09s/it, lr: 1.0e-04 loss: 1.996e-01]
a-cold-wall:  68%|######7   | 2039/3000 [57:09<17:29,  1.09s/it, lr: 1.0e-04 loss: 7.322e-01]
a-cold-wall:  68%|######7   | 2039/3000 [57:09<17:29,  1.09s/it, lr: 1.0e-04 loss: 7.322e-01]
a-cold-wall:  68%|######8   | 2040/3000 [57:10<17:27,  1.09s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  68%|######8   | 2040/3000 [57:10<17:27,  1.09s/it, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  68%|######8   | 2041/3000 [57:10<14:43,  1.09it/s, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  68%|######8   | 2041/3000 [57:10<14:43,  1.09it/s, lr: 1.0e-04 loss: 5.613e-01]
a-cold-wall:  68%|######8   | 2041/3000 [57:11<14:43,  1.09it/s, lr: 1.0e-04 loss: 5.135e-01]
a-cold-wall:  68%|######8   | 2041/3000 [57:11<14:43,  1.09it/s, lr: 1.0e-04 loss: 5.135e-01]
a-cold-wall:  68%|######8   | 2042/3000 [57:11<14:53,  1.07it/s, lr: 1.0e-04 loss: 5.135e-01]
a-cold-wall:  68%|######8   | 2042/3000 [57:11<14:53,  1.07it/s, lr: 1.0e-04 loss: 5.135e-01]
a-cold-wall:  68%|######8   | 2042/3000 [57:12<14:53,  1.07it/s, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  68%|######8   | 2042/3000 [57:12<14:53,  1.07it/s, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  68%|######8   | 2043/3000 [57:12<14:04,  1.13it/s, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  68%|######8   | 2043/3000 [57:12<14:04,  1.13it/s, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  68%|######8   | 2043/3000 [57:13<14:04,  1.13it/s, lr: 1.0e-04 loss: 9.103e-02]
a-cold-wall:  68%|######8   | 2043/3000 [57:13<14:04,  1.13it/s, lr: 1.0e-04 loss: 9.103e-02]
a-cold-wall:  68%|######8   | 2044/3000 [57:13<13:48,  1.15it/s, lr: 1.0e-04 loss: 9.103e-02]
a-cold-wall:  68%|######8   | 2044/3000 [57:13<13:48,  1.15it/s, lr: 1.0e-04 loss: 9.103e-02]
a-cold-wall:  68%|######8   | 2044/3000 [57:13<13:48,  1.15it/s, lr: 1.0e-04 loss: 2.212e-01]
a-cold-wall:  68%|######8   | 2044/3000 [57:13<13:48,  1.15it/s, lr: 1.0e-04 loss: 2.212e-01]
a-cold-wall:  68%|######8   | 2045/3000 [57:13<13:13,  1.20it/s, lr: 1.0e-04 loss: 2.212e-01]
a-cold-wall:  68%|######8   | 2045/3000 [57:13<13:13,  1.20it/s, lr: 1.0e-04 loss: 2.212e-01]
a-cold-wall:  68%|######8   | 2045/3000 [57:16<13:13,  1.20it/s, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  68%|######8   | 2045/3000 [57:16<13:13,  1.20it/s, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  68%|######8   | 2046/3000 [57:16<22:26,  1.41s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  68%|######8   | 2046/3000 [57:16<22:26,  1.41s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  68%|######8   | 2046/3000 [57:19<22:26,  1.41s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  68%|######8   | 2046/3000 [57:19<22:26,  1.41s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  68%|######8   | 2047/3000 [57:19<29:06,  1.83s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  68%|######8   | 2047/3000 [57:19<29:06,  1.83s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  68%|######8   | 2047/3000 [57:21<29:06,  1.83s/it, lr: 1.0e-04 loss: 7.671e-01]
a-cold-wall:  68%|######8   | 2047/3000 [57:21<29:06,  1.83s/it, lr: 1.0e-04 loss: 7.671e-01]
a-cold-wall:  68%|######8   | 2048/3000 [57:21<27:15,  1.72s/it, lr: 1.0e-04 loss: 7.671e-01]
a-cold-wall:  68%|######8   | 2048/3000 [57:21<27:15,  1.72s/it, lr: 1.0e-04 loss: 7.671e-01]
a-cold-wall:  68%|######8   | 2048/3000 [57:24<27:15,  1.72s/it, lr: 1.0e-04 loss: 1.774e-01]
a-cold-wall:  68%|######8   | 2048/3000 [57:24<27:15,  1.72s/it, lr: 1.0e-04 loss: 1.774e-01]
a-cold-wall:  68%|######8   | 2049/3000 [57:24<32:40,  2.06s/it, lr: 1.0e-04 loss: 1.774e-01]
a-cold-wall:  68%|######8   | 2049/3000 [57:24<32:40,  2.06s/it, lr: 1.0e-04 loss: 1.774e-01]
a-cold-wall:  68%|######8   | 2049/3000 [57:26<32:40,  2.06s/it, lr: 1.0e-04 loss: 3.296e-01]
a-cold-wall:  68%|######8   | 2049/3000 [57:26<32:40,  2.06s/it, lr: 1.0e-04 loss: 3.296e-01]
a-cold-wall:  68%|######8   | 2050/3000 [57:27<32:38,  2.06s/it, lr: 1.0e-04 loss: 4.448e-01]
a-cold-wall:  68%|######8   | 2050/3000 [57:27<32:38,  2.06s/it, lr: 1.0e-04 loss: 4.448e-01]
a-cold-wall:  68%|######8   | 2051/3000 [57:27<20:28,  1.29s/it, lr: 1.0e-04 loss: 4.448e-01]
a-cold-wall:  68%|######8   | 2051/3000 [57:27<20:28,  1.29s/it, lr: 1.0e-04 loss: 4.448e-01]
a-cold-wall:  68%|######8   | 2051/3000 [57:28<20:28,  1.29s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:  68%|######8   | 2051/3000 [57:28<20:28,  1.29s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:  68%|######8   | 2052/3000 [57:28<18:19,  1.16s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:  68%|######8   | 2052/3000 [57:28<18:19,  1.16s/it, lr: 1.0e-04 loss: 4.008e-01]
a-cold-wall:  68%|######8   | 2052/3000 [57:31<18:19,  1.16s/it, lr: 1.0e-04 loss: 6.764e-01]
a-cold-wall:  68%|######8   | 2052/3000 [57:31<18:19,  1.16s/it, lr: 1.0e-04 loss: 6.764e-01]
a-cold-wall:  68%|######8   | 2053/3000 [57:31<25:20,  1.61s/it, lr: 1.0e-04 loss: 6.764e-01]
a-cold-wall:  68%|######8   | 2053/3000 [57:31<25:20,  1.61s/it, lr: 1.0e-04 loss: 6.764e-01]
a-cold-wall:  68%|######8   | 2053/3000 [57:32<25:20,  1.61s/it, lr: 1.0e-04 loss: 2.023e-02]
a-cold-wall:  68%|######8   | 2053/3000 [57:32<25:20,  1.61s/it, lr: 1.0e-04 loss: 2.023e-02]
a-cold-wall:  68%|######8   | 2054/3000 [57:32<21:36,  1.37s/it, lr: 1.0e-04 loss: 2.023e-02]
a-cold-wall:  68%|######8   | 2054/3000 [57:32<21:36,  1.37s/it, lr: 1.0e-04 loss: 2.023e-02]
a-cold-wall:  68%|######8   | 2054/3000 [57:35<21:36,  1.37s/it, lr: 1.0e-04 loss: 6.207e-01]
a-cold-wall:  68%|######8   | 2054/3000 [57:35<21:36,  1.37s/it, lr: 1.0e-04 loss: 6.207e-01]
a-cold-wall:  68%|######8   | 2055/3000 [57:35<29:09,  1.85s/it, lr: 1.0e-04 loss: 6.207e-01]
a-cold-wall:  68%|######8   | 2055/3000 [57:35<29:09,  1.85s/it, lr: 1.0e-04 loss: 6.207e-01]
a-cold-wall:  68%|######8   | 2055/3000 [57:35<29:09,  1.85s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  68%|######8   | 2055/3000 [57:35<29:09,  1.85s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  69%|######8   | 2056/3000 [57:35<24:04,  1.53s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  69%|######8   | 2056/3000 [57:35<24:04,  1.53s/it, lr: 1.0e-04 loss: 3.846e-01]
a-cold-wall:  69%|######8   | 2056/3000 [57:38<24:04,  1.53s/it, lr: 1.0e-04 loss: 5.615e-01]
a-cold-wall:  69%|######8   | 2056/3000 [57:38<24:04,  1.53s/it, lr: 1.0e-04 loss: 5.615e-01]
a-cold-wall:  69%|######8   | 2057/3000 [57:38<30:10,  1.92s/it, lr: 1.0e-04 loss: 5.615e-01]
a-cold-wall:  69%|######8   | 2057/3000 [57:38<30:10,  1.92s/it, lr: 1.0e-04 loss: 5.615e-01]
a-cold-wall:  69%|######8   | 2057/3000 [57:40<30:10,  1.92s/it, lr: 1.0e-04 loss: 6.638e-01]
a-cold-wall:  69%|######8   | 2057/3000 [57:40<30:10,  1.92s/it, lr: 1.0e-04 loss: 6.638e-01]
a-cold-wall:  69%|######8   | 2058/3000 [57:40<27:51,  1.77s/it, lr: 1.0e-04 loss: 6.638e-01]
a-cold-wall:  69%|######8   | 2058/3000 [57:40<27:51,  1.77s/it, lr: 1.0e-04 loss: 6.638e-01]
a-cold-wall:  69%|######8   | 2058/3000 [57:42<27:51,  1.77s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  69%|######8   | 2058/3000 [57:42<27:51,  1.77s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  69%|######8   | 2059/3000 [57:42<32:47,  2.09s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  69%|######8   | 2059/3000 [57:42<32:47,  2.09s/it, lr: 1.0e-04 loss: 2.624e-01]
a-cold-wall:  69%|######8   | 2059/3000 [57:43<32:47,  2.09s/it, lr: 1.0e-04 loss: 2.178e-01]
a-cold-wall:  69%|######8   | 2059/3000 [57:43<32:47,  2.09s/it, lr: 1.0e-04 loss: 2.178e-01]
a-cold-wall:  69%|######8   | 2060/3000 [57:46<32:44,  2.09s/it, lr: 1.0e-04 loss: 7.151e-02]
a-cold-wall:  69%|######8   | 2060/3000 [57:46<32:44,  2.09s/it, lr: 1.0e-04 loss: 7.151e-02]
a-cold-wall:  69%|######8   | 2061/3000 [57:46<27:56,  1.79s/it, lr: 1.0e-04 loss: 7.151e-02]
a-cold-wall:  69%|######8   | 2061/3000 [57:46<27:56,  1.79s/it, lr: 1.0e-04 loss: 7.151e-02]
a-cold-wall:  69%|######8   | 2061/3000 [57:48<27:56,  1.79s/it, lr: 1.0e-04 loss: 4.528e-01]
a-cold-wall:  69%|######8   | 2061/3000 [57:48<27:56,  1.79s/it, lr: 1.0e-04 loss: 4.528e-01]
a-cold-wall:  69%|######8   | 2062/3000 [57:48<26:57,  1.72s/it, lr: 1.0e-04 loss: 4.528e-01]
a-cold-wall:  69%|######8   | 2062/3000 [57:48<26:57,  1.72s/it, lr: 1.0e-04 loss: 4.528e-01]
a-cold-wall:  69%|######8   | 2062/3000 [57:49<26:57,  1.72s/it, lr: 1.0e-04 loss: 2.539e-01]
a-cold-wall:  69%|######8   | 2062/3000 [57:49<26:57,  1.72s/it, lr: 1.0e-04 loss: 2.539e-01]
a-cold-wall:  69%|######8   | 2063/3000 [57:49<25:40,  1.64s/it, lr: 1.0e-04 loss: 2.539e-01]
a-cold-wall:  69%|######8   | 2063/3000 [57:49<25:40,  1.64s/it, lr: 1.0e-04 loss: 2.539e-01]
a-cold-wall:  69%|######8   | 2063/3000 [57:52<25:40,  1.64s/it, lr: 1.0e-04 loss: 2.180e-01]
a-cold-wall:  69%|######8   | 2063/3000 [57:52<25:40,  1.64s/it, lr: 1.0e-04 loss: 2.180e-01]
a-cold-wall:  69%|######8   | 2064/3000 [57:52<30:45,  1.97s/it, lr: 1.0e-04 loss: 2.180e-01]
a-cold-wall:  69%|######8   | 2064/3000 [57:52<30:45,  1.97s/it, lr: 1.0e-04 loss: 2.180e-01]
a-cold-wall:  69%|######8   | 2064/3000 [57:53<30:45,  1.97s/it, lr: 1.0e-04 loss: 1.672e-01]
a-cold-wall:  69%|######8   | 2064/3000 [57:53<30:45,  1.97s/it, lr: 1.0e-04 loss: 1.672e-01]
a-cold-wall:  69%|######8   | 2065/3000 [57:53<25:25,  1.63s/it, lr: 1.0e-04 loss: 1.672e-01]
a-cold-wall:  69%|######8   | 2065/3000 [57:53<25:25,  1.63s/it, lr: 1.0e-04 loss: 1.672e-01]
a-cold-wall:  69%|######8   | 2065/3000 [57:53<25:25,  1.63s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  69%|######8   | 2065/3000 [57:53<25:25,  1.63s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  69%|######8   | 2066/3000 [57:53<21:29,  1.38s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  69%|######8   | 2066/3000 [57:53<21:29,  1.38s/it, lr: 1.0e-04 loss: 4.117e-01]
a-cold-wall:  69%|######8   | 2066/3000 [57:54<21:29,  1.38s/it, lr: 1.0e-04 loss: 7.384e-02]
a-cold-wall:  69%|######8   | 2066/3000 [57:54<21:29,  1.38s/it, lr: 1.0e-04 loss: 7.384e-02]
a-cold-wall:  69%|######8   | 2067/3000 [57:54<18:37,  1.20s/it, lr: 1.0e-04 loss: 7.384e-02]
a-cold-wall:  69%|######8   | 2067/3000 [57:54<18:37,  1.20s/it, lr: 1.0e-04 loss: 7.384e-02]
a-cold-wall:  69%|######8   | 2067/3000 [57:55<18:37,  1.20s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  69%|######8   | 2067/3000 [57:55<18:37,  1.20s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  69%|######8   | 2068/3000 [57:55<17:35,  1.13s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  69%|######8   | 2068/3000 [57:55<17:35,  1.13s/it, lr: 1.0e-04 loss: 4.719e-01]
a-cold-wall:  69%|######8   | 2068/3000 [57:56<17:35,  1.13s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  69%|######8   | 2068/3000 [57:56<17:35,  1.13s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  69%|######8   | 2069/3000 [57:56<15:48,  1.02s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  69%|######8   | 2069/3000 [57:56<15:48,  1.02s/it, lr: 1.0e-04 loss: 2.872e-01]
a-cold-wall:  69%|######8   | 2069/3000 [57:57<15:48,  1.02s/it, lr: 1.0e-04 loss: 5.805e-01]
a-cold-wall:  69%|######8   | 2069/3000 [57:57<15:48,  1.02s/it, lr: 1.0e-04 loss: 5.805e-01]
a-cold-wall:  69%|######9   | 2070/3000 [57:59<15:47,  1.02s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:  69%|######9   | 2070/3000 [57:59<15:47,  1.02s/it, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:  69%|######9   | 2071/3000 [57:59<13:37,  1.14it/s, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:  69%|######9   | 2071/3000 [57:59<13:37,  1.14it/s, lr: 1.0e-04 loss: 5.359e-01]
a-cold-wall:  69%|######9   | 2071/3000 [58:02<13:37,  1.14it/s, lr: 1.0e-04 loss: 1.600e-01]
a-cold-wall:  69%|######9   | 2071/3000 [58:02<13:37,  1.14it/s, lr: 1.0e-04 loss: 1.600e-01]
a-cold-wall:  69%|######9   | 2072/3000 [58:02<21:09,  1.37s/it, lr: 1.0e-04 loss: 1.600e-01]
a-cold-wall:  69%|######9   | 2072/3000 [58:02<21:09,  1.37s/it, lr: 1.0e-04 loss: 1.600e-01]
a-cold-wall:  69%|######9   | 2072/3000 [58:03<21:09,  1.37s/it, lr: 1.0e-04 loss: 4.122e-01]
a-cold-wall:  69%|######9   | 2072/3000 [58:03<21:09,  1.37s/it, lr: 1.0e-04 loss: 4.122e-01]
a-cold-wall:  69%|######9   | 2073/3000 [58:03<21:31,  1.39s/it, lr: 1.0e-04 loss: 4.122e-01]
a-cold-wall:  69%|######9   | 2073/3000 [58:03<21:31,  1.39s/it, lr: 1.0e-04 loss: 4.122e-01]
a-cold-wall:  69%|######9   | 2073/3000 [58:04<21:31,  1.39s/it, lr: 1.0e-04 loss: 6.062e-02]
a-cold-wall:  69%|######9   | 2073/3000 [58:04<21:31,  1.39s/it, lr: 1.0e-04 loss: 6.062e-02]
a-cold-wall:  69%|######9   | 2074/3000 [58:04<18:53,  1.22s/it, lr: 1.0e-04 loss: 6.062e-02]
a-cold-wall:  69%|######9   | 2074/3000 [58:04<18:53,  1.22s/it, lr: 1.0e-04 loss: 6.062e-02]
a-cold-wall:  69%|######9   | 2074/3000 [58:05<18:53,  1.22s/it, lr: 1.0e-04 loss: 3.075e-01]
a-cold-wall:  69%|######9   | 2074/3000 [58:05<18:53,  1.22s/it, lr: 1.0e-04 loss: 3.075e-01]
a-cold-wall:  69%|######9   | 2075/3000 [58:05<16:50,  1.09s/it, lr: 1.0e-04 loss: 3.075e-01]
a-cold-wall:  69%|######9   | 2075/3000 [58:05<16:50,  1.09s/it, lr: 1.0e-04 loss: 3.075e-01]
a-cold-wall:  69%|######9   | 2075/3000 [58:07<16:50,  1.09s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  69%|######9   | 2075/3000 [58:07<16:50,  1.09s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  69%|######9   | 2076/3000 [58:07<24:38,  1.60s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  69%|######9   | 2076/3000 [58:07<24:38,  1.60s/it, lr: 1.0e-04 loss: 5.348e-01]
a-cold-wall:  69%|######9   | 2076/3000 [58:09<24:38,  1.60s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  69%|######9   | 2076/3000 [58:09<24:38,  1.60s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  69%|######9   | 2077/3000 [58:09<23:49,  1.55s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  69%|######9   | 2077/3000 [58:09<23:49,  1.55s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  69%|######9   | 2077/3000 [58:10<23:49,  1.55s/it, lr: 1.0e-04 loss: 1.228e-01]
a-cold-wall:  69%|######9   | 2077/3000 [58:10<23:49,  1.55s/it, lr: 1.0e-04 loss: 1.228e-01]
a-cold-wall:  69%|######9   | 2078/3000 [58:10<23:17,  1.52s/it, lr: 1.0e-04 loss: 1.228e-01]
a-cold-wall:  69%|######9   | 2078/3000 [58:10<23:17,  1.52s/it, lr: 1.0e-04 loss: 1.228e-01]
a-cold-wall:  69%|######9   | 2078/3000 [58:13<23:17,  1.52s/it, lr: 1.0e-04 loss: 3.457e-02]
a-cold-wall:  69%|######9   | 2078/3000 [58:13<23:17,  1.52s/it, lr: 1.0e-04 loss: 3.457e-02]
a-cold-wall:  69%|######9   | 2079/3000 [58:13<29:26,  1.92s/it, lr: 1.0e-04 loss: 3.457e-02]
a-cold-wall:  69%|######9   | 2079/3000 [58:13<29:26,  1.92s/it, lr: 1.0e-04 loss: 3.457e-02]
a-cold-wall:  69%|######9   | 2079/3000 [58:14<29:26,  1.92s/it, lr: 1.0e-04 loss: 1.086e-01]
a-cold-wall:  69%|######9   | 2079/3000 [58:14<29:26,  1.92s/it, lr: 1.0e-04 loss: 1.086e-01]
a-cold-wall:  69%|######9   | 2080/3000 [58:15<29:24,  1.92s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  69%|######9   | 2080/3000 [58:15<29:24,  1.92s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  69%|######9   | 2081/3000 [58:15<18:35,  1.21s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  69%|######9   | 2081/3000 [58:15<18:35,  1.21s/it, lr: 1.0e-04 loss: 3.085e-01]
a-cold-wall:  69%|######9   | 2081/3000 [58:16<18:35,  1.21s/it, lr: 1.0e-04 loss: 4.310e-01]
a-cold-wall:  69%|######9   | 2081/3000 [58:16<18:35,  1.21s/it, lr: 1.0e-04 loss: 4.310e-01]
a-cold-wall:  69%|######9   | 2082/3000 [58:16<16:50,  1.10s/it, lr: 1.0e-04 loss: 4.310e-01]
a-cold-wall:  69%|######9   | 2082/3000 [58:16<16:50,  1.10s/it, lr: 1.0e-04 loss: 4.310e-01]
a-cold-wall:  69%|######9   | 2082/3000 [58:19<16:50,  1.10s/it, lr: 1.0e-04 loss: 5.309e-01]
a-cold-wall:  69%|######9   | 2082/3000 [58:19<16:50,  1.10s/it, lr: 1.0e-04 loss: 5.309e-01]
a-cold-wall:  69%|######9   | 2083/3000 [58:19<24:16,  1.59s/it, lr: 1.0e-04 loss: 5.309e-01]
a-cold-wall:  69%|######9   | 2083/3000 [58:19<24:16,  1.59s/it, lr: 1.0e-04 loss: 5.309e-01]
a-cold-wall:  69%|######9   | 2083/3000 [58:19<24:16,  1.59s/it, lr: 1.0e-04 loss: 6.623e-01]
a-cold-wall:  69%|######9   | 2083/3000 [58:19<24:16,  1.59s/it, lr: 1.0e-04 loss: 6.623e-01]
a-cold-wall:  69%|######9   | 2084/3000 [58:19<20:49,  1.36s/it, lr: 1.0e-04 loss: 6.623e-01]
a-cold-wall:  69%|######9   | 2084/3000 [58:19<20:49,  1.36s/it, lr: 1.0e-04 loss: 6.623e-01]
a-cold-wall:  69%|######9   | 2084/3000 [58:20<20:49,  1.36s/it, lr: 1.0e-04 loss: 7.356e-01]
a-cold-wall:  69%|######9   | 2084/3000 [58:20<20:49,  1.36s/it, lr: 1.0e-04 loss: 7.356e-01]
a-cold-wall:  70%|######9   | 2085/3000 [58:20<18:12,  1.19s/it, lr: 1.0e-04 loss: 7.356e-01]
a-cold-wall:  70%|######9   | 2085/3000 [58:20<18:12,  1.19s/it, lr: 1.0e-04 loss: 7.356e-01]
a-cold-wall:  70%|######9   | 2085/3000 [58:23<18:12,  1.19s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  70%|######9   | 2085/3000 [58:23<18:12,  1.19s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  70%|######9   | 2086/3000 [58:23<25:41,  1.69s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  70%|######9   | 2086/3000 [58:23<25:41,  1.69s/it, lr: 1.0e-04 loss: 1.526e-01]
a-cold-wall:  70%|######9   | 2086/3000 [58:24<25:41,  1.69s/it, lr: 1.0e-04 loss: 3.479e-01]
a-cold-wall:  70%|######9   | 2086/3000 [58:24<25:41,  1.69s/it, lr: 1.0e-04 loss: 3.479e-01]
a-cold-wall:  70%|######9   | 2087/3000 [58:24<21:33,  1.42s/it, lr: 1.0e-04 loss: 3.479e-01]
a-cold-wall:  70%|######9   | 2087/3000 [58:24<21:33,  1.42s/it, lr: 1.0e-04 loss: 3.479e-01]
a-cold-wall:  70%|######9   | 2087/3000 [58:27<21:33,  1.42s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  70%|######9   | 2087/3000 [58:27<21:33,  1.42s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  70%|######9   | 2088/3000 [58:27<28:05,  1.85s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  70%|######9   | 2088/3000 [58:27<28:05,  1.85s/it, lr: 1.0e-04 loss: 2.362e-01]
a-cold-wall:  70%|######9   | 2088/3000 [58:28<28:05,  1.85s/it, lr: 1.0e-04 loss: 1.822e-02]
a-cold-wall:  70%|######9   | 2088/3000 [58:28<28:05,  1.85s/it, lr: 1.0e-04 loss: 1.822e-02]
a-cold-wall:  70%|######9   | 2089/3000 [58:28<26:14,  1.73s/it, lr: 1.0e-04 loss: 1.822e-02]
a-cold-wall:  70%|######9   | 2089/3000 [58:28<26:14,  1.73s/it, lr: 1.0e-04 loss: 1.822e-02]
a-cold-wall:  70%|######9   | 2089/3000 [58:30<26:14,  1.73s/it, lr: 1.0e-04 loss: 4.902e-01]
a-cold-wall:  70%|######9   | 2089/3000 [58:30<26:14,  1.73s/it, lr: 1.0e-04 loss: 4.902e-01]
a-cold-wall:  70%|######9   | 2090/3000 [58:31<26:12,  1.73s/it, lr: 1.0e-04 loss: 5.915e-01]
a-cold-wall:  70%|######9   | 2090/3000 [58:31<26:12,  1.73s/it, lr: 1.0e-04 loss: 5.915e-01]
a-cold-wall:  70%|######9   | 2091/3000 [58:31<19:08,  1.26s/it, lr: 1.0e-04 loss: 5.915e-01]
a-cold-wall:  70%|######9   | 2091/3000 [58:31<19:08,  1.26s/it, lr: 1.0e-04 loss: 5.915e-01]
a-cold-wall:  70%|######9   | 2091/3000 [58:32<19:08,  1.26s/it, lr: 1.0e-04 loss: 7.475e-01]
a-cold-wall:  70%|######9   | 2091/3000 [58:32<19:08,  1.26s/it, lr: 1.0e-04 loss: 7.475e-01]
a-cold-wall:  70%|######9   | 2092/3000 [58:32<19:44,  1.30s/it, lr: 1.0e-04 loss: 7.475e-01]
a-cold-wall:  70%|######9   | 2092/3000 [58:32<19:44,  1.30s/it, lr: 1.0e-04 loss: 7.475e-01]
a-cold-wall:  70%|######9   | 2092/3000 [58:35<19:44,  1.30s/it, lr: 1.0e-04 loss: 5.184e-01]
a-cold-wall:  70%|######9   | 2092/3000 [58:35<19:44,  1.30s/it, lr: 1.0e-04 loss: 5.184e-01]
a-cold-wall:  70%|######9   | 2093/3000 [58:35<25:57,  1.72s/it, lr: 1.0e-04 loss: 5.184e-01]
a-cold-wall:  70%|######9   | 2093/3000 [58:35<25:57,  1.72s/it, lr: 1.0e-04 loss: 5.184e-01]
a-cold-wall:  70%|######9   | 2093/3000 [58:36<25:57,  1.72s/it, lr: 1.0e-04 loss: 2.149e-01]
a-cold-wall:  70%|######9   | 2093/3000 [58:36<25:57,  1.72s/it, lr: 1.0e-04 loss: 2.149e-01]
a-cold-wall:  70%|######9   | 2094/3000 [58:36<21:58,  1.46s/it, lr: 1.0e-04 loss: 2.149e-01]
a-cold-wall:  70%|######9   | 2094/3000 [58:36<21:58,  1.46s/it, lr: 1.0e-04 loss: 2.149e-01]
a-cold-wall:  70%|######9   | 2094/3000 [58:37<21:58,  1.46s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:  70%|######9   | 2094/3000 [58:37<21:58,  1.46s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:  70%|######9   | 2095/3000 [58:37<18:59,  1.26s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:  70%|######9   | 2095/3000 [58:37<18:59,  1.26s/it, lr: 1.0e-04 loss: 1.929e-01]
a-cold-wall:  70%|######9   | 2095/3000 [58:38<18:59,  1.26s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  70%|######9   | 2095/3000 [58:38<18:59,  1.26s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  70%|######9   | 2096/3000 [58:38<19:39,  1.31s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  70%|######9   | 2096/3000 [58:38<19:39,  1.31s/it, lr: 1.0e-04 loss: 4.889e-01]
a-cold-wall:  70%|######9   | 2096/3000 [58:41<19:39,  1.31s/it, lr: 1.0e-04 loss: 3.999e-01]
a-cold-wall:  70%|######9   | 2096/3000 [58:41<19:39,  1.31s/it, lr: 1.0e-04 loss: 3.999e-01]
a-cold-wall:  70%|######9   | 2097/3000 [58:41<26:57,  1.79s/it, lr: 1.0e-04 loss: 3.999e-01]
a-cold-wall:  70%|######9   | 2097/3000 [58:41<26:57,  1.79s/it, lr: 1.0e-04 loss: 3.999e-01]
a-cold-wall:  70%|######9   | 2097/3000 [58:42<26:57,  1.79s/it, lr: 1.0e-04 loss: 1.441e-01]
a-cold-wall:  70%|######9   | 2097/3000 [58:42<26:57,  1.79s/it, lr: 1.0e-04 loss: 1.441e-01]
a-cold-wall:  70%|######9   | 2098/3000 [58:42<22:17,  1.48s/it, lr: 1.0e-04 loss: 1.441e-01]
a-cold-wall:  70%|######9   | 2098/3000 [58:42<22:17,  1.48s/it, lr: 1.0e-04 loss: 1.441e-01]
a-cold-wall:  70%|######9   | 2098/3000 [58:45<22:17,  1.48s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  70%|######9   | 2098/3000 [58:45<22:17,  1.48s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  70%|######9   | 2099/3000 [58:45<28:23,  1.89s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  70%|######9   | 2099/3000 [58:45<28:23,  1.89s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  70%|######9   | 2099/3000 [58:47<28:23,  1.89s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  70%|######9   | 2099/3000 [58:47<28:23,  1.89s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  70%|#######   | 2100/3000 [58:48<28:22,  1.89s/it, lr: 1.0e-04 loss: 1.456e-01]
a-cold-wall:  70%|#######   | 2100/3000 [58:48<28:22,  1.89s/it, lr: 1.0e-04 loss: 1.456e-01]
a-cold-wall:  70%|#######   | 2101/3000 [58:48<17:55,  1.20s/it, lr: 1.0e-04 loss: 1.456e-01]
a-cold-wall:  70%|#######   | 2101/3000 [58:48<17:55,  1.20s/it, lr: 1.0e-04 loss: 1.456e-01]
a-cold-wall:  70%|#######   | 2101/3000 [58:50<17:55,  1.20s/it, lr: 1.0e-04 loss: 5.145e-01]
a-cold-wall:  70%|#######   | 2101/3000 [58:50<17:55,  1.20s/it, lr: 1.0e-04 loss: 5.145e-01]
a-cold-wall:  70%|#######   | 2102/3000 [58:50<23:59,  1.60s/it, lr: 1.0e-04 loss: 5.145e-01]
a-cold-wall:  70%|#######   | 2102/3000 [58:50<23:59,  1.60s/it, lr: 1.0e-04 loss: 5.145e-01]
a-cold-wall:  70%|#######   | 2102/3000 [58:51<23:59,  1.60s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  70%|#######   | 2102/3000 [58:51<23:59,  1.60s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  70%|#######   | 2103/3000 [58:51<20:41,  1.38s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  70%|#######   | 2103/3000 [58:51<20:41,  1.38s/it, lr: 1.0e-04 loss: 5.826e-01]
a-cold-wall:  70%|#######   | 2103/3000 [58:54<20:41,  1.38s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  70%|#######   | 2103/3000 [58:54<20:41,  1.38s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  70%|#######   | 2104/3000 [58:54<26:31,  1.78s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  70%|#######   | 2104/3000 [58:54<26:31,  1.78s/it, lr: 1.0e-04 loss: 4.654e-01]
a-cold-wall:  70%|#######   | 2104/3000 [58:55<26:31,  1.78s/it, lr: 1.0e-04 loss: 4.912e-01]
a-cold-wall:  70%|#######   | 2104/3000 [58:55<26:31,  1.78s/it, lr: 1.0e-04 loss: 4.912e-01]
a-cold-wall:  70%|#######   | 2105/3000 [58:55<22:17,  1.49s/it, lr: 1.0e-04 loss: 4.912e-01]
a-cold-wall:  70%|#######   | 2105/3000 [58:55<22:17,  1.49s/it, lr: 1.0e-04 loss: 4.912e-01]
a-cold-wall:  70%|#######   | 2105/3000 [58:55<22:17,  1.49s/it, lr: 1.0e-04 loss: 5.983e-01]
a-cold-wall:  70%|#######   | 2105/3000 [58:55<22:17,  1.49s/it, lr: 1.0e-04 loss: 5.983e-01]
a-cold-wall:  70%|#######   | 2106/3000 [58:55<19:07,  1.28s/it, lr: 1.0e-04 loss: 5.983e-01]
a-cold-wall:  70%|#######   | 2106/3000 [58:55<19:07,  1.28s/it, lr: 1.0e-04 loss: 5.983e-01]
a-cold-wall:  70%|#######   | 2106/3000 [58:57<19:07,  1.28s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  70%|#######   | 2106/3000 [58:57<19:07,  1.28s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  70%|#######   | 2107/3000 [58:57<19:40,  1.32s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  70%|#######   | 2107/3000 [58:57<19:40,  1.32s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  70%|#######   | 2107/3000 [59:00<19:40,  1.32s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  70%|#######   | 2107/3000 [59:00<19:40,  1.32s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  70%|#######   | 2108/3000 [59:00<26:13,  1.76s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  70%|#######   | 2108/3000 [59:00<26:13,  1.76s/it, lr: 1.0e-04 loss: 2.847e-01]
a-cold-wall:  70%|#######   | 2108/3000 [59:01<26:13,  1.76s/it, lr: 1.0e-04 loss: 2.887e-02]
a-cold-wall:  70%|#######   | 2108/3000 [59:01<26:13,  1.76s/it, lr: 1.0e-04 loss: 2.887e-02]
a-cold-wall:  70%|#######   | 2109/3000 [59:01<24:46,  1.67s/it, lr: 1.0e-04 loss: 2.887e-02]
a-cold-wall:  70%|#######   | 2109/3000 [59:01<24:46,  1.67s/it, lr: 1.0e-04 loss: 2.887e-02]
a-cold-wall:  70%|#######   | 2109/3000 [59:04<24:46,  1.67s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  70%|#######   | 2109/3000 [59:04<24:46,  1.67s/it, lr: 1.0e-04 loss: 6.489e-01]
a-cold-wall:  70%|#######   | 2110/3000 [59:07<24:44,  1.67s/it, lr: 1.0e-04 loss: 1.255e-01]
a-cold-wall:  70%|#######   | 2110/3000 [59:07<24:44,  1.67s/it, lr: 1.0e-04 loss: 1.255e-01]
a-cold-wall:  70%|#######   | 2111/3000 [59:07<23:06,  1.56s/it, lr: 1.0e-04 loss: 1.255e-01]
a-cold-wall:  70%|#######   | 2111/3000 [59:07<23:06,  1.56s/it, lr: 1.0e-04 loss: 1.255e-01]
a-cold-wall:  70%|#######   | 2111/3000 [59:09<23:06,  1.56s/it, lr: 1.0e-04 loss: 6.173e-01]
a-cold-wall:  70%|#######   | 2111/3000 [59:09<23:06,  1.56s/it, lr: 1.0e-04 loss: 6.173e-01]
a-cold-wall:  70%|#######   | 2112/3000 [59:09<22:32,  1.52s/it, lr: 1.0e-04 loss: 6.173e-01]
a-cold-wall:  70%|#######   | 2112/3000 [59:09<22:32,  1.52s/it, lr: 1.0e-04 loss: 6.173e-01]
a-cold-wall:  70%|#######   | 2112/3000 [59:11<22:32,  1.52s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  70%|#######   | 2112/3000 [59:11<22:32,  1.52s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  70%|#######   | 2113/3000 [59:11<27:38,  1.87s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  70%|#######   | 2113/3000 [59:11<27:38,  1.87s/it, lr: 1.0e-04 loss: 1.554e-01]
a-cold-wall:  70%|#######   | 2113/3000 [59:13<27:38,  1.87s/it, lr: 1.0e-04 loss: 2.745e-01]
a-cold-wall:  70%|#######   | 2113/3000 [59:13<27:38,  1.87s/it, lr: 1.0e-04 loss: 2.745e-01]
a-cold-wall:  70%|#######   | 2114/3000 [59:13<25:46,  1.75s/it, lr: 1.0e-04 loss: 2.745e-01]
a-cold-wall:  70%|#######   | 2114/3000 [59:13<25:46,  1.75s/it, lr: 1.0e-04 loss: 2.745e-01]
a-cold-wall:  70%|#######   | 2114/3000 [59:14<25:46,  1.75s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  70%|#######   | 2114/3000 [59:14<25:46,  1.75s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  70%|#######   | 2115/3000 [59:14<24:22,  1.65s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  70%|#######   | 2115/3000 [59:14<24:22,  1.65s/it, lr: 1.0e-04 loss: 3.364e-01]
a-cold-wall:  70%|#######   | 2115/3000 [59:17<24:22,  1.65s/it, lr: 1.0e-04 loss: 6.425e-01]
a-cold-wall:  70%|#######   | 2115/3000 [59:17<24:22,  1.65s/it, lr: 1.0e-04 loss: 6.425e-01]
a-cold-wall:  71%|#######   | 2116/3000 [59:17<29:24,  2.00s/it, lr: 1.0e-04 loss: 6.425e-01]
a-cold-wall:  71%|#######   | 2116/3000 [59:17<29:24,  2.00s/it, lr: 1.0e-04 loss: 6.425e-01]
a-cold-wall:  71%|#######   | 2116/3000 [59:18<29:24,  2.00s/it, lr: 1.0e-04 loss: 6.587e-01]
a-cold-wall:  71%|#######   | 2116/3000 [59:18<29:24,  2.00s/it, lr: 1.0e-04 loss: 6.587e-01]
a-cold-wall:  71%|#######   | 2117/3000 [59:18<24:00,  1.63s/it, lr: 1.0e-04 loss: 6.587e-01]
a-cold-wall:  71%|#######   | 2117/3000 [59:18<24:00,  1.63s/it, lr: 1.0e-04 loss: 6.587e-01]
a-cold-wall:  71%|#######   | 2117/3000 [59:19<24:00,  1.63s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  71%|#######   | 2117/3000 [59:19<24:00,  1.63s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  71%|#######   | 2118/3000 [59:19<23:02,  1.57s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  71%|#######   | 2118/3000 [59:19<23:02,  1.57s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  71%|#######   | 2118/3000 [59:22<23:02,  1.57s/it, lr: 1.0e-04 loss: 7.203e-01]
a-cold-wall:  71%|#######   | 2118/3000 [59:22<23:02,  1.57s/it, lr: 1.0e-04 loss: 7.203e-01]
a-cold-wall:  71%|#######   | 2119/3000 [59:22<28:27,  1.94s/it, lr: 1.0e-04 loss: 7.203e-01]
a-cold-wall:  71%|#######   | 2119/3000 [59:22<28:27,  1.94s/it, lr: 1.0e-04 loss: 7.203e-01]
a-cold-wall:  71%|#######   | 2119/3000 [59:24<28:27,  1.94s/it, lr: 1.0e-04 loss: 5.304e-01]
a-cold-wall:  71%|#######   | 2119/3000 [59:24<28:27,  1.94s/it, lr: 1.0e-04 loss: 5.304e-01]
a-cold-wall:  71%|#######   | 2120/3000 [59:24<28:25,  1.94s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:  71%|#######   | 2120/3000 [59:24<28:25,  1.94s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:  71%|#######   | 2121/3000 [59:24<17:53,  1.22s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:  71%|#######   | 2121/3000 [59:24<17:53,  1.22s/it, lr: 1.0e-04 loss: 6.846e-01]
a-cold-wall:  71%|#######   | 2121/3000 [59:25<17:53,  1.22s/it, lr: 1.0e-04 loss: 6.384e-01]
a-cold-wall:  71%|#######   | 2121/3000 [59:25<17:53,  1.22s/it, lr: 1.0e-04 loss: 6.384e-01]
a-cold-wall:  71%|#######   | 2122/3000 [59:25<16:09,  1.10s/it, lr: 1.0e-04 loss: 6.384e-01]
a-cold-wall:  71%|#######   | 2122/3000 [59:25<16:09,  1.10s/it, lr: 1.0e-04 loss: 6.384e-01]
a-cold-wall:  71%|#######   | 2122/3000 [59:28<16:09,  1.10s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  71%|#######   | 2122/3000 [59:28<16:09,  1.10s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  71%|#######   | 2123/3000 [59:28<23:10,  1.59s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  71%|#######   | 2123/3000 [59:28<23:10,  1.59s/it, lr: 1.0e-04 loss: 4.859e-01]
a-cold-wall:  71%|#######   | 2123/3000 [59:31<23:10,  1.59s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:  71%|#######   | 2123/3000 [59:31<23:10,  1.59s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:  71%|#######   | 2124/3000 [59:31<28:02,  1.92s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:  71%|#######   | 2124/3000 [59:31<28:02,  1.92s/it, lr: 1.0e-04 loss: 2.620e-01]
a-cold-wall:  71%|#######   | 2124/3000 [59:32<28:02,  1.92s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  71%|#######   | 2124/3000 [59:32<28:02,  1.92s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  71%|#######   | 2125/3000 [59:32<25:56,  1.78s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  71%|#######   | 2125/3000 [59:32<25:56,  1.78s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  71%|#######   | 2125/3000 [59:34<25:56,  1.78s/it, lr: 1.0e-04 loss: 2.983e-01]
a-cold-wall:  71%|#######   | 2125/3000 [59:34<25:56,  1.78s/it, lr: 1.0e-04 loss: 2.983e-01]
a-cold-wall:  71%|#######   | 2126/3000 [59:34<24:20,  1.67s/it, lr: 1.0e-04 loss: 2.983e-01]
a-cold-wall:  71%|#######   | 2126/3000 [59:34<24:20,  1.67s/it, lr: 1.0e-04 loss: 2.983e-01]
a-cold-wall:  71%|#######   | 2126/3000 [59:36<24:20,  1.67s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  71%|#######   | 2126/3000 [59:36<24:20,  1.67s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  71%|#######   | 2127/3000 [59:36<29:18,  2.01s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  71%|#######   | 2127/3000 [59:36<29:18,  2.01s/it, lr: 1.0e-04 loss: 1.786e-01]
a-cold-wall:  71%|#######   | 2127/3000 [59:37<29:18,  2.01s/it, lr: 1.0e-04 loss: 3.980e-01]
a-cold-wall:  71%|#######   | 2127/3000 [59:37<29:18,  2.01s/it, lr: 1.0e-04 loss: 3.980e-01]
a-cold-wall:  71%|#######   | 2128/3000 [59:37<23:53,  1.64s/it, lr: 1.0e-04 loss: 3.980e-01]
a-cold-wall:  71%|#######   | 2128/3000 [59:37<23:53,  1.64s/it, lr: 1.0e-04 loss: 3.980e-01]
a-cold-wall:  71%|#######   | 2128/3000 [59:38<23:53,  1.64s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  71%|#######   | 2128/3000 [59:38<23:53,  1.64s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  71%|#######   | 2129/3000 [59:38<20:00,  1.38s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  71%|#######   | 2129/3000 [59:38<20:00,  1.38s/it, lr: 1.0e-04 loss: 4.893e-01]
a-cold-wall:  71%|#######   | 2129/3000 [59:39<20:00,  1.38s/it, lr: 1.0e-04 loss: 7.090e-01]
a-cold-wall:  71%|#######   | 2129/3000 [59:39<20:00,  1.38s/it, lr: 1.0e-04 loss: 7.090e-01]
a-cold-wall:  71%|#######1  | 2130/3000 [59:40<19:58,  1.38s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  71%|#######1  | 2130/3000 [59:40<19:58,  1.38s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  71%|#######1  | 2131/3000 [59:40<15:30,  1.07s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  71%|#######1  | 2131/3000 [59:40<15:30,  1.07s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  71%|#######1  | 2131/3000 [59:43<15:30,  1.07s/it, lr: 1.0e-04 loss: 4.420e-01]
a-cold-wall:  71%|#######1  | 2131/3000 [59:43<15:30,  1.07s/it, lr: 1.0e-04 loss: 4.420e-01]
a-cold-wall:  71%|#######1  | 2132/3000 [59:43<21:52,  1.51s/it, lr: 1.0e-04 loss: 4.420e-01]
a-cold-wall:  71%|#######1  | 2132/3000 [59:43<21:52,  1.51s/it, lr: 1.0e-04 loss: 4.420e-01]
a-cold-wall:  71%|#######1  | 2132/3000 [59:44<21:52,  1.51s/it, lr: 1.0e-04 loss: 4.282e-01]
a-cold-wall:  71%|#######1  | 2132/3000 [59:44<21:52,  1.51s/it, lr: 1.0e-04 loss: 4.282e-01]
a-cold-wall:  71%|#######1  | 2133/3000 [59:44<18:56,  1.31s/it, lr: 1.0e-04 loss: 4.282e-01]
a-cold-wall:  71%|#######1  | 2133/3000 [59:44<18:56,  1.31s/it, lr: 1.0e-04 loss: 4.282e-01]
a-cold-wall:  71%|#######1  | 2133/3000 [59:45<18:56,  1.31s/it, lr: 1.0e-04 loss: 2.783e-01]
a-cold-wall:  71%|#######1  | 2133/3000 [59:45<18:56,  1.31s/it, lr: 1.0e-04 loss: 2.783e-01]
a-cold-wall:  71%|#######1  | 2134/3000 [59:45<17:01,  1.18s/it, lr: 1.0e-04 loss: 2.783e-01]
a-cold-wall:  71%|#######1  | 2134/3000 [59:45<17:01,  1.18s/it, lr: 1.0e-04 loss: 2.783e-01]
a-cold-wall:  71%|#######1  | 2134/3000 [59:47<17:01,  1.18s/it, lr: 1.0e-04 loss: 6.020e-01]
a-cold-wall:  71%|#######1  | 2134/3000 [59:47<17:01,  1.18s/it, lr: 1.0e-04 loss: 6.020e-01]
a-cold-wall:  71%|#######1  | 2135/3000 [59:47<23:45,  1.65s/it, lr: 1.0e-04 loss: 6.020e-01]
a-cold-wall:  71%|#######1  | 2135/3000 [59:47<23:45,  1.65s/it, lr: 1.0e-04 loss: 6.020e-01]
a-cold-wall:  71%|#######1  | 2135/3000 [59:50<23:45,  1.65s/it, lr: 1.0e-04 loss: 2.053e-01]
a-cold-wall:  71%|#######1  | 2135/3000 [59:50<23:45,  1.65s/it, lr: 1.0e-04 loss: 2.053e-01]
a-cold-wall:  71%|#######1  | 2136/3000 [59:50<28:40,  1.99s/it, lr: 1.0e-04 loss: 2.053e-01]
a-cold-wall:  71%|#######1  | 2136/3000 [59:50<28:40,  1.99s/it, lr: 1.0e-04 loss: 2.053e-01]
a-cold-wall:  71%|#######1  | 2136/3000 [59:52<28:40,  1.99s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  71%|#######1  | 2136/3000 [59:52<28:40,  1.99s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  71%|#######1  | 2137/3000 [59:52<26:16,  1.83s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  71%|#######1  | 2137/3000 [59:52<26:16,  1.83s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  71%|#######1  | 2137/3000 [59:53<26:16,  1.83s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  71%|#######1  | 2137/3000 [59:53<26:16,  1.83s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  71%|#######1  | 2138/3000 [59:53<25:09,  1.75s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  71%|#######1  | 2138/3000 [59:53<25:09,  1.75s/it, lr: 1.0e-04 loss: 7.490e-01]
a-cold-wall:  71%|#######1  | 2138/3000 [59:55<25:09,  1.75s/it, lr: 1.0e-04 loss: 7.187e-01]
a-cold-wall:  71%|#######1  | 2138/3000 [59:55<25:09,  1.75s/it, lr: 1.0e-04 loss: 7.187e-01]
a-cold-wall:  71%|#######1  | 2139/3000 [59:55<23:31,  1.64s/it, lr: 1.0e-04 loss: 7.187e-01]
a-cold-wall:  71%|#######1  | 2139/3000 [59:55<23:31,  1.64s/it, lr: 1.0e-04 loss: 7.187e-01]
a-cold-wall:  71%|#######1  | 2139/3000 [59:55<23:31,  1.64s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  71%|#######1  | 2139/3000 [59:55<23:31,  1.64s/it, lr: 1.0e-04 loss: 1.289e-01]
a-cold-wall:  71%|#######1  | 2140/3000 [59:57<23:29,  1.64s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  71%|#######1  | 2140/3000 [59:57<23:29,  1.64s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  71%|#######1  | 2141/3000 [59:57<17:12,  1.20s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  71%|#######1  | 2141/3000 [59:57<17:12,  1.20s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  71%|#######1  | 2141/3000 [1:00:00<17:12,  1.20s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  71%|#######1  | 2141/3000 [1:00:00<17:12,  1.20s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  71%|#######1  | 2142/3000 [1:00:00<22:56,  1.60s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  71%|#######1  | 2142/3000 [1:00:00<22:56,  1.60s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  71%|#######1  | 2142/3000 [1:00:01<22:56,  1.60s/it, lr: 1.0e-04 loss: 7.075e-01]
a-cold-wall:  71%|#######1  | 2142/3000 [1:00:01<22:56,  1.60s/it, lr: 1.0e-04 loss: 7.075e-01]
a-cold-wall:  71%|#######1  | 2143/3000 [1:00:01<22:16,  1.56s/it, lr: 1.0e-04 loss: 7.075e-01]
a-cold-wall:  71%|#######1  | 2143/3000 [1:00:01<22:16,  1.56s/it, lr: 1.0e-04 loss: 7.075e-01]
a-cold-wall:  71%|#######1  | 2143/3000 [1:00:02<22:16,  1.56s/it, lr: 1.0e-04 loss: 5.854e-01]
a-cold-wall:  71%|#######1  | 2143/3000 [1:00:02<22:16,  1.56s/it, lr: 1.0e-04 loss: 5.854e-01]
a-cold-wall:  71%|#######1  | 2144/3000 [1:00:02<19:06,  1.34s/it, lr: 1.0e-04 loss: 5.854e-01]
a-cold-wall:  71%|#######1  | 2144/3000 [1:00:02<19:06,  1.34s/it, lr: 1.0e-04 loss: 5.854e-01]
a-cold-wall:  71%|#######1  | 2144/3000 [1:00:05<19:06,  1.34s/it, lr: 1.0e-04 loss: 4.858e-01]
a-cold-wall:  71%|#######1  | 2144/3000 [1:00:05<19:06,  1.34s/it, lr: 1.0e-04 loss: 4.858e-01]
a-cold-wall:  72%|#######1  | 2145/3000 [1:00:05<25:07,  1.76s/it, lr: 1.0e-04 loss: 4.858e-01]
a-cold-wall:  72%|#######1  | 2145/3000 [1:00:05<25:07,  1.76s/it, lr: 1.0e-04 loss: 4.858e-01]
a-cold-wall:  72%|#######1  | 2145/3000 [1:00:07<25:07,  1.76s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  72%|#######1  | 2145/3000 [1:00:07<25:07,  1.76s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  72%|#######1  | 2146/3000 [1:00:07<29:33,  2.08s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  72%|#######1  | 2146/3000 [1:00:07<29:33,  2.08s/it, lr: 1.0e-04 loss: 3.247e-01]
a-cold-wall:  72%|#######1  | 2146/3000 [1:00:09<29:33,  2.08s/it, lr: 1.0e-04 loss: 4.748e-01]
a-cold-wall:  72%|#######1  | 2146/3000 [1:00:09<29:33,  2.08s/it, lr: 1.0e-04 loss: 4.748e-01]
a-cold-wall:  72%|#######1  | 2147/3000 [1:00:09<26:49,  1.89s/it, lr: 1.0e-04 loss: 4.748e-01]
a-cold-wall:  72%|#######1  | 2147/3000 [1:00:09<26:49,  1.89s/it, lr: 1.0e-04 loss: 4.748e-01]
a-cold-wall:  72%|#######1  | 2147/3000 [1:00:10<26:49,  1.89s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  72%|#######1  | 2147/3000 [1:00:10<26:49,  1.89s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  72%|#######1  | 2148/3000 [1:00:10<24:50,  1.75s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  72%|#######1  | 2148/3000 [1:00:10<24:50,  1.75s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  72%|#######1  | 2148/3000 [1:00:13<24:50,  1.75s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  72%|#######1  | 2148/3000 [1:00:13<24:50,  1.75s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  72%|#######1  | 2149/3000 [1:00:13<29:21,  2.07s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  72%|#######1  | 2149/3000 [1:00:13<29:21,  2.07s/it, lr: 1.0e-04 loss: 6.292e-01]
a-cold-wall:  72%|#######1  | 2149/3000 [1:00:16<29:21,  2.07s/it, lr: 1.0e-04 loss: 5.981e-01]
a-cold-wall:  72%|#######1  | 2149/3000 [1:00:16<29:21,  2.07s/it, lr: 1.0e-04 loss: 5.981e-01]
a-cold-wall:  72%|#######1  | 2150/3000 [1:00:17<29:19,  2.07s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  72%|#######1  | 2150/3000 [1:00:17<29:19,  2.07s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  72%|#######1  | 2151/3000 [1:00:17<18:18,  1.29s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  72%|#######1  | 2151/3000 [1:00:17<18:18,  1.29s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  72%|#######1  | 2151/3000 [1:00:18<18:18,  1.29s/it, lr: 1.0e-04 loss: 1.013e-01]
a-cold-wall:  72%|#######1  | 2151/3000 [1:00:18<18:18,  1.29s/it, lr: 1.0e-04 loss: 1.013e-01]
a-cold-wall:  72%|#######1  | 2152/3000 [1:00:18<19:23,  1.37s/it, lr: 1.0e-04 loss: 1.013e-01]
a-cold-wall:  72%|#######1  | 2152/3000 [1:00:18<19:23,  1.37s/it, lr: 1.0e-04 loss: 1.013e-01]
a-cold-wall:  72%|#######1  | 2152/3000 [1:00:20<19:23,  1.37s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  72%|#######1  | 2152/3000 [1:00:20<19:23,  1.37s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  72%|#######1  | 2153/3000 [1:00:20<19:55,  1.41s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  72%|#######1  | 2153/3000 [1:00:20<19:55,  1.41s/it, lr: 1.0e-04 loss: 2.911e-01]
a-cold-wall:  72%|#######1  | 2153/3000 [1:00:21<19:55,  1.41s/it, lr: 1.0e-04 loss: 1.783e-01]
a-cold-wall:  72%|#######1  | 2153/3000 [1:00:21<19:55,  1.41s/it, lr: 1.0e-04 loss: 1.783e-01]
a-cold-wall:  72%|#######1  | 2154/3000 [1:00:21<17:21,  1.23s/it, lr: 1.0e-04 loss: 1.783e-01]
a-cold-wall:  72%|#######1  | 2154/3000 [1:00:21<17:21,  1.23s/it, lr: 1.0e-04 loss: 1.783e-01]
a-cold-wall:  72%|#######1  | 2154/3000 [1:00:23<17:21,  1.23s/it, lr: 1.0e-04 loss: 4.666e-01]
a-cold-wall:  72%|#######1  | 2154/3000 [1:00:23<17:21,  1.23s/it, lr: 1.0e-04 loss: 4.666e-01]
a-cold-wall:  72%|#######1  | 2155/3000 [1:00:23<23:37,  1.68s/it, lr: 1.0e-04 loss: 4.666e-01]
a-cold-wall:  72%|#######1  | 2155/3000 [1:00:23<23:37,  1.68s/it, lr: 1.0e-04 loss: 4.666e-01]
a-cold-wall:  72%|#######1  | 2155/3000 [1:00:24<23:37,  1.68s/it, lr: 1.0e-04 loss: 6.331e-01]
a-cold-wall:  72%|#######1  | 2155/3000 [1:00:24<23:37,  1.68s/it, lr: 1.0e-04 loss: 6.331e-01]
a-cold-wall:  72%|#######1  | 2156/3000 [1:00:24<19:51,  1.41s/it, lr: 1.0e-04 loss: 6.331e-01]
a-cold-wall:  72%|#######1  | 2156/3000 [1:00:24<19:51,  1.41s/it, lr: 1.0e-04 loss: 6.331e-01]
a-cold-wall:  72%|#######1  | 2156/3000 [1:00:26<19:51,  1.41s/it, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  72%|#######1  | 2156/3000 [1:00:26<19:51,  1.41s/it, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  72%|#######1  | 2157/3000 [1:00:26<19:48,  1.41s/it, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  72%|#######1  | 2157/3000 [1:00:26<19:48,  1.41s/it, lr: 1.0e-04 loss: 3.183e-01]
a-cold-wall:  72%|#######1  | 2157/3000 [1:00:26<19:48,  1.41s/it, lr: 1.0e-04 loss: 4.073e-01]
a-cold-wall:  72%|#######1  | 2157/3000 [1:00:26<19:48,  1.41s/it, lr: 1.0e-04 loss: 4.073e-01]
a-cold-wall:  72%|#######1  | 2158/3000 [1:00:26<17:06,  1.22s/it, lr: 1.0e-04 loss: 4.073e-01]
a-cold-wall:  72%|#######1  | 2158/3000 [1:00:26<17:06,  1.22s/it, lr: 1.0e-04 loss: 4.073e-01]
a-cold-wall:  72%|#######1  | 2158/3000 [1:00:27<17:06,  1.22s/it, lr: 1.0e-04 loss: 4.617e-01]
a-cold-wall:  72%|#######1  | 2158/3000 [1:00:27<17:06,  1.22s/it, lr: 1.0e-04 loss: 4.617e-01]
a-cold-wall:  72%|#######1  | 2159/3000 [1:00:27<15:05,  1.08s/it, lr: 1.0e-04 loss: 4.617e-01]
a-cold-wall:  72%|#######1  | 2159/3000 [1:00:27<15:05,  1.08s/it, lr: 1.0e-04 loss: 4.617e-01]
a-cold-wall:  72%|#######1  | 2159/3000 [1:00:28<15:05,  1.08s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  72%|#######1  | 2159/3000 [1:00:28<15:05,  1.08s/it, lr: 1.0e-04 loss: 5.584e-01]
a-cold-wall:  72%|#######2  | 2160/3000 [1:00:29<15:04,  1.08s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  72%|#######2  | 2160/3000 [1:00:29<15:04,  1.08s/it, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  72%|#######2  | 2161/3000 [1:00:29<11:14,  1.24it/s, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  72%|#######2  | 2161/3000 [1:00:29<11:14,  1.24it/s, lr: 1.0e-04 loss: 6.099e-01]
a-cold-wall:  72%|#######2  | 2161/3000 [1:00:30<11:14,  1.24it/s, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  72%|#######2  | 2161/3000 [1:00:30<11:14,  1.24it/s, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  72%|#######2  | 2162/3000 [1:00:30<13:20,  1.05it/s, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  72%|#######2  | 2162/3000 [1:00:30<13:20,  1.05it/s, lr: 1.0e-04 loss: 5.091e-01]
a-cold-wall:  72%|#######2  | 2162/3000 [1:00:32<13:20,  1.05it/s, lr: 1.0e-04 loss: 6.546e-02]
a-cold-wall:  72%|#######2  | 2162/3000 [1:00:32<13:20,  1.05it/s, lr: 1.0e-04 loss: 6.546e-02]
a-cold-wall:  72%|#######2  | 2163/3000 [1:00:32<15:04,  1.08s/it, lr: 1.0e-04 loss: 6.546e-02]
a-cold-wall:  72%|#######2  | 2163/3000 [1:00:32<15:04,  1.08s/it, lr: 1.0e-04 loss: 6.546e-02]
a-cold-wall:  72%|#######2  | 2163/3000 [1:00:35<15:04,  1.08s/it, lr: 1.0e-04 loss: 4.410e-01]
a-cold-wall:  72%|#######2  | 2163/3000 [1:00:35<15:04,  1.08s/it, lr: 1.0e-04 loss: 4.410e-01]
a-cold-wall:  72%|#######2  | 2164/3000 [1:00:35<21:50,  1.57s/it, lr: 1.0e-04 loss: 4.410e-01]
a-cold-wall:  72%|#######2  | 2164/3000 [1:00:35<21:50,  1.57s/it, lr: 1.0e-04 loss: 4.410e-01]
a-cold-wall:  72%|#######2  | 2164/3000 [1:00:36<21:50,  1.57s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  72%|#######2  | 2164/3000 [1:00:36<21:50,  1.57s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  72%|#######2  | 2165/3000 [1:00:36<19:33,  1.41s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  72%|#######2  | 2165/3000 [1:00:36<19:33,  1.41s/it, lr: 1.0e-04 loss: 1.677e-01]
a-cold-wall:  72%|#######2  | 2165/3000 [1:00:38<19:33,  1.41s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  72%|#######2  | 2165/3000 [1:00:38<19:33,  1.41s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  72%|#######2  | 2166/3000 [1:00:38<25:24,  1.83s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  72%|#######2  | 2166/3000 [1:00:38<25:24,  1.83s/it, lr: 1.0e-04 loss: 5.667e-01]
a-cold-wall:  72%|#######2  | 2166/3000 [1:00:39<25:24,  1.83s/it, lr: 1.0e-04 loss: 5.010e-01]
a-cold-wall:  72%|#######2  | 2166/3000 [1:00:39<25:24,  1.83s/it, lr: 1.0e-04 loss: 5.010e-01]
a-cold-wall:  72%|#######2  | 2167/3000 [1:00:39<21:00,  1.51s/it, lr: 1.0e-04 loss: 5.010e-01]
a-cold-wall:  72%|#######2  | 2167/3000 [1:00:39<21:00,  1.51s/it, lr: 1.0e-04 loss: 5.010e-01]
a-cold-wall:  72%|#######2  | 2167/3000 [1:00:40<21:00,  1.51s/it, lr: 1.0e-04 loss: 2.777e-01]
a-cold-wall:  72%|#######2  | 2167/3000 [1:00:40<21:00,  1.51s/it, lr: 1.0e-04 loss: 2.777e-01]
a-cold-wall:  72%|#######2  | 2168/3000 [1:00:40<17:52,  1.29s/it, lr: 1.0e-04 loss: 2.777e-01]
a-cold-wall:  72%|#######2  | 2168/3000 [1:00:40<17:52,  1.29s/it, lr: 1.0e-04 loss: 2.777e-01]
a-cold-wall:  72%|#######2  | 2168/3000 [1:00:41<17:52,  1.29s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  72%|#######2  | 2168/3000 [1:00:41<17:52,  1.29s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  72%|#######2  | 2169/3000 [1:00:41<15:32,  1.12s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  72%|#######2  | 2169/3000 [1:00:41<15:32,  1.12s/it, lr: 1.0e-04 loss: 5.918e-01]
a-cold-wall:  72%|#######2  | 2169/3000 [1:00:41<15:32,  1.12s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  72%|#######2  | 2169/3000 [1:00:41<15:32,  1.12s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  72%|#######2  | 2170/3000 [1:00:44<15:31,  1.12s/it, lr: 1.0e-04 loss: 5.918e-02]
a-cold-wall:  72%|#######2  | 2170/3000 [1:00:44<15:31,  1.12s/it, lr: 1.0e-04 loss: 5.918e-02]
a-cold-wall:  72%|#######2  | 2171/3000 [1:00:44<17:25,  1.26s/it, lr: 1.0e-04 loss: 5.918e-02]
a-cold-wall:  72%|#######2  | 2171/3000 [1:00:44<17:25,  1.26s/it, lr: 1.0e-04 loss: 5.918e-02]
a-cold-wall:  72%|#######2  | 2171/3000 [1:00:45<17:25,  1.26s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  72%|#######2  | 2171/3000 [1:00:45<17:25,  1.26s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  72%|#######2  | 2172/3000 [1:00:45<15:40,  1.14s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  72%|#######2  | 2172/3000 [1:00:45<15:40,  1.14s/it, lr: 1.0e-04 loss: 2.638e-01]
a-cold-wall:  72%|#######2  | 2172/3000 [1:00:46<15:40,  1.14s/it, lr: 1.0e-04 loss: 3.624e-02]
a-cold-wall:  72%|#######2  | 2172/3000 [1:00:46<15:40,  1.14s/it, lr: 1.0e-04 loss: 3.624e-02]
a-cold-wall:  72%|#######2  | 2173/3000 [1:00:46<16:42,  1.21s/it, lr: 1.0e-04 loss: 3.624e-02]
a-cold-wall:  72%|#######2  | 2173/3000 [1:00:46<16:42,  1.21s/it, lr: 1.0e-04 loss: 3.624e-02]
a-cold-wall:  72%|#######2  | 2173/3000 [1:00:48<16:42,  1.21s/it, lr: 1.0e-04 loss: 7.520e-01]
a-cold-wall:  72%|#######2  | 2173/3000 [1:00:48<16:42,  1.21s/it, lr: 1.0e-04 loss: 7.520e-01]
a-cold-wall:  72%|#######2  | 2174/3000 [1:00:48<17:31,  1.27s/it, lr: 1.0e-04 loss: 7.520e-01]
a-cold-wall:  72%|#######2  | 2174/3000 [1:00:48<17:31,  1.27s/it, lr: 1.0e-04 loss: 7.520e-01]
a-cold-wall:  72%|#######2  | 2174/3000 [1:00:51<17:31,  1.27s/it, lr: 1.0e-04 loss: 2.632e-01]
a-cold-wall:  72%|#######2  | 2174/3000 [1:00:51<17:31,  1.27s/it, lr: 1.0e-04 loss: 2.632e-01]
a-cold-wall:  72%|#######2  | 2175/3000 [1:00:51<23:46,  1.73s/it, lr: 1.0e-04 loss: 2.632e-01]
a-cold-wall:  72%|#######2  | 2175/3000 [1:00:51<23:46,  1.73s/it, lr: 1.0e-04 loss: 2.632e-01]
a-cold-wall:  72%|#######2  | 2175/3000 [1:00:51<23:46,  1.73s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  72%|#######2  | 2175/3000 [1:00:51<23:46,  1.73s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  73%|#######2  | 2176/3000 [1:00:51<19:55,  1.45s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  73%|#######2  | 2176/3000 [1:00:51<19:55,  1.45s/it, lr: 1.0e-04 loss: 6.168e-01]
a-cold-wall:  73%|#######2  | 2176/3000 [1:00:52<19:55,  1.45s/it, lr: 1.0e-04 loss: 1.383e-01]
a-cold-wall:  73%|#######2  | 2176/3000 [1:00:52<19:55,  1.45s/it, lr: 1.0e-04 loss: 1.383e-01]
a-cold-wall:  73%|#######2  | 2177/3000 [1:00:52<17:59,  1.31s/it, lr: 1.0e-04 loss: 1.383e-01]
a-cold-wall:  73%|#######2  | 2177/3000 [1:00:52<17:59,  1.31s/it, lr: 1.0e-04 loss: 1.383e-01]
a-cold-wall:  73%|#######2  | 2177/3000 [1:00:53<17:59,  1.31s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  73%|#######2  | 2177/3000 [1:00:53<17:59,  1.31s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  73%|#######2  | 2178/3000 [1:00:53<16:38,  1.21s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  73%|#######2  | 2178/3000 [1:00:53<16:38,  1.21s/it, lr: 1.0e-04 loss: 4.456e-01]
a-cold-wall:  73%|#######2  | 2178/3000 [1:00:56<16:38,  1.21s/it, lr: 1.0e-04 loss: 5.477e-01]
a-cold-wall:  73%|#######2  | 2178/3000 [1:00:56<16:38,  1.21s/it, lr: 1.0e-04 loss: 5.477e-01]
a-cold-wall:  73%|#######2  | 2179/3000 [1:00:56<23:19,  1.70s/it, lr: 1.0e-04 loss: 5.477e-01]
a-cold-wall:  73%|#######2  | 2179/3000 [1:00:56<23:19,  1.70s/it, lr: 1.0e-04 loss: 5.477e-01]
a-cold-wall:  73%|#######2  | 2179/3000 [1:00:59<23:19,  1.70s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  73%|#######2  | 2179/3000 [1:00:59<23:19,  1.70s/it, lr: 1.0e-04 loss: 5.954e-01]
a-cold-wall:  73%|#######2  | 2180/3000 [1:01:00<23:17,  1.70s/it, lr: 1.0e-04 loss: 1.451e-01]
a-cold-wall:  73%|#######2  | 2180/3000 [1:01:00<23:17,  1.70s/it, lr: 1.0e-04 loss: 1.451e-01]
a-cold-wall:  73%|#######2  | 2181/3000 [1:01:00<14:59,  1.10s/it, lr: 1.0e-04 loss: 1.451e-01]
a-cold-wall:  73%|#######2  | 2181/3000 [1:01:00<14:59,  1.10s/it, lr: 1.0e-04 loss: 1.451e-01]
a-cold-wall:  73%|#######2  | 2181/3000 [1:01:01<14:59,  1.10s/it, lr: 1.0e-04 loss: 6.392e-01]
a-cold-wall:  73%|#######2  | 2181/3000 [1:01:01<14:59,  1.10s/it, lr: 1.0e-04 loss: 6.392e-01]
a-cold-wall:  73%|#######2  | 2182/3000 [1:01:01<16:04,  1.18s/it, lr: 1.0e-04 loss: 6.392e-01]
a-cold-wall:  73%|#######2  | 2182/3000 [1:01:01<16:04,  1.18s/it, lr: 1.0e-04 loss: 6.392e-01]
a-cold-wall:  73%|#######2  | 2182/3000 [1:01:03<16:04,  1.18s/it, lr: 1.0e-04 loss: 1.985e-01]
a-cold-wall:  73%|#######2  | 2182/3000 [1:01:03<16:04,  1.18s/it, lr: 1.0e-04 loss: 1.985e-01]
a-cold-wall:  73%|#######2  | 2183/3000 [1:01:03<16:56,  1.24s/it, lr: 1.0e-04 loss: 1.985e-01]
a-cold-wall:  73%|#######2  | 2183/3000 [1:01:03<16:56,  1.24s/it, lr: 1.0e-04 loss: 1.985e-01]
a-cold-wall:  73%|#######2  | 2183/3000 [1:01:04<16:56,  1.24s/it, lr: 1.0e-04 loss: 3.715e-01]
a-cold-wall:  73%|#######2  | 2183/3000 [1:01:04<16:56,  1.24s/it, lr: 1.0e-04 loss: 3.715e-01]
a-cold-wall:  73%|#######2  | 2184/3000 [1:01:04<15:05,  1.11s/it, lr: 1.0e-04 loss: 3.715e-01]
a-cold-wall:  73%|#######2  | 2184/3000 [1:01:04<15:05,  1.11s/it, lr: 1.0e-04 loss: 3.715e-01]
a-cold-wall:  73%|#######2  | 2184/3000 [1:01:04<15:05,  1.11s/it, lr: 1.0e-04 loss: 5.828e-02]
a-cold-wall:  73%|#######2  | 2184/3000 [1:01:04<15:05,  1.11s/it, lr: 1.0e-04 loss: 5.828e-02]
a-cold-wall:  73%|#######2  | 2185/3000 [1:01:04<13:43,  1.01s/it, lr: 1.0e-04 loss: 5.828e-02]
a-cold-wall:  73%|#######2  | 2185/3000 [1:01:04<13:43,  1.01s/it, lr: 1.0e-04 loss: 5.828e-02]
a-cold-wall:  73%|#######2  | 2185/3000 [1:01:06<13:43,  1.01s/it, lr: 1.0e-04 loss: 7.139e-01]
a-cold-wall:  73%|#######2  | 2185/3000 [1:01:06<13:43,  1.01s/it, lr: 1.0e-04 loss: 7.139e-01]
a-cold-wall:  73%|#######2  | 2186/3000 [1:01:06<15:21,  1.13s/it, lr: 1.0e-04 loss: 7.139e-01]
a-cold-wall:  73%|#######2  | 2186/3000 [1:01:06<15:21,  1.13s/it, lr: 1.0e-04 loss: 7.139e-01]
a-cold-wall:  73%|#######2  | 2186/3000 [1:01:09<15:21,  1.13s/it, lr: 1.0e-04 loss: 6.757e-01]
a-cold-wall:  73%|#######2  | 2186/3000 [1:01:09<15:21,  1.13s/it, lr: 1.0e-04 loss: 6.757e-01]
a-cold-wall:  73%|#######2  | 2187/3000 [1:01:09<22:15,  1.64s/it, lr: 1.0e-04 loss: 6.757e-01]
a-cold-wall:  73%|#######2  | 2187/3000 [1:01:09<22:15,  1.64s/it, lr: 1.0e-04 loss: 6.757e-01]
a-cold-wall:  73%|#######2  | 2187/3000 [1:01:10<22:15,  1.64s/it, lr: 1.0e-04 loss: 1.862e-01]
a-cold-wall:  73%|#######2  | 2187/3000 [1:01:10<22:15,  1.64s/it, lr: 1.0e-04 loss: 1.862e-01]
a-cold-wall:  73%|#######2  | 2188/3000 [1:01:10<21:23,  1.58s/it, lr: 1.0e-04 loss: 1.862e-01]
a-cold-wall:  73%|#######2  | 2188/3000 [1:01:10<21:23,  1.58s/it, lr: 1.0e-04 loss: 1.862e-01]
a-cold-wall:  73%|#######2  | 2188/3000 [1:01:13<21:23,  1.58s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  73%|#######2  | 2188/3000 [1:01:13<21:23,  1.58s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  73%|#######2  | 2189/3000 [1:01:13<26:45,  1.98s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  73%|#######2  | 2189/3000 [1:01:13<26:45,  1.98s/it, lr: 1.0e-04 loss: 2.084e-01]
a-cold-wall:  73%|#######2  | 2189/3000 [1:01:14<26:45,  1.98s/it, lr: 1.0e-04 loss: 5.866e-01]
a-cold-wall:  73%|#######2  | 2189/3000 [1:01:14<26:45,  1.98s/it, lr: 1.0e-04 loss: 5.866e-01]
a-cold-wall:  73%|#######3  | 2190/3000 [1:01:15<26:43,  1.98s/it, lr: 1.0e-04 loss: 6.466e-01]
a-cold-wall:  73%|#######3  | 2190/3000 [1:01:15<26:43,  1.98s/it, lr: 1.0e-04 loss: 6.466e-01]
a-cold-wall:  73%|#######3  | 2191/3000 [1:01:15<18:49,  1.40s/it, lr: 1.0e-04 loss: 6.466e-01]
a-cold-wall:  73%|#######3  | 2191/3000 [1:01:15<18:49,  1.40s/it, lr: 1.0e-04 loss: 6.466e-01]
a-cold-wall:  73%|#######3  | 2191/3000 [1:01:18<18:49,  1.40s/it, lr: 1.0e-04 loss: 4.867e-01]
a-cold-wall:  73%|#######3  | 2191/3000 [1:01:18<18:49,  1.40s/it, lr: 1.0e-04 loss: 4.867e-01]
a-cold-wall:  73%|#######3  | 2192/3000 [1:01:18<23:41,  1.76s/it, lr: 1.0e-04 loss: 4.867e-01]
a-cold-wall:  73%|#######3  | 2192/3000 [1:01:18<23:41,  1.76s/it, lr: 1.0e-04 loss: 4.867e-01]
a-cold-wall:  73%|#######3  | 2192/3000 [1:01:20<23:41,  1.76s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  73%|#######3  | 2192/3000 [1:01:20<23:41,  1.76s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  73%|#######3  | 2193/3000 [1:01:20<23:03,  1.71s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  73%|#######3  | 2193/3000 [1:01:20<23:03,  1.71s/it, lr: 1.0e-04 loss: 4.967e-01]
a-cold-wall:  73%|#######3  | 2193/3000 [1:01:21<23:03,  1.71s/it, lr: 1.0e-04 loss: 6.794e-01]
a-cold-wall:  73%|#######3  | 2193/3000 [1:01:21<23:03,  1.71s/it, lr: 1.0e-04 loss: 6.794e-01]
a-cold-wall:  73%|#######3  | 2194/3000 [1:01:21<21:55,  1.63s/it, lr: 1.0e-04 loss: 6.794e-01]
a-cold-wall:  73%|#######3  | 2194/3000 [1:01:21<21:55,  1.63s/it, lr: 1.0e-04 loss: 6.794e-01]
a-cold-wall:  73%|#######3  | 2194/3000 [1:01:24<21:55,  1.63s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  73%|#######3  | 2194/3000 [1:01:24<21:55,  1.63s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  73%|#######3  | 2195/3000 [1:01:24<26:23,  1.97s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  73%|#######3  | 2195/3000 [1:01:24<26:23,  1.97s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  73%|#######3  | 2195/3000 [1:01:25<26:23,  1.97s/it, lr: 1.0e-04 loss: 1.295e-01]
a-cold-wall:  73%|#######3  | 2195/3000 [1:01:25<26:23,  1.97s/it, lr: 1.0e-04 loss: 1.295e-01]
a-cold-wall:  73%|#######3  | 2196/3000 [1:01:25<21:41,  1.62s/it, lr: 1.0e-04 loss: 1.295e-01]
a-cold-wall:  73%|#######3  | 2196/3000 [1:01:25<21:41,  1.62s/it, lr: 1.0e-04 loss: 1.295e-01]
a-cold-wall:  73%|#######3  | 2196/3000 [1:01:28<21:41,  1.62s/it, lr: 1.0e-04 loss: 7.233e-01]
a-cold-wall:  73%|#######3  | 2196/3000 [1:01:28<21:41,  1.62s/it, lr: 1.0e-04 loss: 7.233e-01]
a-cold-wall:  73%|#######3  | 2197/3000 [1:01:28<26:27,  1.98s/it, lr: 1.0e-04 loss: 7.233e-01]
a-cold-wall:  73%|#######3  | 2197/3000 [1:01:28<26:27,  1.98s/it, lr: 1.0e-04 loss: 7.233e-01]
a-cold-wall:  73%|#######3  | 2197/3000 [1:01:30<26:27,  1.98s/it, lr: 1.0e-04 loss: 7.275e-01]
a-cold-wall:  73%|#######3  | 2197/3000 [1:01:30<26:27,  1.98s/it, lr: 1.0e-04 loss: 7.275e-01]
a-cold-wall:  73%|#######3  | 2198/3000 [1:01:30<29:44,  2.22s/it, lr: 1.0e-04 loss: 7.275e-01]
a-cold-wall:  73%|#######3  | 2198/3000 [1:01:30<29:44,  2.22s/it, lr: 1.0e-04 loss: 7.275e-01]
a-cold-wall:  73%|#######3  | 2198/3000 [1:01:31<29:44,  2.22s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  73%|#######3  | 2198/3000 [1:01:31<29:44,  2.22s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  73%|#######3  | 2199/3000 [1:01:31<23:46,  1.78s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  73%|#######3  | 2199/3000 [1:01:31<23:46,  1.78s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  73%|#######3  | 2199/3000 [1:01:34<23:46,  1.78s/it, lr: 1.0e-04 loss: 5.141e-01]
a-cold-wall:  73%|#######3  | 2199/3000 [1:01:34<23:46,  1.78s/it, lr: 1.0e-04 loss: 5.141e-01]
a-cold-wall:  73%|#######3  | 2200/3000 [1:01:35<23:44,  1.78s/it, lr: 1.0e-04 loss: 1.413e-01]
a-cold-wall:  73%|#######3  | 2200/3000 [1:01:35<23:44,  1.78s/it, lr: 1.0e-04 loss: 1.413e-01]
a-cold-wall:  73%|#######3  | 2201/3000 [1:01:35<15:10,  1.14s/it, lr: 1.0e-04 loss: 1.413e-01]
a-cold-wall:  73%|#######3  | 2201/3000 [1:01:35<15:10,  1.14s/it, lr: 1.0e-04 loss: 1.413e-01]
a-cold-wall:  73%|#######3  | 2201/3000 [1:01:36<15:10,  1.14s/it, lr: 1.0e-04 loss: 4.998e-01]
a-cold-wall:  73%|#######3  | 2201/3000 [1:01:36<15:10,  1.14s/it, lr: 1.0e-04 loss: 4.998e-01]
a-cold-wall:  73%|#######3  | 2202/3000 [1:01:36<15:58,  1.20s/it, lr: 1.0e-04 loss: 4.998e-01]
a-cold-wall:  73%|#######3  | 2202/3000 [1:01:36<15:58,  1.20s/it, lr: 1.0e-04 loss: 4.998e-01]
a-cold-wall:  73%|#######3  | 2202/3000 [1:01:39<15:58,  1.20s/it, lr: 1.0e-04 loss: 1.621e-01]
a-cold-wall:  73%|#######3  | 2202/3000 [1:01:39<15:58,  1.20s/it, lr: 1.0e-04 loss: 1.621e-01]
a-cold-wall:  73%|#######3  | 2203/3000 [1:01:39<21:32,  1.62s/it, lr: 1.0e-04 loss: 1.621e-01]
a-cold-wall:  73%|#######3  | 2203/3000 [1:01:39<21:32,  1.62s/it, lr: 1.0e-04 loss: 1.621e-01]
a-cold-wall:  73%|#######3  | 2203/3000 [1:01:40<21:32,  1.62s/it, lr: 1.0e-04 loss: 2.571e-01]
a-cold-wall:  73%|#######3  | 2203/3000 [1:01:40<21:32,  1.62s/it, lr: 1.0e-04 loss: 2.571e-01]
a-cold-wall:  73%|#######3  | 2204/3000 [1:01:40<20:47,  1.57s/it, lr: 1.0e-04 loss: 2.571e-01]
a-cold-wall:  73%|#######3  | 2204/3000 [1:01:40<20:47,  1.57s/it, lr: 1.0e-04 loss: 2.571e-01]
a-cold-wall:  73%|#######3  | 2204/3000 [1:01:42<20:47,  1.57s/it, lr: 1.0e-04 loss: 4.715e-01]
a-cold-wall:  73%|#######3  | 2204/3000 [1:01:42<20:47,  1.57s/it, lr: 1.0e-04 loss: 4.715e-01]
a-cold-wall:  74%|#######3  | 2205/3000 [1:01:42<17:56,  1.35s/it, lr: 1.0e-04 loss: 4.715e-01]
a-cold-wall:  74%|#######3  | 2205/3000 [1:01:42<17:56,  1.35s/it, lr: 1.0e-04 loss: 4.715e-01]
a-cold-wall:  74%|#######3  | 2205/3000 [1:01:42<17:56,  1.35s/it, lr: 1.0e-04 loss: 4.371e-01]
a-cold-wall:  74%|#######3  | 2205/3000 [1:01:42<17:56,  1.35s/it, lr: 1.0e-04 loss: 4.371e-01]
a-cold-wall:  74%|#######3  | 2206/3000 [1:01:42<15:35,  1.18s/it, lr: 1.0e-04 loss: 4.371e-01]
a-cold-wall:  74%|#######3  | 2206/3000 [1:01:42<15:35,  1.18s/it, lr: 1.0e-04 loss: 4.371e-01]
a-cold-wall:  74%|#######3  | 2206/3000 [1:01:44<15:35,  1.18s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  74%|#######3  | 2206/3000 [1:01:44<15:35,  1.18s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  74%|#######3  | 2207/3000 [1:01:44<17:28,  1.32s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  74%|#######3  | 2207/3000 [1:01:44<17:28,  1.32s/it, lr: 1.0e-04 loss: 4.971e-01]
a-cold-wall:  74%|#######3  | 2207/3000 [1:01:45<17:28,  1.32s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  74%|#######3  | 2207/3000 [1:01:45<17:28,  1.32s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  74%|#######3  | 2208/3000 [1:01:45<17:44,  1.34s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  74%|#######3  | 2208/3000 [1:01:45<17:44,  1.34s/it, lr: 1.0e-04 loss: 3.203e-01]
a-cold-wall:  74%|#######3  | 2208/3000 [1:01:46<17:44,  1.34s/it, lr: 1.0e-04 loss: 1.212e-01]
a-cold-wall:  74%|#######3  | 2208/3000 [1:01:46<17:44,  1.34s/it, lr: 1.0e-04 loss: 1.212e-01]
a-cold-wall:  74%|#######3  | 2209/3000 [1:01:46<15:22,  1.17s/it, lr: 1.0e-04 loss: 1.212e-01]
a-cold-wall:  74%|#######3  | 2209/3000 [1:01:46<15:22,  1.17s/it, lr: 1.0e-04 loss: 1.212e-01]
a-cold-wall:  74%|#######3  | 2209/3000 [1:01:47<15:22,  1.17s/it, lr: 1.0e-04 loss: 1.585e-01]
a-cold-wall:  74%|#######3  | 2209/3000 [1:01:47<15:22,  1.17s/it, lr: 1.0e-04 loss: 1.585e-01]
a-cold-wall:  74%|#######3  | 2210/3000 [1:01:48<15:21,  1.17s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  74%|#######3  | 2210/3000 [1:01:48<15:21,  1.17s/it, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  74%|#######3  | 2211/3000 [1:01:48<10:33,  1.25it/s, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  74%|#######3  | 2211/3000 [1:01:48<10:33,  1.25it/s, lr: 1.0e-04 loss: 3.982e-01]
a-cold-wall:  74%|#######3  | 2211/3000 [1:01:49<10:33,  1.25it/s, lr: 1.0e-04 loss: 1.297e-01]
a-cold-wall:  74%|#######3  | 2211/3000 [1:01:49<10:33,  1.25it/s, lr: 1.0e-04 loss: 1.297e-01]
a-cold-wall:  74%|#######3  | 2212/3000 [1:01:49<12:21,  1.06it/s, lr: 1.0e-04 loss: 1.297e-01]
a-cold-wall:  74%|#######3  | 2212/3000 [1:01:49<12:21,  1.06it/s, lr: 1.0e-04 loss: 1.297e-01]
a-cold-wall:  74%|#######3  | 2212/3000 [1:01:50<12:21,  1.06it/s, lr: 1.0e-04 loss: 4.274e-01]
a-cold-wall:  74%|#######3  | 2212/3000 [1:01:50<12:21,  1.06it/s, lr: 1.0e-04 loss: 4.274e-01]
a-cold-wall:  74%|#######3  | 2213/3000 [1:01:50<12:24,  1.06it/s, lr: 1.0e-04 loss: 4.274e-01]
a-cold-wall:  74%|#######3  | 2213/3000 [1:01:50<12:24,  1.06it/s, lr: 1.0e-04 loss: 4.274e-01]
a-cold-wall:  74%|#######3  | 2213/3000 [1:01:53<12:24,  1.06it/s, lr: 1.0e-04 loss: 6.078e-01]
a-cold-wall:  74%|#######3  | 2213/3000 [1:01:53<12:24,  1.06it/s, lr: 1.0e-04 loss: 6.078e-01]
a-cold-wall:  74%|#######3  | 2214/3000 [1:01:53<19:10,  1.46s/it, lr: 1.0e-04 loss: 6.078e-01]
a-cold-wall:  74%|#######3  | 2214/3000 [1:01:53<19:10,  1.46s/it, lr: 1.0e-04 loss: 6.078e-01]
a-cold-wall:  74%|#######3  | 2214/3000 [1:01:54<19:10,  1.46s/it, lr: 1.0e-04 loss: 7.230e-02]
a-cold-wall:  74%|#######3  | 2214/3000 [1:01:54<19:10,  1.46s/it, lr: 1.0e-04 loss: 7.230e-02]
a-cold-wall:  74%|#######3  | 2215/3000 [1:01:54<18:56,  1.45s/it, lr: 1.0e-04 loss: 7.230e-02]
a-cold-wall:  74%|#######3  | 2215/3000 [1:01:54<18:56,  1.45s/it, lr: 1.0e-04 loss: 7.230e-02]
a-cold-wall:  74%|#######3  | 2215/3000 [1:01:55<18:56,  1.45s/it, lr: 1.0e-04 loss: 5.945e-01]
a-cold-wall:  74%|#######3  | 2215/3000 [1:01:55<18:56,  1.45s/it, lr: 1.0e-04 loss: 5.945e-01]
a-cold-wall:  74%|#######3  | 2216/3000 [1:01:55<16:12,  1.24s/it, lr: 1.0e-04 loss: 5.945e-01]
a-cold-wall:  74%|#######3  | 2216/3000 [1:01:55<16:12,  1.24s/it, lr: 1.0e-04 loss: 5.945e-01]
a-cold-wall:  74%|#######3  | 2216/3000 [1:01:58<16:12,  1.24s/it, lr: 1.0e-04 loss: 4.679e-01]
a-cold-wall:  74%|#######3  | 2216/3000 [1:01:58<16:12,  1.24s/it, lr: 1.0e-04 loss: 4.679e-01]
a-cold-wall:  74%|#######3  | 2217/3000 [1:01:58<22:07,  1.70s/it, lr: 1.0e-04 loss: 4.679e-01]
a-cold-wall:  74%|#######3  | 2217/3000 [1:01:58<22:07,  1.70s/it, lr: 1.0e-04 loss: 4.679e-01]
a-cold-wall:  74%|#######3  | 2217/3000 [1:01:59<22:07,  1.70s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  74%|#######3  | 2217/3000 [1:01:59<22:07,  1.70s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  74%|#######3  | 2218/3000 [1:01:59<20:57,  1.61s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  74%|#######3  | 2218/3000 [1:01:59<20:57,  1.61s/it, lr: 1.0e-04 loss: 4.687e-01]
a-cold-wall:  74%|#######3  | 2218/3000 [1:02:01<20:57,  1.61s/it, lr: 1.0e-04 loss: 7.754e-02]
a-cold-wall:  74%|#######3  | 2218/3000 [1:02:01<20:57,  1.61s/it, lr: 1.0e-04 loss: 7.754e-02]
a-cold-wall:  74%|#######3  | 2219/3000 [1:02:01<20:09,  1.55s/it, lr: 1.0e-04 loss: 7.754e-02]
a-cold-wall:  74%|#######3  | 2219/3000 [1:02:01<20:09,  1.55s/it, lr: 1.0e-04 loss: 7.754e-02]
a-cold-wall:  74%|#######3  | 2219/3000 [1:02:04<20:09,  1.55s/it, lr: 1.0e-04 loss: 5.627e-01]
a-cold-wall:  74%|#######3  | 2219/3000 [1:02:04<20:09,  1.55s/it, lr: 1.0e-04 loss: 5.627e-01]
a-cold-wall:  74%|#######4  | 2220/3000 [1:02:05<20:08,  1.55s/it, lr: 1.0e-04 loss: 1.666e-01]
a-cold-wall:  74%|#######4  | 2220/3000 [1:02:05<20:08,  1.55s/it, lr: 1.0e-04 loss: 1.666e-01]
a-cold-wall:  74%|#######4  | 2221/3000 [1:02:05<15:03,  1.16s/it, lr: 1.0e-04 loss: 1.666e-01]
a-cold-wall:  74%|#######4  | 2221/3000 [1:02:05<15:03,  1.16s/it, lr: 1.0e-04 loss: 1.666e-01]
a-cold-wall:  74%|#######4  | 2221/3000 [1:02:06<15:03,  1.16s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  74%|#######4  | 2221/3000 [1:02:06<15:03,  1.16s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  74%|#######4  | 2222/3000 [1:02:06<13:40,  1.06s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  74%|#######4  | 2222/3000 [1:02:06<13:40,  1.06s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  74%|#######4  | 2222/3000 [1:02:09<13:40,  1.06s/it, lr: 1.0e-04 loss: 6.680e-01]
a-cold-wall:  74%|#######4  | 2222/3000 [1:02:09<13:40,  1.06s/it, lr: 1.0e-04 loss: 6.680e-01]
a-cold-wall:  74%|#######4  | 2223/3000 [1:02:09<19:42,  1.52s/it, lr: 1.0e-04 loss: 6.680e-01]
a-cold-wall:  74%|#######4  | 2223/3000 [1:02:09<19:42,  1.52s/it, lr: 1.0e-04 loss: 6.680e-01]
a-cold-wall:  74%|#######4  | 2223/3000 [1:02:11<19:42,  1.52s/it, lr: 1.0e-04 loss: 4.229e-01]
a-cold-wall:  74%|#######4  | 2223/3000 [1:02:11<19:42,  1.52s/it, lr: 1.0e-04 loss: 4.229e-01]
a-cold-wall:  74%|#######4  | 2224/3000 [1:02:11<24:20,  1.88s/it, lr: 1.0e-04 loss: 4.229e-01]
a-cold-wall:  74%|#######4  | 2224/3000 [1:02:11<24:20,  1.88s/it, lr: 1.0e-04 loss: 4.229e-01]
a-cold-wall:  74%|#######4  | 2224/3000 [1:02:14<24:20,  1.88s/it, lr: 1.0e-04 loss: 6.363e-01]
a-cold-wall:  74%|#######4  | 2224/3000 [1:02:14<24:20,  1.88s/it, lr: 1.0e-04 loss: 6.363e-01]
a-cold-wall:  74%|#######4  | 2225/3000 [1:02:14<27:39,  2.14s/it, lr: 1.0e-04 loss: 6.363e-01]
a-cold-wall:  74%|#######4  | 2225/3000 [1:02:14<27:39,  2.14s/it, lr: 1.0e-04 loss: 6.363e-01]
a-cold-wall:  74%|#######4  | 2225/3000 [1:02:15<27:39,  2.14s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  74%|#######4  | 2225/3000 [1:02:15<27:39,  2.14s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  74%|#######4  | 2226/3000 [1:02:15<22:28,  1.74s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  74%|#######4  | 2226/3000 [1:02:15<22:28,  1.74s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  74%|#######4  | 2226/3000 [1:02:16<22:28,  1.74s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  74%|#######4  | 2226/3000 [1:02:16<22:28,  1.74s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  74%|#######4  | 2227/3000 [1:02:16<21:09,  1.64s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  74%|#######4  | 2227/3000 [1:02:16<21:09,  1.64s/it, lr: 1.0e-04 loss: 2.806e-01]
a-cold-wall:  74%|#######4  | 2227/3000 [1:02:18<21:09,  1.64s/it, lr: 1.0e-04 loss: 6.614e-02]
a-cold-wall:  74%|#######4  | 2227/3000 [1:02:18<21:09,  1.64s/it, lr: 1.0e-04 loss: 6.614e-02]
a-cold-wall:  74%|#######4  | 2228/3000 [1:02:18<20:12,  1.57s/it, lr: 1.0e-04 loss: 6.614e-02]
a-cold-wall:  74%|#######4  | 2228/3000 [1:02:18<20:12,  1.57s/it, lr: 1.0e-04 loss: 6.614e-02]
a-cold-wall:  74%|#######4  | 2228/3000 [1:02:19<20:12,  1.57s/it, lr: 1.0e-04 loss: 5.574e-01]
a-cold-wall:  74%|#######4  | 2228/3000 [1:02:19<20:12,  1.57s/it, lr: 1.0e-04 loss: 5.574e-01]
a-cold-wall:  74%|#######4  | 2229/3000 [1:02:19<16:58,  1.32s/it, lr: 1.0e-04 loss: 5.574e-01]
a-cold-wall:  74%|#######4  | 2229/3000 [1:02:19<16:58,  1.32s/it, lr: 1.0e-04 loss: 5.574e-01]
a-cold-wall:  74%|#######4  | 2229/3000 [1:02:20<16:58,  1.32s/it, lr: 1.0e-04 loss: 1.814e-01]
a-cold-wall:  74%|#######4  | 2229/3000 [1:02:20<16:58,  1.32s/it, lr: 1.0e-04 loss: 1.814e-01]
a-cold-wall:  74%|#######4  | 2230/3000 [1:02:21<16:56,  1.32s/it, lr: 1.0e-04 loss: 7.563e-01]
a-cold-wall:  74%|#######4  | 2230/3000 [1:02:21<16:56,  1.32s/it, lr: 1.0e-04 loss: 7.563e-01]
a-cold-wall:  74%|#######4  | 2231/3000 [1:02:21<13:16,  1.04s/it, lr: 1.0e-04 loss: 7.563e-01]
a-cold-wall:  74%|#######4  | 2231/3000 [1:02:21<13:16,  1.04s/it, lr: 1.0e-04 loss: 7.563e-01]
a-cold-wall:  74%|#######4  | 2231/3000 [1:02:23<13:16,  1.04s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  74%|#######4  | 2231/3000 [1:02:23<13:16,  1.04s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  74%|#######4  | 2232/3000 [1:02:23<14:23,  1.12s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  74%|#######4  | 2232/3000 [1:02:23<14:23,  1.12s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  74%|#######4  | 2232/3000 [1:02:24<14:23,  1.12s/it, lr: 1.0e-04 loss: 5.289e-01]
a-cold-wall:  74%|#######4  | 2232/3000 [1:02:24<14:23,  1.12s/it, lr: 1.0e-04 loss: 5.289e-01]
a-cold-wall:  74%|#######4  | 2233/3000 [1:02:24<15:55,  1.25s/it, lr: 1.0e-04 loss: 5.289e-01]
a-cold-wall:  74%|#######4  | 2233/3000 [1:02:24<15:55,  1.25s/it, lr: 1.0e-04 loss: 5.289e-01]
a-cold-wall:  74%|#######4  | 2233/3000 [1:02:25<15:55,  1.25s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  74%|#######4  | 2233/3000 [1:02:25<15:55,  1.25s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  74%|#######4  | 2234/3000 [1:02:25<14:09,  1.11s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  74%|#######4  | 2234/3000 [1:02:25<14:09,  1.11s/it, lr: 1.0e-04 loss: 2.196e-01]
a-cold-wall:  74%|#######4  | 2234/3000 [1:02:26<14:09,  1.11s/it, lr: 1.0e-04 loss: 2.356e-01]
a-cold-wall:  74%|#######4  | 2234/3000 [1:02:26<14:09,  1.11s/it, lr: 1.0e-04 loss: 2.356e-01]
a-cold-wall:  74%|#######4  | 2235/3000 [1:02:26<15:09,  1.19s/it, lr: 1.0e-04 loss: 2.356e-01]
a-cold-wall:  74%|#######4  | 2235/3000 [1:02:26<15:09,  1.19s/it, lr: 1.0e-04 loss: 2.356e-01]
a-cold-wall:  74%|#######4  | 2235/3000 [1:02:27<15:09,  1.19s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  74%|#######4  | 2235/3000 [1:02:27<15:09,  1.19s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  75%|#######4  | 2236/3000 [1:02:27<13:31,  1.06s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  75%|#######4  | 2236/3000 [1:02:27<13:31,  1.06s/it, lr: 1.0e-04 loss: 5.621e-01]
a-cold-wall:  75%|#######4  | 2236/3000 [1:02:29<13:31,  1.06s/it, lr: 1.0e-04 loss: 3.170e-01]
a-cold-wall:  75%|#######4  | 2236/3000 [1:02:29<13:31,  1.06s/it, lr: 1.0e-04 loss: 3.170e-01]
a-cold-wall:  75%|#######4  | 2237/3000 [1:02:29<15:10,  1.19s/it, lr: 1.0e-04 loss: 3.170e-01]
a-cold-wall:  75%|#######4  | 2237/3000 [1:02:29<15:10,  1.19s/it, lr: 1.0e-04 loss: 3.170e-01]
a-cold-wall:  75%|#######4  | 2237/3000 [1:02:32<15:10,  1.19s/it, lr: 1.0e-04 loss: 2.047e-01]
a-cold-wall:  75%|#######4  | 2237/3000 [1:02:32<15:10,  1.19s/it, lr: 1.0e-04 loss: 2.047e-01]
a-cold-wall:  75%|#######4  | 2238/3000 [1:02:32<21:16,  1.68s/it, lr: 1.0e-04 loss: 2.047e-01]
a-cold-wall:  75%|#######4  | 2238/3000 [1:02:32<21:16,  1.68s/it, lr: 1.0e-04 loss: 2.047e-01]
a-cold-wall:  75%|#######4  | 2238/3000 [1:02:33<21:16,  1.68s/it, lr: 1.0e-04 loss: 4.676e-01]
a-cold-wall:  75%|#######4  | 2238/3000 [1:02:33<21:16,  1.68s/it, lr: 1.0e-04 loss: 4.676e-01]
a-cold-wall:  75%|#######4  | 2239/3000 [1:02:33<20:19,  1.60s/it, lr: 1.0e-04 loss: 4.676e-01]
a-cold-wall:  75%|#######4  | 2239/3000 [1:02:33<20:19,  1.60s/it, lr: 1.0e-04 loss: 4.676e-01]
a-cold-wall:  75%|#######4  | 2239/3000 [1:02:36<20:19,  1.60s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  75%|#######4  | 2239/3000 [1:02:36<20:19,  1.60s/it, lr: 1.0e-04 loss: 3.599e-01]
a-cold-wall:  75%|#######4  | 2240/3000 [1:02:37<20:18,  1.60s/it, lr: 1.0e-04 loss: 4.049e-01]
a-cold-wall:  75%|#######4  | 2240/3000 [1:02:37<20:18,  1.60s/it, lr: 1.0e-04 loss: 4.049e-01]
a-cold-wall:  75%|#######4  | 2241/3000 [1:02:37<13:09,  1.04s/it, lr: 1.0e-04 loss: 4.049e-01]
a-cold-wall:  75%|#######4  | 2241/3000 [1:02:37<13:09,  1.04s/it, lr: 1.0e-04 loss: 4.049e-01]
a-cold-wall:  75%|#######4  | 2241/3000 [1:02:37<13:09,  1.04s/it, lr: 1.0e-04 loss: 7.665e-01]
a-cold-wall:  75%|#######4  | 2241/3000 [1:02:37<13:09,  1.04s/it, lr: 1.0e-04 loss: 7.665e-01]
a-cold-wall:  75%|#######4  | 2242/3000 [1:02:37<12:12,  1.03it/s, lr: 1.0e-04 loss: 7.665e-01]
a-cold-wall:  75%|#######4  | 2242/3000 [1:02:37<12:12,  1.03it/s, lr: 1.0e-04 loss: 7.665e-01]
a-cold-wall:  75%|#######4  | 2242/3000 [1:02:38<12:12,  1.03it/s, lr: 1.0e-04 loss: 6.755e-01]
a-cold-wall:  75%|#######4  | 2242/3000 [1:02:38<12:12,  1.03it/s, lr: 1.0e-04 loss: 6.755e-01]
a-cold-wall:  75%|#######4  | 2243/3000 [1:02:38<11:30,  1.10it/s, lr: 1.0e-04 loss: 6.755e-01]
a-cold-wall:  75%|#######4  | 2243/3000 [1:02:38<11:30,  1.10it/s, lr: 1.0e-04 loss: 6.755e-01]
a-cold-wall:  75%|#######4  | 2243/3000 [1:02:41<11:30,  1.10it/s, lr: 1.0e-04 loss: 4.380e-01]
a-cold-wall:  75%|#######4  | 2243/3000 [1:02:41<11:30,  1.10it/s, lr: 1.0e-04 loss: 4.380e-01]
a-cold-wall:  75%|#######4  | 2244/3000 [1:02:41<18:17,  1.45s/it, lr: 1.0e-04 loss: 4.380e-01]
a-cold-wall:  75%|#######4  | 2244/3000 [1:02:41<18:17,  1.45s/it, lr: 1.0e-04 loss: 4.380e-01]
a-cold-wall:  75%|#######4  | 2244/3000 [1:02:42<18:17,  1.45s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  75%|#######4  | 2244/3000 [1:02:42<18:17,  1.45s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  75%|#######4  | 2245/3000 [1:02:42<18:06,  1.44s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  75%|#######4  | 2245/3000 [1:02:42<18:06,  1.44s/it, lr: 1.0e-04 loss: 6.301e-01]
a-cold-wall:  75%|#######4  | 2245/3000 [1:02:45<18:06,  1.44s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  75%|#######4  | 2245/3000 [1:02:45<18:06,  1.44s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  75%|#######4  | 2246/3000 [1:02:45<23:06,  1.84s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  75%|#######4  | 2246/3000 [1:02:45<23:06,  1.84s/it, lr: 1.0e-04 loss: 3.243e-01]
a-cold-wall:  75%|#######4  | 2246/3000 [1:02:47<23:06,  1.84s/it, lr: 1.0e-04 loss: 6.243e-01]
a-cold-wall:  75%|#######4  | 2246/3000 [1:02:47<23:06,  1.84s/it, lr: 1.0e-04 loss: 6.243e-01]
a-cold-wall:  75%|#######4  | 2247/3000 [1:02:47<21:28,  1.71s/it, lr: 1.0e-04 loss: 6.243e-01]
a-cold-wall:  75%|#######4  | 2247/3000 [1:02:47<21:28,  1.71s/it, lr: 1.0e-04 loss: 6.243e-01]
a-cold-wall:  75%|#######4  | 2247/3000 [1:02:48<21:28,  1.71s/it, lr: 1.0e-04 loss: 6.621e-01]
a-cold-wall:  75%|#######4  | 2247/3000 [1:02:48<21:28,  1.71s/it, lr: 1.0e-04 loss: 6.621e-01]
a-cold-wall:  75%|#######4  | 2248/3000 [1:02:48<18:45,  1.50s/it, lr: 1.0e-04 loss: 6.621e-01]
a-cold-wall:  75%|#######4  | 2248/3000 [1:02:48<18:45,  1.50s/it, lr: 1.0e-04 loss: 6.621e-01]
a-cold-wall:  75%|#######4  | 2248/3000 [1:02:48<18:45,  1.50s/it, lr: 1.0e-04 loss: 6.153e-01]
a-cold-wall:  75%|#######4  | 2248/3000 [1:02:48<18:45,  1.50s/it, lr: 1.0e-04 loss: 6.153e-01]
a-cold-wall:  75%|#######4  | 2249/3000 [1:02:48<15:58,  1.28s/it, lr: 1.0e-04 loss: 6.153e-01]
a-cold-wall:  75%|#######4  | 2249/3000 [1:02:48<15:58,  1.28s/it, lr: 1.0e-04 loss: 6.153e-01]
a-cold-wall:  75%|#######4  | 2249/3000 [1:02:49<15:58,  1.28s/it, lr: 1.0e-04 loss: 4.047e-01]
a-cold-wall:  75%|#######4  | 2249/3000 [1:02:49<15:58,  1.28s/it, lr: 1.0e-04 loss: 4.047e-01]
Saving at step 2250
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000002250.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000001250.safetensors

a-cold-wall:  75%|#######5  | 2250/3000 [1:02:52<15:57,  1.28s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  75%|#######5  | 2250/3000 [1:02:52<15:57,  1.28s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  75%|#######5  | 2251/3000 [1:02:52<17:21,  1.39s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  75%|#######5  | 2251/3000 [1:02:52<17:21,  1.39s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  75%|#######5  | 2251/3000 [1:02:55<17:21,  1.39s/it, lr: 1.0e-04 loss: 5.379e-01]
a-cold-wall:  75%|#######5  | 2251/3000 [1:02:55<17:21,  1.39s/it, lr: 1.0e-04 loss: 5.379e-01]
a-cold-wall:  75%|#######5  | 2252/3000 [1:02:55<21:41,  1.74s/it, lr: 1.0e-04 loss: 5.379e-01]
a-cold-wall:  75%|#######5  | 2252/3000 [1:02:55<21:41,  1.74s/it, lr: 1.0e-04 loss: 5.379e-01]
a-cold-wall:  75%|#######5  | 2252/3000 [1:02:56<21:41,  1.74s/it, lr: 1.0e-04 loss: 2.684e-01]
a-cold-wall:  75%|#######5  | 2252/3000 [1:02:56<21:41,  1.74s/it, lr: 1.0e-04 loss: 2.684e-01]
a-cold-wall:  75%|#######5  | 2253/3000 [1:02:56<20:35,  1.65s/it, lr: 1.0e-04 loss: 2.684e-01]
a-cold-wall:  75%|#######5  | 2253/3000 [1:02:56<20:35,  1.65s/it, lr: 1.0e-04 loss: 2.684e-01]
a-cold-wall:  75%|#######5  | 2253/3000 [1:02:57<20:35,  1.65s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  75%|#######5  | 2253/3000 [1:02:57<20:35,  1.65s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  75%|#######5  | 2254/3000 [1:02:57<17:30,  1.41s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  75%|#######5  | 2254/3000 [1:02:57<17:30,  1.41s/it, lr: 1.0e-04 loss: 7.005e-01]
a-cold-wall:  75%|#######5  | 2254/3000 [1:02:58<17:30,  1.41s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  75%|#######5  | 2254/3000 [1:02:58<17:30,  1.41s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  75%|#######5  | 2255/3000 [1:02:58<15:10,  1.22s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  75%|#######5  | 2255/3000 [1:02:58<15:10,  1.22s/it, lr: 1.0e-04 loss: 2.722e-01]
a-cold-wall:  75%|#######5  | 2255/3000 [1:02:59<15:10,  1.22s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  75%|#######5  | 2255/3000 [1:02:59<15:10,  1.22s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  75%|#######5  | 2256/3000 [1:02:59<15:49,  1.28s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  75%|#######5  | 2256/3000 [1:02:59<15:49,  1.28s/it, lr: 1.0e-04 loss: 5.765e-01]
a-cold-wall:  75%|#######5  | 2256/3000 [1:03:02<15:49,  1.28s/it, lr: 1.0e-04 loss: 6.400e-01]
a-cold-wall:  75%|#######5  | 2256/3000 [1:03:02<15:49,  1.28s/it, lr: 1.0e-04 loss: 6.400e-01]
a-cold-wall:  75%|#######5  | 2257/3000 [1:03:02<21:25,  1.73s/it, lr: 1.0e-04 loss: 6.400e-01]
a-cold-wall:  75%|#######5  | 2257/3000 [1:03:02<21:25,  1.73s/it, lr: 1.0e-04 loss: 6.400e-01]
a-cold-wall:  75%|#######5  | 2257/3000 [1:03:05<21:25,  1.73s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  75%|#######5  | 2257/3000 [1:03:05<21:25,  1.73s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  75%|#######5  | 2258/3000 [1:03:05<25:27,  2.06s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  75%|#######5  | 2258/3000 [1:03:05<25:27,  2.06s/it, lr: 1.0e-04 loss: 2.150e-01]
a-cold-wall:  75%|#######5  | 2258/3000 [1:03:06<25:27,  2.06s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  75%|#######5  | 2258/3000 [1:03:06<25:27,  2.06s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  75%|#######5  | 2259/3000 [1:03:06<20:40,  1.67s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  75%|#######5  | 2259/3000 [1:03:06<20:40,  1.67s/it, lr: 1.0e-04 loss: 7.026e-01]
a-cold-wall:  75%|#######5  | 2259/3000 [1:03:06<20:40,  1.67s/it, lr: 1.0e-04 loss: 5.485e-01]
a-cold-wall:  75%|#######5  | 2259/3000 [1:03:06<20:40,  1.67s/it, lr: 1.0e-04 loss: 5.485e-01]
a-cold-wall:  75%|#######5  | 2260/3000 [1:03:08<20:38,  1.67s/it, lr: 1.0e-04 loss: 6.342e-01]
a-cold-wall:  75%|#######5  | 2260/3000 [1:03:08<20:38,  1.67s/it, lr: 1.0e-04 loss: 6.342e-01]
a-cold-wall:  75%|#######5  | 2261/3000 [1:03:08<15:12,  1.23s/it, lr: 1.0e-04 loss: 6.342e-01]
a-cold-wall:  75%|#######5  | 2261/3000 [1:03:08<15:12,  1.23s/it, lr: 1.0e-04 loss: 6.342e-01]
a-cold-wall:  75%|#######5  | 2261/3000 [1:03:09<15:12,  1.23s/it, lr: 1.0e-04 loss: 8.556e-02]
a-cold-wall:  75%|#######5  | 2261/3000 [1:03:09<15:12,  1.23s/it, lr: 1.0e-04 loss: 8.556e-02]
a-cold-wall:  75%|#######5  | 2262/3000 [1:03:09<15:47,  1.28s/it, lr: 1.0e-04 loss: 8.556e-02]
a-cold-wall:  75%|#######5  | 2262/3000 [1:03:09<15:47,  1.28s/it, lr: 1.0e-04 loss: 8.556e-02]
a-cold-wall:  75%|#######5  | 2262/3000 [1:03:11<15:47,  1.28s/it, lr: 1.0e-04 loss: 4.894e-01]
a-cold-wall:  75%|#######5  | 2262/3000 [1:03:11<15:47,  1.28s/it, lr: 1.0e-04 loss: 4.894e-01]
a-cold-wall:  75%|#######5  | 2263/3000 [1:03:11<16:41,  1.36s/it, lr: 1.0e-04 loss: 4.894e-01]
a-cold-wall:  75%|#######5  | 2263/3000 [1:03:11<16:41,  1.36s/it, lr: 1.0e-04 loss: 4.894e-01]
a-cold-wall:  75%|#######5  | 2263/3000 [1:03:14<16:41,  1.36s/it, lr: 1.0e-04 loss: 5.579e-01]
a-cold-wall:  75%|#######5  | 2263/3000 [1:03:14<16:41,  1.36s/it, lr: 1.0e-04 loss: 5.579e-01]
a-cold-wall:  75%|#######5  | 2264/3000 [1:03:14<21:38,  1.76s/it, lr: 1.0e-04 loss: 5.579e-01]
a-cold-wall:  75%|#######5  | 2264/3000 [1:03:14<21:38,  1.76s/it, lr: 1.0e-04 loss: 5.579e-01]
a-cold-wall:  75%|#######5  | 2264/3000 [1:03:17<21:38,  1.76s/it, lr: 1.0e-04 loss: 8.646e-01]
a-cold-wall:  75%|#######5  | 2264/3000 [1:03:17<21:38,  1.76s/it, lr: 1.0e-04 loss: 8.646e-01]
a-cold-wall:  76%|#######5  | 2265/3000 [1:03:17<25:21,  2.07s/it, lr: 1.0e-04 loss: 8.646e-01]
a-cold-wall:  76%|#######5  | 2265/3000 [1:03:17<25:21,  2.07s/it, lr: 1.0e-04 loss: 8.646e-01]
a-cold-wall:  76%|#######5  | 2265/3000 [1:03:18<25:21,  2.07s/it, lr: 1.0e-04 loss: 7.473e-02]
a-cold-wall:  76%|#######5  | 2265/3000 [1:03:18<25:21,  2.07s/it, lr: 1.0e-04 loss: 7.473e-02]
a-cold-wall:  76%|#######5  | 2266/3000 [1:03:18<21:27,  1.75s/it, lr: 1.0e-04 loss: 7.473e-02]
a-cold-wall:  76%|#######5  | 2266/3000 [1:03:18<21:27,  1.75s/it, lr: 1.0e-04 loss: 7.473e-02]
a-cold-wall:  76%|#######5  | 2266/3000 [1:03:18<21:27,  1.75s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  76%|#######5  | 2266/3000 [1:03:18<21:27,  1.75s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  76%|#######5  | 2267/3000 [1:03:18<17:54,  1.47s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  76%|#######5  | 2267/3000 [1:03:18<17:54,  1.47s/it, lr: 1.0e-04 loss: 5.143e-01]
a-cold-wall:  76%|#######5  | 2267/3000 [1:03:21<17:54,  1.47s/it, lr: 1.0e-04 loss: 1.265e-01]
a-cold-wall:  76%|#######5  | 2267/3000 [1:03:21<17:54,  1.47s/it, lr: 1.0e-04 loss: 1.265e-01]
a-cold-wall:  76%|#######5  | 2268/3000 [1:03:21<22:44,  1.86s/it, lr: 1.0e-04 loss: 1.265e-01]
a-cold-wall:  76%|#######5  | 2268/3000 [1:03:21<22:44,  1.86s/it, lr: 1.0e-04 loss: 1.265e-01]
a-cold-wall:  76%|#######5  | 2268/3000 [1:03:22<22:44,  1.86s/it, lr: 1.0e-04 loss: 2.965e-01]
a-cold-wall:  76%|#######5  | 2268/3000 [1:03:22<22:44,  1.86s/it, lr: 1.0e-04 loss: 2.965e-01]
a-cold-wall:  76%|#######5  | 2269/3000 [1:03:22<18:43,  1.54s/it, lr: 1.0e-04 loss: 2.965e-01]
a-cold-wall:  76%|#######5  | 2269/3000 [1:03:22<18:43,  1.54s/it, lr: 1.0e-04 loss: 2.965e-01]
a-cold-wall:  76%|#######5  | 2269/3000 [1:03:23<18:43,  1.54s/it, lr: 1.0e-04 loss: 1.478e-02]
a-cold-wall:  76%|#######5  | 2269/3000 [1:03:23<18:43,  1.54s/it, lr: 1.0e-04 loss: 1.478e-02]
a-cold-wall:  76%|#######5  | 2270/3000 [1:03:25<18:41,  1.54s/it, lr: 1.0e-04 loss: 1.136e-01]
a-cold-wall:  76%|#######5  | 2270/3000 [1:03:25<18:41,  1.54s/it, lr: 1.0e-04 loss: 1.136e-01]
a-cold-wall:  76%|#######5  | 2271/3000 [1:03:25<14:04,  1.16s/it, lr: 1.0e-04 loss: 1.136e-01]
a-cold-wall:  76%|#######5  | 2271/3000 [1:03:25<14:04,  1.16s/it, lr: 1.0e-04 loss: 1.136e-01]
a-cold-wall:  76%|#######5  | 2271/3000 [1:03:25<14:04,  1.16s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  76%|#######5  | 2271/3000 [1:03:25<14:04,  1.16s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  76%|#######5  | 2272/3000 [1:03:25<12:46,  1.05s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  76%|#######5  | 2272/3000 [1:03:25<12:46,  1.05s/it, lr: 1.0e-04 loss: 5.547e-01]
a-cold-wall:  76%|#######5  | 2272/3000 [1:03:28<12:46,  1.05s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:  76%|#######5  | 2272/3000 [1:03:28<12:46,  1.05s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:  76%|#######5  | 2273/3000 [1:03:28<18:21,  1.52s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:  76%|#######5  | 2273/3000 [1:03:28<18:21,  1.52s/it, lr: 1.0e-04 loss: 4.671e-01]
a-cold-wall:  76%|#######5  | 2273/3000 [1:03:30<18:21,  1.52s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  76%|#######5  | 2273/3000 [1:03:30<18:21,  1.52s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  76%|#######5  | 2274/3000 [1:03:30<17:58,  1.48s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  76%|#######5  | 2274/3000 [1:03:30<17:58,  1.48s/it, lr: 1.0e-04 loss: 6.254e-02]
a-cold-wall:  76%|#######5  | 2274/3000 [1:03:33<17:58,  1.48s/it, lr: 1.0e-04 loss: 3.881e-01]
a-cold-wall:  76%|#######5  | 2274/3000 [1:03:33<17:58,  1.48s/it, lr: 1.0e-04 loss: 3.881e-01]
a-cold-wall:  76%|#######5  | 2275/3000 [1:03:33<22:35,  1.87s/it, lr: 1.0e-04 loss: 3.881e-01]
a-cold-wall:  76%|#######5  | 2275/3000 [1:03:33<22:35,  1.87s/it, lr: 1.0e-04 loss: 3.881e-01]
a-cold-wall:  76%|#######5  | 2275/3000 [1:03:33<22:35,  1.87s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:  76%|#######5  | 2275/3000 [1:03:33<22:35,  1.87s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:  76%|#######5  | 2276/3000 [1:03:33<18:39,  1.55s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:  76%|#######5  | 2276/3000 [1:03:33<18:39,  1.55s/it, lr: 1.0e-04 loss: 5.239e-01]
a-cold-wall:  76%|#######5  | 2276/3000 [1:03:34<18:39,  1.55s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  76%|#######5  | 2276/3000 [1:03:34<18:39,  1.55s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  76%|#######5  | 2277/3000 [1:03:34<15:49,  1.31s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  76%|#######5  | 2277/3000 [1:03:34<15:49,  1.31s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  76%|#######5  | 2277/3000 [1:03:36<15:49,  1.31s/it, lr: 1.0e-04 loss: 2.856e-01]
a-cold-wall:  76%|#######5  | 2277/3000 [1:03:36<15:49,  1.31s/it, lr: 1.0e-04 loss: 2.856e-01]
a-cold-wall:  76%|#######5  | 2278/3000 [1:03:36<16:46,  1.39s/it, lr: 1.0e-04 loss: 2.856e-01]
a-cold-wall:  76%|#######5  | 2278/3000 [1:03:36<16:46,  1.39s/it, lr: 1.0e-04 loss: 2.856e-01]
a-cold-wall:  76%|#######5  | 2278/3000 [1:03:36<16:46,  1.39s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  76%|#######5  | 2278/3000 [1:03:36<16:46,  1.39s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  76%|#######5  | 2279/3000 [1:03:36<14:26,  1.20s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  76%|#######5  | 2279/3000 [1:03:36<14:26,  1.20s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  76%|#######5  | 2279/3000 [1:03:39<14:26,  1.20s/it, lr: 1.0e-04 loss: 4.758e-01]
a-cold-wall:  76%|#######5  | 2279/3000 [1:03:39<14:26,  1.20s/it, lr: 1.0e-04 loss: 4.758e-01]
a-cold-wall:  76%|#######6  | 2280/3000 [1:03:40<14:25,  1.20s/it, lr: 1.0e-04 loss: 8.183e-02]
a-cold-wall:  76%|#######6  | 2280/3000 [1:03:40<14:25,  1.20s/it, lr: 1.0e-04 loss: 8.183e-02]
a-cold-wall:  76%|#######6  | 2281/3000 [1:03:40<09:50,  1.22it/s, lr: 1.0e-04 loss: 8.183e-02]
a-cold-wall:  76%|#######6  | 2281/3000 [1:03:40<09:50,  1.22it/s, lr: 1.0e-04 loss: 8.183e-02]
a-cold-wall:  76%|#######6  | 2281/3000 [1:03:41<09:50,  1.22it/s, lr: 1.0e-04 loss: 9.502e-02]
a-cold-wall:  76%|#######6  | 2281/3000 [1:03:41<09:50,  1.22it/s, lr: 1.0e-04 loss: 9.502e-02]
a-cold-wall:  76%|#######6  | 2282/3000 [1:03:41<09:35,  1.25it/s, lr: 1.0e-04 loss: 9.502e-02]
a-cold-wall:  76%|#######6  | 2282/3000 [1:03:41<09:35,  1.25it/s, lr: 1.0e-04 loss: 9.502e-02]
a-cold-wall:  76%|#######6  | 2282/3000 [1:03:41<09:35,  1.25it/s, lr: 1.0e-04 loss: 1.168e-01]
a-cold-wall:  76%|#######6  | 2282/3000 [1:03:41<09:35,  1.25it/s, lr: 1.0e-04 loss: 1.168e-01]
a-cold-wall:  76%|#######6  | 2283/3000 [1:03:41<09:25,  1.27it/s, lr: 1.0e-04 loss: 1.168e-01]
a-cold-wall:  76%|#######6  | 2283/3000 [1:03:41<09:25,  1.27it/s, lr: 1.0e-04 loss: 1.168e-01]
a-cold-wall:  76%|#######6  | 2283/3000 [1:03:44<09:25,  1.27it/s, lr: 1.0e-04 loss: 2.627e-01]
a-cold-wall:  76%|#######6  | 2283/3000 [1:03:44<09:25,  1.27it/s, lr: 1.0e-04 loss: 2.627e-01]
a-cold-wall:  76%|#######6  | 2284/3000 [1:03:44<16:02,  1.34s/it, lr: 1.0e-04 loss: 2.627e-01]
a-cold-wall:  76%|#######6  | 2284/3000 [1:03:44<16:02,  1.34s/it, lr: 1.0e-04 loss: 2.627e-01]
a-cold-wall:  76%|#######6  | 2284/3000 [1:03:47<16:02,  1.34s/it, lr: 1.0e-04 loss: 3.727e-01]
a-cold-wall:  76%|#######6  | 2284/3000 [1:03:47<16:02,  1.34s/it, lr: 1.0e-04 loss: 3.727e-01]
a-cold-wall:  76%|#######6  | 2285/3000 [1:03:47<20:56,  1.76s/it, lr: 1.0e-04 loss: 3.727e-01]
a-cold-wall:  76%|#######6  | 2285/3000 [1:03:47<20:56,  1.76s/it, lr: 1.0e-04 loss: 3.727e-01]
a-cold-wall:  76%|#######6  | 2285/3000 [1:03:50<20:56,  1.76s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  76%|#######6  | 2285/3000 [1:03:50<20:56,  1.76s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  76%|#######6  | 2286/3000 [1:03:50<24:35,  2.07s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  76%|#######6  | 2286/3000 [1:03:50<24:35,  2.07s/it, lr: 1.0e-04 loss: 3.836e-01]
a-cold-wall:  76%|#######6  | 2286/3000 [1:03:53<24:35,  2.07s/it, lr: 1.0e-04 loss: 5.821e-01]
a-cold-wall:  76%|#######6  | 2286/3000 [1:03:53<24:35,  2.07s/it, lr: 1.0e-04 loss: 5.821e-01]
a-cold-wall:  76%|#######6  | 2287/3000 [1:03:53<27:13,  2.29s/it, lr: 1.0e-04 loss: 5.821e-01]
a-cold-wall:  76%|#######6  | 2287/3000 [1:03:53<27:13,  2.29s/it, lr: 1.0e-04 loss: 5.821e-01]
a-cold-wall:  76%|#######6  | 2287/3000 [1:03:53<27:13,  2.29s/it, lr: 1.0e-04 loss: 3.423e-01]
a-cold-wall:  76%|#######6  | 2287/3000 [1:03:53<27:13,  2.29s/it, lr: 1.0e-04 loss: 3.423e-01]
a-cold-wall:  76%|#######6  | 2288/3000 [1:03:53<21:48,  1.84s/it, lr: 1.0e-04 loss: 3.423e-01]
a-cold-wall:  76%|#######6  | 2288/3000 [1:03:53<21:48,  1.84s/it, lr: 1.0e-04 loss: 3.423e-01]
a-cold-wall:  76%|#######6  | 2288/3000 [1:03:55<21:48,  1.84s/it, lr: 1.0e-04 loss: 3.380e-01]
a-cold-wall:  76%|#######6  | 2288/3000 [1:03:55<21:48,  1.84s/it, lr: 1.0e-04 loss: 3.380e-01]
a-cold-wall:  76%|#######6  | 2289/3000 [1:03:55<20:19,  1.71s/it, lr: 1.0e-04 loss: 3.380e-01]
a-cold-wall:  76%|#######6  | 2289/3000 [1:03:55<20:19,  1.71s/it, lr: 1.0e-04 loss: 3.380e-01]
a-cold-wall:  76%|#######6  | 2289/3000 [1:03:58<20:19,  1.71s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  76%|#######6  | 2289/3000 [1:03:58<20:19,  1.71s/it, lr: 1.0e-04 loss: 5.593e-01]
a-cold-wall:  76%|#######6  | 2290/3000 [1:04:01<20:17,  1.71s/it, lr: 1.0e-04 loss: 5.364e-01]
a-cold-wall:  76%|#######6  | 2290/3000 [1:04:01<20:17,  1.71s/it, lr: 1.0e-04 loss: 5.364e-01]
a-cold-wall:  76%|#######6  | 2291/3000 [1:04:01<18:46,  1.59s/it, lr: 1.0e-04 loss: 5.364e-01]
a-cold-wall:  76%|#######6  | 2291/3000 [1:04:01<18:46,  1.59s/it, lr: 1.0e-04 loss: 5.364e-01]
a-cold-wall:  76%|#######6  | 2291/3000 [1:04:04<18:46,  1.59s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  76%|#######6  | 2291/3000 [1:04:04<18:46,  1.59s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  76%|#######6  | 2292/3000 [1:04:04<22:54,  1.94s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  76%|#######6  | 2292/3000 [1:04:04<22:54,  1.94s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  76%|#######6  | 2292/3000 [1:04:07<22:54,  1.94s/it, lr: 1.0e-04 loss: 9.351e-02]
a-cold-wall:  76%|#######6  | 2292/3000 [1:04:07<22:54,  1.94s/it, lr: 1.0e-04 loss: 9.351e-02]
a-cold-wall:  76%|#######6  | 2293/3000 [1:04:07<25:47,  2.19s/it, lr: 1.0e-04 loss: 9.351e-02]
a-cold-wall:  76%|#######6  | 2293/3000 [1:04:07<25:47,  2.19s/it, lr: 1.0e-04 loss: 9.351e-02]
a-cold-wall:  76%|#######6  | 2293/3000 [1:04:07<25:47,  2.19s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  76%|#######6  | 2293/3000 [1:04:07<25:47,  2.19s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  76%|#######6  | 2294/3000 [1:04:07<21:12,  1.80s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  76%|#######6  | 2294/3000 [1:04:07<21:12,  1.80s/it, lr: 1.0e-04 loss: 6.129e-01]
a-cold-wall:  76%|#######6  | 2294/3000 [1:04:09<21:12,  1.80s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  76%|#######6  | 2294/3000 [1:04:09<21:12,  1.80s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  76%|#######6  | 2295/3000 [1:04:09<19:58,  1.70s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  76%|#######6  | 2295/3000 [1:04:09<19:58,  1.70s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  76%|#######6  | 2295/3000 [1:04:10<19:58,  1.70s/it, lr: 1.0e-04 loss: 4.628e-01]
a-cold-wall:  76%|#######6  | 2295/3000 [1:04:10<19:58,  1.70s/it, lr: 1.0e-04 loss: 4.628e-01]
a-cold-wall:  77%|#######6  | 2296/3000 [1:04:10<19:03,  1.62s/it, lr: 1.0e-04 loss: 4.628e-01]
a-cold-wall:  77%|#######6  | 2296/3000 [1:04:10<19:03,  1.62s/it, lr: 1.0e-04 loss: 4.628e-01]
a-cold-wall:  77%|#######6  | 2296/3000 [1:04:13<19:03,  1.62s/it, lr: 1.0e-04 loss: 7.060e-01]
a-cold-wall:  77%|#######6  | 2296/3000 [1:04:13<19:03,  1.62s/it, lr: 1.0e-04 loss: 7.060e-01]
a-cold-wall:  77%|#######6  | 2297/3000 [1:04:13<23:14,  1.98s/it, lr: 1.0e-04 loss: 7.060e-01]
a-cold-wall:  77%|#######6  | 2297/3000 [1:04:13<23:14,  1.98s/it, lr: 1.0e-04 loss: 7.060e-01]
a-cold-wall:  77%|#######6  | 2297/3000 [1:04:16<23:14,  1.98s/it, lr: 1.0e-04 loss: 1.797e-01]
a-cold-wall:  77%|#######6  | 2297/3000 [1:04:16<23:14,  1.98s/it, lr: 1.0e-04 loss: 1.797e-01]
a-cold-wall:  77%|#######6  | 2298/3000 [1:04:16<26:16,  2.25s/it, lr: 1.0e-04 loss: 1.797e-01]
a-cold-wall:  77%|#######6  | 2298/3000 [1:04:16<26:16,  2.25s/it, lr: 1.0e-04 loss: 1.797e-01]
a-cold-wall:  77%|#######6  | 2298/3000 [1:04:19<26:16,  2.25s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  77%|#######6  | 2298/3000 [1:04:19<26:16,  2.25s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  77%|#######6  | 2299/3000 [1:04:19<28:30,  2.44s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  77%|#######6  | 2299/3000 [1:04:19<28:30,  2.44s/it, lr: 1.0e-04 loss: 2.261e-01]
a-cold-wall:  77%|#######6  | 2299/3000 [1:04:20<28:30,  2.44s/it, lr: 1.0e-04 loss: 7.959e-02]
a-cold-wall:  77%|#######6  | 2299/3000 [1:04:20<28:30,  2.44s/it, lr: 1.0e-04 loss: 7.959e-02]
a-cold-wall:  77%|#######6  | 2300/3000 [1:04:23<28:28,  2.44s/it, lr: 1.0e-04 loss: 9.881e-02]
a-cold-wall:  77%|#######6  | 2300/3000 [1:04:23<28:28,  2.44s/it, lr: 1.0e-04 loss: 9.881e-02]
a-cold-wall:  77%|#######6  | 2301/3000 [1:04:23<23:12,  1.99s/it, lr: 1.0e-04 loss: 9.881e-02]
a-cold-wall:  77%|#######6  | 2301/3000 [1:04:23<23:12,  1.99s/it, lr: 1.0e-04 loss: 9.881e-02]
a-cold-wall:  77%|#######6  | 2301/3000 [1:04:26<23:12,  1.99s/it, lr: 1.0e-04 loss: 6.305e-01]
a-cold-wall:  77%|#######6  | 2301/3000 [1:04:26<23:12,  1.99s/it, lr: 1.0e-04 loss: 6.305e-01]
a-cold-wall:  77%|#######6  | 2302/3000 [1:04:26<25:47,  2.22s/it, lr: 1.0e-04 loss: 6.305e-01]
a-cold-wall:  77%|#######6  | 2302/3000 [1:04:26<25:47,  2.22s/it, lr: 1.0e-04 loss: 6.305e-01]
a-cold-wall:  77%|#######6  | 2302/3000 [1:04:27<25:47,  2.22s/it, lr: 1.0e-04 loss: 3.760e-01]
a-cold-wall:  77%|#######6  | 2302/3000 [1:04:27<25:47,  2.22s/it, lr: 1.0e-04 loss: 3.760e-01]
a-cold-wall:  77%|#######6  | 2303/3000 [1:04:27<23:21,  2.01s/it, lr: 1.0e-04 loss: 3.760e-01]
a-cold-wall:  77%|#######6  | 2303/3000 [1:04:27<23:21,  2.01s/it, lr: 1.0e-04 loss: 3.760e-01]
a-cold-wall:  77%|#######6  | 2303/3000 [1:04:28<23:21,  2.01s/it, lr: 1.0e-04 loss: 2.770e-02]
a-cold-wall:  77%|#######6  | 2303/3000 [1:04:28<23:21,  2.01s/it, lr: 1.0e-04 loss: 2.770e-02]
a-cold-wall:  77%|#######6  | 2304/3000 [1:04:28<21:22,  1.84s/it, lr: 1.0e-04 loss: 2.770e-02]
a-cold-wall:  77%|#######6  | 2304/3000 [1:04:28<21:22,  1.84s/it, lr: 1.0e-04 loss: 2.770e-02]
a-cold-wall:  77%|#######6  | 2304/3000 [1:04:31<21:22,  1.84s/it, lr: 1.0e-04 loss: 4.782e-01]
a-cold-wall:  77%|#######6  | 2304/3000 [1:04:31<21:22,  1.84s/it, lr: 1.0e-04 loss: 4.782e-01]
a-cold-wall:  77%|#######6  | 2305/3000 [1:04:31<25:32,  2.21s/it, lr: 1.0e-04 loss: 4.782e-01]
a-cold-wall:  77%|#######6  | 2305/3000 [1:04:31<25:32,  2.21s/it, lr: 1.0e-04 loss: 4.782e-01]
a-cold-wall:  77%|#######6  | 2305/3000 [1:04:32<25:32,  2.21s/it, lr: 1.0e-04 loss: 1.355e-01]
a-cold-wall:  77%|#######6  | 2305/3000 [1:04:32<25:32,  2.21s/it, lr: 1.0e-04 loss: 1.355e-01]
a-cold-wall:  77%|#######6  | 2306/3000 [1:04:32<20:40,  1.79s/it, lr: 1.0e-04 loss: 1.355e-01]
a-cold-wall:  77%|#######6  | 2306/3000 [1:04:32<20:40,  1.79s/it, lr: 1.0e-04 loss: 1.355e-01]
a-cold-wall:  77%|#######6  | 2306/3000 [1:04:34<20:40,  1.79s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  77%|#######6  | 2306/3000 [1:04:34<20:40,  1.79s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  77%|#######6  | 2307/3000 [1:04:34<19:17,  1.67s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  77%|#######6  | 2307/3000 [1:04:34<19:17,  1.67s/it, lr: 1.0e-04 loss: 2.181e-01]
a-cold-wall:  77%|#######6  | 2307/3000 [1:04:35<19:17,  1.67s/it, lr: 1.0e-04 loss: 7.394e-01]
a-cold-wall:  77%|#######6  | 2307/3000 [1:04:35<19:17,  1.67s/it, lr: 1.0e-04 loss: 7.394e-01]
a-cold-wall:  77%|#######6  | 2308/3000 [1:04:35<18:25,  1.60s/it, lr: 1.0e-04 loss: 7.394e-01]
a-cold-wall:  77%|#######6  | 2308/3000 [1:04:35<18:25,  1.60s/it, lr: 1.0e-04 loss: 7.394e-01]
a-cold-wall:  77%|#######6  | 2308/3000 [1:04:36<18:25,  1.60s/it, lr: 1.0e-04 loss: 2.996e-01]
a-cold-wall:  77%|#######6  | 2308/3000 [1:04:36<18:25,  1.60s/it, lr: 1.0e-04 loss: 2.996e-01]
a-cold-wall:  77%|#######6  | 2309/3000 [1:04:36<15:31,  1.35s/it, lr: 1.0e-04 loss: 2.996e-01]
a-cold-wall:  77%|#######6  | 2309/3000 [1:04:36<15:31,  1.35s/it, lr: 1.0e-04 loss: 2.996e-01]
a-cold-wall:  77%|#######6  | 2309/3000 [1:04:39<15:31,  1.35s/it, lr: 1.0e-04 loss: 6.303e-01]
a-cold-wall:  77%|#######6  | 2309/3000 [1:04:39<15:31,  1.35s/it, lr: 1.0e-04 loss: 6.303e-01]
a-cold-wall:  77%|#######7  | 2310/3000 [1:04:42<15:30,  1.35s/it, lr: 1.0e-04 loss: 3.702e-01]
a-cold-wall:  77%|#######7  | 2310/3000 [1:04:42<15:30,  1.35s/it, lr: 1.0e-04 loss: 3.702e-01]
a-cold-wall:  77%|#######7  | 2311/3000 [1:04:42<16:01,  1.40s/it, lr: 1.0e-04 loss: 3.702e-01]
a-cold-wall:  77%|#######7  | 2311/3000 [1:04:42<16:01,  1.40s/it, lr: 1.0e-04 loss: 3.702e-01]
a-cold-wall:  77%|#######7  | 2311/3000 [1:04:43<16:01,  1.40s/it, lr: 1.0e-04 loss: 2.320e-01]
a-cold-wall:  77%|#######7  | 2311/3000 [1:04:43<16:01,  1.40s/it, lr: 1.0e-04 loss: 2.320e-01]
a-cold-wall:  77%|#######7  | 2312/3000 [1:04:43<14:10,  1.24s/it, lr: 1.0e-04 loss: 2.320e-01]
a-cold-wall:  77%|#######7  | 2312/3000 [1:04:43<14:10,  1.24s/it, lr: 1.0e-04 loss: 2.320e-01]
a-cold-wall:  77%|#######7  | 2312/3000 [1:04:44<14:10,  1.24s/it, lr: 1.0e-04 loss: 1.479e-01]
a-cold-wall:  77%|#######7  | 2312/3000 [1:04:44<14:10,  1.24s/it, lr: 1.0e-04 loss: 1.479e-01]
a-cold-wall:  77%|#######7  | 2313/3000 [1:04:44<12:40,  1.11s/it, lr: 1.0e-04 loss: 1.479e-01]
a-cold-wall:  77%|#######7  | 2313/3000 [1:04:44<12:40,  1.11s/it, lr: 1.0e-04 loss: 1.479e-01]
a-cold-wall:  77%|#######7  | 2313/3000 [1:04:46<12:40,  1.11s/it, lr: 1.0e-04 loss: 5.385e-01]
a-cold-wall:  77%|#######7  | 2313/3000 [1:04:46<12:40,  1.11s/it, lr: 1.0e-04 loss: 5.385e-01]
a-cold-wall:  77%|#######7  | 2314/3000 [1:04:46<18:05,  1.58s/it, lr: 1.0e-04 loss: 5.385e-01]
a-cold-wall:  77%|#######7  | 2314/3000 [1:04:46<18:05,  1.58s/it, lr: 1.0e-04 loss: 5.385e-01]
a-cold-wall:  77%|#######7  | 2314/3000 [1:04:48<18:05,  1.58s/it, lr: 1.0e-04 loss: 3.958e-01]
a-cold-wall:  77%|#######7  | 2314/3000 [1:04:48<18:05,  1.58s/it, lr: 1.0e-04 loss: 3.958e-01]
a-cold-wall:  77%|#######7  | 2315/3000 [1:04:48<17:35,  1.54s/it, lr: 1.0e-04 loss: 3.958e-01]
a-cold-wall:  77%|#######7  | 2315/3000 [1:04:48<17:35,  1.54s/it, lr: 1.0e-04 loss: 3.958e-01]
a-cold-wall:  77%|#######7  | 2315/3000 [1:04:49<17:35,  1.54s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:  77%|#######7  | 2315/3000 [1:04:49<17:35,  1.54s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:  77%|#######7  | 2316/3000 [1:04:49<14:59,  1.32s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:  77%|#######7  | 2316/3000 [1:04:49<14:59,  1.32s/it, lr: 1.0e-04 loss: 1.865e-01]
a-cold-wall:  77%|#######7  | 2316/3000 [1:04:51<14:59,  1.32s/it, lr: 1.0e-04 loss: 5.834e-02]
a-cold-wall:  77%|#######7  | 2316/3000 [1:04:51<14:59,  1.32s/it, lr: 1.0e-04 loss: 5.834e-02]
a-cold-wall:  77%|#######7  | 2317/3000 [1:04:51<20:13,  1.78s/it, lr: 1.0e-04 loss: 5.834e-02]
a-cold-wall:  77%|#######7  | 2317/3000 [1:04:51<20:13,  1.78s/it, lr: 1.0e-04 loss: 5.834e-02]
a-cold-wall:  77%|#######7  | 2317/3000 [1:04:55<20:13,  1.78s/it, lr: 1.0e-04 loss: 4.248e-01]
a-cold-wall:  77%|#######7  | 2317/3000 [1:04:55<20:13,  1.78s/it, lr: 1.0e-04 loss: 4.248e-01]
a-cold-wall:  77%|#######7  | 2318/3000 [1:04:55<24:28,  2.15s/it, lr: 1.0e-04 loss: 4.248e-01]
a-cold-wall:  77%|#######7  | 2318/3000 [1:04:55<24:28,  2.15s/it, lr: 1.0e-04 loss: 4.248e-01]
a-cold-wall:  77%|#######7  | 2318/3000 [1:04:56<24:28,  2.15s/it, lr: 1.0e-04 loss: 4.944e-01]
a-cold-wall:  77%|#######7  | 2318/3000 [1:04:56<24:28,  2.15s/it, lr: 1.0e-04 loss: 4.944e-01]
a-cold-wall:  77%|#######7  | 2319/3000 [1:04:56<20:30,  1.81s/it, lr: 1.0e-04 loss: 4.944e-01]
a-cold-wall:  77%|#######7  | 2319/3000 [1:04:56<20:30,  1.81s/it, lr: 1.0e-04 loss: 4.944e-01]
a-cold-wall:  77%|#######7  | 2319/3000 [1:04:58<20:30,  1.81s/it, lr: 1.0e-04 loss: 4.289e-01]
a-cold-wall:  77%|#######7  | 2319/3000 [1:04:58<20:30,  1.81s/it, lr: 1.0e-04 loss: 4.289e-01]
a-cold-wall:  77%|#######7  | 2320/3000 [1:05:01<20:28,  1.81s/it, lr: 1.0e-04 loss: 5.072e-01]
a-cold-wall:  77%|#######7  | 2320/3000 [1:05:01<20:28,  1.81s/it, lr: 1.0e-04 loss: 5.072e-01]
a-cold-wall:  77%|#######7  | 2321/3000 [1:05:01<18:30,  1.63s/it, lr: 1.0e-04 loss: 5.072e-01]
a-cold-wall:  77%|#######7  | 2321/3000 [1:05:01<18:30,  1.63s/it, lr: 1.0e-04 loss: 5.072e-01]
a-cold-wall:  77%|#######7  | 2321/3000 [1:05:02<18:30,  1.63s/it, lr: 1.0e-04 loss: 9.859e-02]
a-cold-wall:  77%|#######7  | 2321/3000 [1:05:02<18:30,  1.63s/it, lr: 1.0e-04 loss: 9.859e-02]
a-cold-wall:  77%|#######7  | 2322/3000 [1:05:02<16:03,  1.42s/it, lr: 1.0e-04 loss: 9.859e-02]
a-cold-wall:  77%|#######7  | 2322/3000 [1:05:02<16:03,  1.42s/it, lr: 1.0e-04 loss: 9.859e-02]
a-cold-wall:  77%|#######7  | 2322/3000 [1:05:03<16:03,  1.42s/it, lr: 1.0e-04 loss: 2.804e-01]
a-cold-wall:  77%|#######7  | 2322/3000 [1:05:03<16:03,  1.42s/it, lr: 1.0e-04 loss: 2.804e-01]
a-cold-wall:  77%|#######7  | 2323/3000 [1:05:03<14:01,  1.24s/it, lr: 1.0e-04 loss: 2.804e-01]
a-cold-wall:  77%|#######7  | 2323/3000 [1:05:03<14:01,  1.24s/it, lr: 1.0e-04 loss: 2.804e-01]
a-cold-wall:  77%|#######7  | 2323/3000 [1:05:04<14:01,  1.24s/it, lr: 1.0e-04 loss: 6.340e-01]
a-cold-wall:  77%|#######7  | 2323/3000 [1:05:04<14:01,  1.24s/it, lr: 1.0e-04 loss: 6.340e-01]
a-cold-wall:  77%|#######7  | 2324/3000 [1:05:04<14:36,  1.30s/it, lr: 1.0e-04 loss: 6.340e-01]
a-cold-wall:  77%|#######7  | 2324/3000 [1:05:04<14:36,  1.30s/it, lr: 1.0e-04 loss: 6.340e-01]
a-cold-wall:  77%|#######7  | 2324/3000 [1:05:07<14:36,  1.30s/it, lr: 1.0e-04 loss: 6.571e-01]
a-cold-wall:  77%|#######7  | 2324/3000 [1:05:07<14:36,  1.30s/it, lr: 1.0e-04 loss: 6.571e-01]
a-cold-wall:  78%|#######7  | 2325/3000 [1:05:07<19:38,  1.75s/it, lr: 1.0e-04 loss: 6.571e-01]
a-cold-wall:  78%|#######7  | 2325/3000 [1:05:07<19:38,  1.75s/it, lr: 1.0e-04 loss: 6.571e-01]
a-cold-wall:  78%|#######7  | 2325/3000 [1:05:10<19:38,  1.75s/it, lr: 1.0e-04 loss: 6.266e-01]
a-cold-wall:  78%|#######7  | 2325/3000 [1:05:10<19:38,  1.75s/it, lr: 1.0e-04 loss: 6.266e-01]
a-cold-wall:  78%|#######7  | 2326/3000 [1:05:10<23:20,  2.08s/it, lr: 1.0e-04 loss: 6.266e-01]
a-cold-wall:  78%|#######7  | 2326/3000 [1:05:10<23:20,  2.08s/it, lr: 1.0e-04 loss: 6.266e-01]
a-cold-wall:  78%|#######7  | 2326/3000 [1:05:11<23:20,  2.08s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  78%|#######7  | 2326/3000 [1:05:11<23:20,  2.08s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  78%|#######7  | 2327/3000 [1:05:11<21:11,  1.89s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  78%|#######7  | 2327/3000 [1:05:11<21:11,  1.89s/it, lr: 1.0e-04 loss: 2.988e-01]
a-cold-wall:  78%|#######7  | 2327/3000 [1:05:13<21:11,  1.89s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  78%|#######7  | 2327/3000 [1:05:13<21:11,  1.89s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  78%|#######7  | 2328/3000 [1:05:13<19:42,  1.76s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  78%|#######7  | 2328/3000 [1:05:13<19:42,  1.76s/it, lr: 1.0e-04 loss: 2.619e-01]
a-cold-wall:  78%|#######7  | 2328/3000 [1:05:14<19:42,  1.76s/it, lr: 1.0e-04 loss: 1.906e-01]
a-cold-wall:  78%|#######7  | 2328/3000 [1:05:14<19:42,  1.76s/it, lr: 1.0e-04 loss: 1.906e-01]
a-cold-wall:  78%|#######7  | 2329/3000 [1:05:14<16:21,  1.46s/it, lr: 1.0e-04 loss: 1.906e-01]
a-cold-wall:  78%|#######7  | 2329/3000 [1:05:14<16:21,  1.46s/it, lr: 1.0e-04 loss: 1.906e-01]
a-cold-wall:  78%|#######7  | 2329/3000 [1:05:14<16:21,  1.46s/it, lr: 1.0e-04 loss: 4.290e-01]
a-cold-wall:  78%|#######7  | 2329/3000 [1:05:14<16:21,  1.46s/it, lr: 1.0e-04 loss: 4.290e-01]
a-cold-wall:  78%|#######7  | 2330/3000 [1:05:16<16:20,  1.46s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  78%|#######7  | 2330/3000 [1:05:16<16:20,  1.46s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  78%|#######7  | 2331/3000 [1:05:16<12:31,  1.12s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  78%|#######7  | 2331/3000 [1:05:16<12:31,  1.12s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  78%|#######7  | 2331/3000 [1:05:19<12:31,  1.12s/it, lr: 1.0e-04 loss: 5.083e-02]
a-cold-wall:  78%|#######7  | 2331/3000 [1:05:19<12:31,  1.12s/it, lr: 1.0e-04 loss: 5.083e-02]
a-cold-wall:  78%|#######7  | 2332/3000 [1:05:19<17:25,  1.57s/it, lr: 1.0e-04 loss: 5.083e-02]
a-cold-wall:  78%|#######7  | 2332/3000 [1:05:19<17:25,  1.57s/it, lr: 1.0e-04 loss: 5.083e-02]
a-cold-wall:  78%|#######7  | 2332/3000 [1:05:20<17:25,  1.57s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  78%|#######7  | 2332/3000 [1:05:20<17:25,  1.57s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  78%|#######7  | 2333/3000 [1:05:20<15:43,  1.41s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  78%|#######7  | 2333/3000 [1:05:20<15:43,  1.41s/it, lr: 1.0e-04 loss: 5.742e-01]
a-cold-wall:  78%|#######7  | 2333/3000 [1:05:20<15:43,  1.41s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  78%|#######7  | 2333/3000 [1:05:20<15:43,  1.41s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  78%|#######7  | 2334/3000 [1:05:20<13:43,  1.24s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  78%|#######7  | 2334/3000 [1:05:20<13:43,  1.24s/it, lr: 1.0e-04 loss: 5.648e-01]
a-cold-wall:  78%|#######7  | 2334/3000 [1:05:22<13:43,  1.24s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  78%|#######7  | 2334/3000 [1:05:22<13:43,  1.24s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  78%|#######7  | 2335/3000 [1:05:22<14:20,  1.29s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  78%|#######7  | 2335/3000 [1:05:22<14:20,  1.29s/it, lr: 1.0e-04 loss: 4.264e-01]
a-cold-wall:  78%|#######7  | 2335/3000 [1:05:23<14:20,  1.29s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  78%|#######7  | 2335/3000 [1:05:23<14:20,  1.29s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  78%|#######7  | 2336/3000 [1:05:23<12:37,  1.14s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  78%|#######7  | 2336/3000 [1:05:23<12:37,  1.14s/it, lr: 1.0e-04 loss: 1.367e-01]
a-cold-wall:  78%|#######7  | 2336/3000 [1:05:26<12:37,  1.14s/it, lr: 1.0e-04 loss: 3.092e-01]
a-cold-wall:  78%|#######7  | 2336/3000 [1:05:26<12:37,  1.14s/it, lr: 1.0e-04 loss: 3.092e-01]
a-cold-wall:  78%|#######7  | 2337/3000 [1:05:26<18:14,  1.65s/it, lr: 1.0e-04 loss: 3.092e-01]
a-cold-wall:  78%|#######7  | 2337/3000 [1:05:26<18:14,  1.65s/it, lr: 1.0e-04 loss: 3.092e-01]
a-cold-wall:  78%|#######7  | 2337/3000 [1:05:26<18:14,  1.65s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  78%|#######7  | 2337/3000 [1:05:26<18:14,  1.65s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  78%|#######7  | 2338/3000 [1:05:26<15:21,  1.39s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  78%|#######7  | 2338/3000 [1:05:26<15:21,  1.39s/it, lr: 1.0e-04 loss: 1.532e-01]
a-cold-wall:  78%|#######7  | 2338/3000 [1:05:29<15:21,  1.39s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  78%|#######7  | 2338/3000 [1:05:29<15:21,  1.39s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  78%|#######7  | 2339/3000 [1:05:29<20:07,  1.83s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  78%|#######7  | 2339/3000 [1:05:29<20:07,  1.83s/it, lr: 1.0e-04 loss: 4.888e-01]
a-cold-wall:  78%|#######7  | 2339/3000 [1:05:30<20:07,  1.83s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  78%|#######7  | 2339/3000 [1:05:30<20:07,  1.83s/it, lr: 1.0e-04 loss: 1.832e-01]
a-cold-wall:  78%|#######8  | 2340/3000 [1:05:31<20:05,  1.83s/it, lr: 1.0e-04 loss: 3.605e-01]
a-cold-wall:  78%|#######8  | 2340/3000 [1:05:31<20:05,  1.83s/it, lr: 1.0e-04 loss: 3.605e-01]
a-cold-wall:  78%|#######8  | 2341/3000 [1:05:31<12:46,  1.16s/it, lr: 1.0e-04 loss: 3.605e-01]
a-cold-wall:  78%|#######8  | 2341/3000 [1:05:31<12:46,  1.16s/it, lr: 1.0e-04 loss: 3.605e-01]
a-cold-wall:  78%|#######8  | 2341/3000 [1:05:31<12:46,  1.16s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  78%|#######8  | 2341/3000 [1:05:31<12:46,  1.16s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  78%|#######8  | 2342/3000 [1:05:31<11:38,  1.06s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  78%|#######8  | 2342/3000 [1:05:31<11:38,  1.06s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  78%|#######8  | 2342/3000 [1:05:32<11:38,  1.06s/it, lr: 1.0e-04 loss: 3.900e-01]
a-cold-wall:  78%|#######8  | 2342/3000 [1:05:32<11:38,  1.06s/it, lr: 1.0e-04 loss: 3.900e-01]
a-cold-wall:  78%|#######8  | 2343/3000 [1:05:32<10:43,  1.02it/s, lr: 1.0e-04 loss: 3.900e-01]
a-cold-wall:  78%|#######8  | 2343/3000 [1:05:32<10:43,  1.02it/s, lr: 1.0e-04 loss: 3.900e-01]
a-cold-wall:  78%|#######8  | 2343/3000 [1:05:34<10:43,  1.02it/s, lr: 1.0e-04 loss: 1.138e-01]
a-cold-wall:  78%|#######8  | 2343/3000 [1:05:34<10:43,  1.02it/s, lr: 1.0e-04 loss: 1.138e-01]
a-cold-wall:  78%|#######8  | 2344/3000 [1:05:34<12:00,  1.10s/it, lr: 1.0e-04 loss: 1.138e-01]
a-cold-wall:  78%|#######8  | 2344/3000 [1:05:34<12:00,  1.10s/it, lr: 1.0e-04 loss: 1.138e-01]
a-cold-wall:  78%|#######8  | 2344/3000 [1:05:34<12:00,  1.10s/it, lr: 1.0e-04 loss: 1.503e-01]
a-cold-wall:  78%|#######8  | 2344/3000 [1:05:34<12:00,  1.10s/it, lr: 1.0e-04 loss: 1.503e-01]
a-cold-wall:  78%|#######8  | 2345/3000 [1:05:34<10:55,  1.00s/it, lr: 1.0e-04 loss: 1.503e-01]
a-cold-wall:  78%|#######8  | 2345/3000 [1:05:34<10:55,  1.00s/it, lr: 1.0e-04 loss: 1.503e-01]
a-cold-wall:  78%|#######8  | 2345/3000 [1:05:36<10:55,  1.00s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  78%|#######8  | 2345/3000 [1:05:36<10:55,  1.00s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  78%|#######8  | 2346/3000 [1:05:36<12:12,  1.12s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  78%|#######8  | 2346/3000 [1:05:36<12:12,  1.12s/it, lr: 1.0e-04 loss: 3.852e-01]
a-cold-wall:  78%|#######8  | 2346/3000 [1:05:37<12:12,  1.12s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  78%|#######8  | 2346/3000 [1:05:37<12:12,  1.12s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  78%|#######8  | 2347/3000 [1:05:37<11:44,  1.08s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  78%|#######8  | 2347/3000 [1:05:37<11:44,  1.08s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  78%|#######8  | 2347/3000 [1:05:38<11:44,  1.08s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  78%|#######8  | 2347/3000 [1:05:38<11:44,  1.08s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  78%|#######8  | 2348/3000 [1:05:38<12:48,  1.18s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  78%|#######8  | 2348/3000 [1:05:38<12:48,  1.18s/it, lr: 1.0e-04 loss: 4.162e-01]
a-cold-wall:  78%|#######8  | 2348/3000 [1:05:41<12:48,  1.18s/it, lr: 1.0e-04 loss: 4.493e-01]
a-cold-wall:  78%|#######8  | 2348/3000 [1:05:41<12:48,  1.18s/it, lr: 1.0e-04 loss: 4.493e-01]
a-cold-wall:  78%|#######8  | 2349/3000 [1:05:41<18:08,  1.67s/it, lr: 1.0e-04 loss: 4.493e-01]
a-cold-wall:  78%|#######8  | 2349/3000 [1:05:41<18:08,  1.67s/it, lr: 1.0e-04 loss: 4.493e-01]
a-cold-wall:  78%|#######8  | 2349/3000 [1:05:42<18:08,  1.67s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  78%|#######8  | 2349/3000 [1:05:42<18:08,  1.67s/it, lr: 1.0e-04 loss: 6.214e-01]
a-cold-wall:  78%|#######8  | 2350/3000 [1:05:45<18:06,  1.67s/it, lr: 1.0e-04 loss: 5.751e-01]
a-cold-wall:  78%|#######8  | 2350/3000 [1:05:45<18:06,  1.67s/it, lr: 1.0e-04 loss: 5.751e-01]
a-cold-wall:  78%|#######8  | 2351/3000 [1:05:45<16:51,  1.56s/it, lr: 1.0e-04 loss: 5.751e-01]
a-cold-wall:  78%|#######8  | 2351/3000 [1:05:45<16:51,  1.56s/it, lr: 1.0e-04 loss: 5.751e-01]
a-cold-wall:  78%|#######8  | 2351/3000 [1:05:48<16:51,  1.56s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  78%|#######8  | 2351/3000 [1:05:48<16:51,  1.56s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  78%|#######8  | 2352/3000 [1:05:48<20:15,  1.88s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  78%|#######8  | 2352/3000 [1:05:48<20:15,  1.88s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  78%|#######8  | 2352/3000 [1:05:51<20:15,  1.88s/it, lr: 1.0e-04 loss: 9.986e-02]
a-cold-wall:  78%|#######8  | 2352/3000 [1:05:51<20:15,  1.88s/it, lr: 1.0e-04 loss: 9.986e-02]
a-cold-wall:  78%|#######8  | 2353/3000 [1:05:51<23:09,  2.15s/it, lr: 1.0e-04 loss: 9.986e-02]
a-cold-wall:  78%|#######8  | 2353/3000 [1:05:51<23:09,  2.15s/it, lr: 1.0e-04 loss: 9.986e-02]
a-cold-wall:  78%|#######8  | 2353/3000 [1:05:52<23:09,  2.15s/it, lr: 1.0e-04 loss: 9.880e-02]
a-cold-wall:  78%|#######8  | 2353/3000 [1:05:52<23:09,  2.15s/it, lr: 1.0e-04 loss: 9.880e-02]
a-cold-wall:  78%|#######8  | 2354/3000 [1:05:52<20:58,  1.95s/it, lr: 1.0e-04 loss: 9.880e-02]
a-cold-wall:  78%|#######8  | 2354/3000 [1:05:52<20:58,  1.95s/it, lr: 1.0e-04 loss: 9.880e-02]
a-cold-wall:  78%|#######8  | 2354/3000 [1:05:53<20:58,  1.95s/it, lr: 1.0e-04 loss: 7.576e-01]
a-cold-wall:  78%|#######8  | 2354/3000 [1:05:53<20:58,  1.95s/it, lr: 1.0e-04 loss: 7.576e-01]
a-cold-wall:  78%|#######8  | 2355/3000 [1:05:53<17:22,  1.62s/it, lr: 1.0e-04 loss: 7.576e-01]
a-cold-wall:  78%|#######8  | 2355/3000 [1:05:53<17:22,  1.62s/it, lr: 1.0e-04 loss: 7.576e-01]
a-cold-wall:  78%|#######8  | 2355/3000 [1:05:56<17:22,  1.62s/it, lr: 1.0e-04 loss: 3.973e-01]
a-cold-wall:  78%|#######8  | 2355/3000 [1:05:56<17:22,  1.62s/it, lr: 1.0e-04 loss: 3.973e-01]
a-cold-wall:  79%|#######8  | 2356/3000 [1:05:56<21:06,  1.97s/it, lr: 1.0e-04 loss: 3.973e-01]
a-cold-wall:  79%|#######8  | 2356/3000 [1:05:56<21:06,  1.97s/it, lr: 1.0e-04 loss: 3.973e-01]
a-cold-wall:  79%|#######8  | 2356/3000 [1:05:58<21:06,  1.97s/it, lr: 1.0e-04 loss: 1.825e-01]
a-cold-wall:  79%|#######8  | 2356/3000 [1:05:58<21:06,  1.97s/it, lr: 1.0e-04 loss: 1.825e-01]
a-cold-wall:  79%|#######8  | 2357/3000 [1:05:58<19:26,  1.81s/it, lr: 1.0e-04 loss: 1.825e-01]
a-cold-wall:  79%|#######8  | 2357/3000 [1:05:58<19:26,  1.81s/it, lr: 1.0e-04 loss: 1.825e-01]
a-cold-wall:  79%|#######8  | 2357/3000 [1:06:00<19:26,  1.81s/it, lr: 1.0e-04 loss: 4.409e-01]
a-cold-wall:  79%|#######8  | 2357/3000 [1:06:00<19:26,  1.81s/it, lr: 1.0e-04 loss: 4.409e-01]
a-cold-wall:  79%|#######8  | 2358/3000 [1:06:00<22:44,  2.12s/it, lr: 1.0e-04 loss: 4.409e-01]
a-cold-wall:  79%|#######8  | 2358/3000 [1:06:00<22:44,  2.12s/it, lr: 1.0e-04 loss: 4.409e-01]
a-cold-wall:  79%|#######8  | 2358/3000 [1:06:01<22:44,  2.12s/it, lr: 1.0e-04 loss: 4.260e-02]
a-cold-wall:  79%|#######8  | 2358/3000 [1:06:01<22:44,  2.12s/it, lr: 1.0e-04 loss: 4.260e-02]
a-cold-wall:  79%|#######8  | 2359/3000 [1:06:01<18:23,  1.72s/it, lr: 1.0e-04 loss: 4.260e-02]
a-cold-wall:  79%|#######8  | 2359/3000 [1:06:01<18:23,  1.72s/it, lr: 1.0e-04 loss: 4.260e-02]
a-cold-wall:  79%|#######8  | 2359/3000 [1:06:02<18:23,  1.72s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  79%|#######8  | 2359/3000 [1:06:02<18:23,  1.72s/it, lr: 1.0e-04 loss: 1.505e-01]
a-cold-wall:  79%|#######8  | 2360/3000 [1:06:04<18:21,  1.72s/it, lr: 1.0e-04 loss: 6.549e-01]
a-cold-wall:  79%|#######8  | 2360/3000 [1:06:04<18:21,  1.72s/it, lr: 1.0e-04 loss: 6.549e-01]
a-cold-wall:  79%|#######8  | 2361/3000 [1:06:04<13:24,  1.26s/it, lr: 1.0e-04 loss: 6.549e-01]
a-cold-wall:  79%|#######8  | 2361/3000 [1:06:04<13:24,  1.26s/it, lr: 1.0e-04 loss: 6.549e-01]
a-cold-wall:  79%|#######8  | 2361/3000 [1:06:05<13:24,  1.26s/it, lr: 1.0e-04 loss: 1.787e-01]
a-cold-wall:  79%|#######8  | 2361/3000 [1:06:05<13:24,  1.26s/it, lr: 1.0e-04 loss: 1.787e-01]
a-cold-wall:  79%|#######8  | 2362/3000 [1:06:05<13:48,  1.30s/it, lr: 1.0e-04 loss: 1.787e-01]
a-cold-wall:  79%|#######8  | 2362/3000 [1:06:05<13:48,  1.30s/it, lr: 1.0e-04 loss: 1.787e-01]
a-cold-wall:  79%|#######8  | 2362/3000 [1:06:06<13:48,  1.30s/it, lr: 1.0e-04 loss: 5.247e-01]
a-cold-wall:  79%|#######8  | 2362/3000 [1:06:06<13:48,  1.30s/it, lr: 1.0e-04 loss: 5.247e-01]
a-cold-wall:  79%|#######8  | 2363/3000 [1:06:06<12:15,  1.15s/it, lr: 1.0e-04 loss: 5.247e-01]
a-cold-wall:  79%|#######8  | 2363/3000 [1:06:06<12:15,  1.15s/it, lr: 1.0e-04 loss: 5.247e-01]
a-cold-wall:  79%|#######8  | 2363/3000 [1:06:07<12:15,  1.15s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  79%|#######8  | 2363/3000 [1:06:07<12:15,  1.15s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  79%|#######8  | 2364/3000 [1:06:07<12:59,  1.23s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  79%|#######8  | 2364/3000 [1:06:07<12:59,  1.23s/it, lr: 1.0e-04 loss: 1.120e-01]
a-cold-wall:  79%|#######8  | 2364/3000 [1:06:08<12:59,  1.23s/it, lr: 1.0e-04 loss: 1.849e-01]
a-cold-wall:  79%|#######8  | 2364/3000 [1:06:08<12:59,  1.23s/it, lr: 1.0e-04 loss: 1.849e-01]
a-cold-wall:  79%|#######8  | 2365/3000 [1:06:08<11:31,  1.09s/it, lr: 1.0e-04 loss: 1.849e-01]
a-cold-wall:  79%|#######8  | 2365/3000 [1:06:08<11:31,  1.09s/it, lr: 1.0e-04 loss: 1.849e-01]
a-cold-wall:  79%|#######8  | 2365/3000 [1:06:09<11:31,  1.09s/it, lr: 1.0e-04 loss: 3.484e-01]
a-cold-wall:  79%|#######8  | 2365/3000 [1:06:09<11:31,  1.09s/it, lr: 1.0e-04 loss: 3.484e-01]
a-cold-wall:  79%|#######8  | 2366/3000 [1:06:09<12:50,  1.21s/it, lr: 1.0e-04 loss: 3.484e-01]
a-cold-wall:  79%|#######8  | 2366/3000 [1:06:09<12:50,  1.21s/it, lr: 1.0e-04 loss: 3.484e-01]
a-cold-wall:  79%|#######8  | 2366/3000 [1:06:11<12:50,  1.21s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  79%|#######8  | 2366/3000 [1:06:11<12:50,  1.21s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  79%|#######8  | 2367/3000 [1:06:11<13:24,  1.27s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  79%|#######8  | 2367/3000 [1:06:11<13:24,  1.27s/it, lr: 1.0e-04 loss: 2.861e-01]
a-cold-wall:  79%|#######8  | 2367/3000 [1:06:14<13:24,  1.27s/it, lr: 1.0e-04 loss: 7.299e-01]
a-cold-wall:  79%|#######8  | 2367/3000 [1:06:14<13:24,  1.27s/it, lr: 1.0e-04 loss: 7.299e-01]
a-cold-wall:  79%|#######8  | 2368/3000 [1:06:14<18:15,  1.73s/it, lr: 1.0e-04 loss: 7.299e-01]
a-cold-wall:  79%|#######8  | 2368/3000 [1:06:14<18:15,  1.73s/it, lr: 1.0e-04 loss: 7.299e-01]
a-cold-wall:  79%|#######8  | 2368/3000 [1:06:14<18:15,  1.73s/it, lr: 1.0e-04 loss: 6.336e-01]
a-cold-wall:  79%|#######8  | 2368/3000 [1:06:14<18:15,  1.73s/it, lr: 1.0e-04 loss: 6.336e-01]
a-cold-wall:  79%|#######8  | 2369/3000 [1:06:14<15:10,  1.44s/it, lr: 1.0e-04 loss: 6.336e-01]
a-cold-wall:  79%|#######8  | 2369/3000 [1:06:14<15:10,  1.44s/it, lr: 1.0e-04 loss: 6.336e-01]
a-cold-wall:  79%|#######8  | 2369/3000 [1:06:17<15:10,  1.44s/it, lr: 1.0e-04 loss: 4.963e-01]
a-cold-wall:  79%|#######8  | 2369/3000 [1:06:17<15:10,  1.44s/it, lr: 1.0e-04 loss: 4.963e-01]
a-cold-wall:  79%|#######9  | 2370/3000 [1:06:19<15:09,  1.44s/it, lr: 1.0e-04 loss: 6.045e-01]
a-cold-wall:  79%|#######9  | 2370/3000 [1:06:19<15:09,  1.44s/it, lr: 1.0e-04 loss: 6.045e-01]
a-cold-wall:  79%|#######9  | 2371/3000 [1:06:19<11:35,  1.11s/it, lr: 1.0e-04 loss: 6.045e-01]
a-cold-wall:  79%|#######9  | 2371/3000 [1:06:19<11:35,  1.11s/it, lr: 1.0e-04 loss: 6.045e-01]
a-cold-wall:  79%|#######9  | 2371/3000 [1:06:22<11:35,  1.11s/it, lr: 1.0e-04 loss: 5.671e-01]
a-cold-wall:  79%|#######9  | 2371/3000 [1:06:22<11:35,  1.11s/it, lr: 1.0e-04 loss: 5.671e-01]
a-cold-wall:  79%|#######9  | 2372/3000 [1:06:22<16:09,  1.54s/it, lr: 1.0e-04 loss: 5.671e-01]
a-cold-wall:  79%|#######9  | 2372/3000 [1:06:22<16:09,  1.54s/it, lr: 1.0e-04 loss: 5.671e-01]
a-cold-wall:  79%|#######9  | 2372/3000 [1:06:23<16:09,  1.54s/it, lr: 1.0e-04 loss: 5.240e-01]
a-cold-wall:  79%|#######9  | 2372/3000 [1:06:23<16:09,  1.54s/it, lr: 1.0e-04 loss: 5.240e-01]
a-cold-wall:  79%|#######9  | 2373/3000 [1:06:23<16:15,  1.56s/it, lr: 1.0e-04 loss: 5.240e-01]
a-cold-wall:  79%|#######9  | 2373/3000 [1:06:23<16:15,  1.56s/it, lr: 1.0e-04 loss: 5.240e-01]
a-cold-wall:  79%|#######9  | 2373/3000 [1:06:25<16:15,  1.56s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  79%|#######9  | 2373/3000 [1:06:25<16:15,  1.56s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  79%|#######9  | 2374/3000 [1:06:25<15:54,  1.52s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  79%|#######9  | 2374/3000 [1:06:25<15:54,  1.52s/it, lr: 1.0e-04 loss: 3.305e-01]
a-cold-wall:  79%|#######9  | 2374/3000 [1:06:28<15:54,  1.52s/it, lr: 1.0e-04 loss: 1.454e-01]
a-cold-wall:  79%|#######9  | 2374/3000 [1:06:28<15:54,  1.52s/it, lr: 1.0e-04 loss: 1.454e-01]
a-cold-wall:  79%|#######9  | 2375/3000 [1:06:28<19:50,  1.90s/it, lr: 1.0e-04 loss: 1.454e-01]
a-cold-wall:  79%|#######9  | 2375/3000 [1:06:28<19:50,  1.90s/it, lr: 1.0e-04 loss: 1.454e-01]
a-cold-wall:  79%|#######9  | 2375/3000 [1:06:28<19:50,  1.90s/it, lr: 1.0e-04 loss: 6.422e-01]
a-cold-wall:  79%|#######9  | 2375/3000 [1:06:28<19:50,  1.90s/it, lr: 1.0e-04 loss: 6.422e-01]
a-cold-wall:  79%|#######9  | 2376/3000 [1:06:28<16:21,  1.57s/it, lr: 1.0e-04 loss: 6.422e-01]
a-cold-wall:  79%|#######9  | 2376/3000 [1:06:28<16:21,  1.57s/it, lr: 1.0e-04 loss: 6.422e-01]
a-cold-wall:  79%|#######9  | 2376/3000 [1:06:31<16:21,  1.57s/it, lr: 1.0e-04 loss: 2.245e-01]
a-cold-wall:  79%|#######9  | 2376/3000 [1:06:31<16:21,  1.57s/it, lr: 1.0e-04 loss: 2.245e-01]
a-cold-wall:  79%|#######9  | 2377/3000 [1:06:31<20:15,  1.95s/it, lr: 1.0e-04 loss: 2.245e-01]
a-cold-wall:  79%|#######9  | 2377/3000 [1:06:31<20:15,  1.95s/it, lr: 1.0e-04 loss: 2.245e-01]
a-cold-wall:  79%|#######9  | 2377/3000 [1:06:33<20:15,  1.95s/it, lr: 1.0e-04 loss: 9.386e-02]
a-cold-wall:  79%|#######9  | 2377/3000 [1:06:33<20:15,  1.95s/it, lr: 1.0e-04 loss: 9.386e-02]
a-cold-wall:  79%|#######9  | 2378/3000 [1:06:33<18:37,  1.80s/it, lr: 1.0e-04 loss: 9.386e-02]
a-cold-wall:  79%|#######9  | 2378/3000 [1:06:33<18:37,  1.80s/it, lr: 1.0e-04 loss: 9.386e-02]
a-cold-wall:  79%|#######9  | 2378/3000 [1:06:34<18:37,  1.80s/it, lr: 1.0e-04 loss: 3.685e-01]
a-cold-wall:  79%|#######9  | 2378/3000 [1:06:34<18:37,  1.80s/it, lr: 1.0e-04 loss: 3.685e-01]
a-cold-wall:  79%|#######9  | 2379/3000 [1:06:34<17:27,  1.69s/it, lr: 1.0e-04 loss: 3.685e-01]
a-cold-wall:  79%|#######9  | 2379/3000 [1:06:34<17:27,  1.69s/it, lr: 1.0e-04 loss: 3.685e-01]
a-cold-wall:  79%|#######9  | 2379/3000 [1:06:35<17:27,  1.69s/it, lr: 1.0e-04 loss: 2.920e-01]
a-cold-wall:  79%|#######9  | 2379/3000 [1:06:35<17:27,  1.69s/it, lr: 1.0e-04 loss: 2.920e-01]
a-cold-wall:  79%|#######9  | 2380/3000 [1:06:36<17:25,  1.69s/it, lr: 1.0e-04 loss: 5.866e-02]
a-cold-wall:  79%|#######9  | 2380/3000 [1:06:36<17:25,  1.69s/it, lr: 1.0e-04 loss: 5.866e-02]
a-cold-wall:  79%|#######9  | 2381/3000 [1:06:36<11:11,  1.08s/it, lr: 1.0e-04 loss: 5.866e-02]
a-cold-wall:  79%|#######9  | 2381/3000 [1:06:36<11:11,  1.08s/it, lr: 1.0e-04 loss: 5.866e-02]
a-cold-wall:  79%|#######9  | 2381/3000 [1:06:37<11:11,  1.08s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  79%|#######9  | 2381/3000 [1:06:37<11:11,  1.08s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  79%|#######9  | 2382/3000 [1:06:37<10:19,  1.00s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  79%|#######9  | 2382/3000 [1:06:37<10:19,  1.00s/it, lr: 1.0e-04 loss: 4.490e-01]
a-cold-wall:  79%|#######9  | 2382/3000 [1:06:38<10:19,  1.00s/it, lr: 1.0e-04 loss: 2.891e-01]
a-cold-wall:  79%|#######9  | 2382/3000 [1:06:38<10:19,  1.00s/it, lr: 1.0e-04 loss: 2.891e-01]
a-cold-wall:  79%|#######9  | 2383/3000 [1:06:38<11:24,  1.11s/it, lr: 1.0e-04 loss: 2.891e-01]
a-cold-wall:  79%|#######9  | 2383/3000 [1:06:38<11:24,  1.11s/it, lr: 1.0e-04 loss: 2.891e-01]
a-cold-wall:  79%|#######9  | 2383/3000 [1:06:41<11:24,  1.11s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:  79%|#######9  | 2383/3000 [1:06:41<11:24,  1.11s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:  79%|#######9  | 2384/3000 [1:06:41<16:15,  1.58s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:  79%|#######9  | 2384/3000 [1:06:41<16:15,  1.58s/it, lr: 1.0e-04 loss: 1.813e-01]
a-cold-wall:  79%|#######9  | 2384/3000 [1:06:42<16:15,  1.58s/it, lr: 1.0e-04 loss: 4.292e-01]
a-cold-wall:  79%|#######9  | 2384/3000 [1:06:42<16:15,  1.58s/it, lr: 1.0e-04 loss: 4.292e-01]
a-cold-wall:  80%|#######9  | 2385/3000 [1:06:42<13:49,  1.35s/it, lr: 1.0e-04 loss: 4.292e-01]
a-cold-wall:  80%|#######9  | 2385/3000 [1:06:42<13:49,  1.35s/it, lr: 1.0e-04 loss: 4.292e-01]
a-cold-wall:  80%|#######9  | 2385/3000 [1:06:45<13:49,  1.35s/it, lr: 1.0e-04 loss: 1.279e-01]
a-cold-wall:  80%|#######9  | 2385/3000 [1:06:45<13:49,  1.35s/it, lr: 1.0e-04 loss: 1.279e-01]
a-cold-wall:  80%|#######9  | 2386/3000 [1:06:45<18:20,  1.79s/it, lr: 1.0e-04 loss: 1.279e-01]
a-cold-wall:  80%|#######9  | 2386/3000 [1:06:45<18:20,  1.79s/it, lr: 1.0e-04 loss: 1.279e-01]
a-cold-wall:  80%|#######9  | 2386/3000 [1:06:46<18:20,  1.79s/it, lr: 1.0e-04 loss: 6.296e-01]
a-cold-wall:  80%|#######9  | 2386/3000 [1:06:46<18:20,  1.79s/it, lr: 1.0e-04 loss: 6.296e-01]
a-cold-wall:  80%|#######9  | 2387/3000 [1:06:46<15:12,  1.49s/it, lr: 1.0e-04 loss: 6.296e-01]
a-cold-wall:  80%|#######9  | 2387/3000 [1:06:46<15:12,  1.49s/it, lr: 1.0e-04 loss: 6.296e-01]
a-cold-wall:  80%|#######9  | 2387/3000 [1:06:47<15:12,  1.49s/it, lr: 1.0e-04 loss: 7.311e-01]
a-cold-wall:  80%|#######9  | 2387/3000 [1:06:47<15:12,  1.49s/it, lr: 1.0e-04 loss: 7.311e-01]
a-cold-wall:  80%|#######9  | 2388/3000 [1:06:47<15:29,  1.52s/it, lr: 1.0e-04 loss: 7.311e-01]
a-cold-wall:  80%|#######9  | 2388/3000 [1:06:47<15:29,  1.52s/it, lr: 1.0e-04 loss: 7.311e-01]
a-cold-wall:  80%|#######9  | 2388/3000 [1:06:49<15:29,  1.52s/it, lr: 1.0e-04 loss: 4.751e-01]
a-cold-wall:  80%|#######9  | 2388/3000 [1:06:49<15:29,  1.52s/it, lr: 1.0e-04 loss: 4.751e-01]
a-cold-wall:  80%|#######9  | 2389/3000 [1:06:49<15:10,  1.49s/it, lr: 1.0e-04 loss: 4.751e-01]
a-cold-wall:  80%|#######9  | 2389/3000 [1:06:49<15:10,  1.49s/it, lr: 1.0e-04 loss: 4.751e-01]
a-cold-wall:  80%|#######9  | 2389/3000 [1:06:52<15:10,  1.49s/it, lr: 1.0e-04 loss: 3.478e-01]
a-cold-wall:  80%|#######9  | 2389/3000 [1:06:52<15:10,  1.49s/it, lr: 1.0e-04 loss: 3.478e-01]
a-cold-wall:  80%|#######9  | 2390/3000 [1:06:53<15:09,  1.49s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  80%|#######9  | 2390/3000 [1:06:53<15:09,  1.49s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  80%|#######9  | 2391/3000 [1:06:53<11:30,  1.13s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  80%|#######9  | 2391/3000 [1:06:53<11:30,  1.13s/it, lr: 1.0e-04 loss: 1.932e-01]
a-cold-wall:  80%|#######9  | 2391/3000 [1:06:56<11:30,  1.13s/it, lr: 1.0e-04 loss: 1.101e-01]
a-cold-wall:  80%|#######9  | 2391/3000 [1:06:56<11:30,  1.13s/it, lr: 1.0e-04 loss: 1.101e-01]
a-cold-wall:  80%|#######9  | 2392/3000 [1:06:56<15:54,  1.57s/it, lr: 1.0e-04 loss: 1.101e-01]
a-cold-wall:  80%|#######9  | 2392/3000 [1:06:56<15:54,  1.57s/it, lr: 1.0e-04 loss: 1.101e-01]
a-cold-wall:  80%|#######9  | 2392/3000 [1:06:57<15:54,  1.57s/it, lr: 1.0e-04 loss: 1.739e-01]
a-cold-wall:  80%|#######9  | 2392/3000 [1:06:57<15:54,  1.57s/it, lr: 1.0e-04 loss: 1.739e-01]
a-cold-wall:  80%|#######9  | 2393/3000 [1:06:57<15:32,  1.54s/it, lr: 1.0e-04 loss: 1.739e-01]
a-cold-wall:  80%|#######9  | 2393/3000 [1:06:57<15:32,  1.54s/it, lr: 1.0e-04 loss: 1.739e-01]
a-cold-wall:  80%|#######9  | 2393/3000 [1:07:00<15:32,  1.54s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:  80%|#######9  | 2393/3000 [1:07:00<15:32,  1.54s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:  80%|#######9  | 2394/3000 [1:07:00<19:17,  1.91s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:  80%|#######9  | 2394/3000 [1:07:00<19:17,  1.91s/it, lr: 1.0e-04 loss: 6.095e-01]
a-cold-wall:  80%|#######9  | 2394/3000 [1:07:01<19:17,  1.91s/it, lr: 1.0e-04 loss: 4.140e-01]
a-cold-wall:  80%|#######9  | 2394/3000 [1:07:01<19:17,  1.91s/it, lr: 1.0e-04 loss: 4.140e-01]
a-cold-wall:  80%|#######9  | 2395/3000 [1:07:01<15:58,  1.58s/it, lr: 1.0e-04 loss: 4.140e-01]
a-cold-wall:  80%|#######9  | 2395/3000 [1:07:01<15:58,  1.58s/it, lr: 1.0e-04 loss: 4.140e-01]
a-cold-wall:  80%|#######9  | 2395/3000 [1:07:02<15:58,  1.58s/it, lr: 1.0e-04 loss: 7.017e-01]
a-cold-wall:  80%|#######9  | 2395/3000 [1:07:02<15:58,  1.58s/it, lr: 1.0e-04 loss: 7.017e-01]
a-cold-wall:  80%|#######9  | 2396/3000 [1:07:02<15:37,  1.55s/it, lr: 1.0e-04 loss: 7.017e-01]
a-cold-wall:  80%|#######9  | 2396/3000 [1:07:02<15:37,  1.55s/it, lr: 1.0e-04 loss: 7.017e-01]
a-cold-wall:  80%|#######9  | 2396/3000 [1:07:05<15:37,  1.55s/it, lr: 1.0e-04 loss: 2.236e-01]
a-cold-wall:  80%|#######9  | 2396/3000 [1:07:05<15:37,  1.55s/it, lr: 1.0e-04 loss: 2.236e-01]
a-cold-wall:  80%|#######9  | 2397/3000 [1:07:05<19:34,  1.95s/it, lr: 1.0e-04 loss: 2.236e-01]
a-cold-wall:  80%|#######9  | 2397/3000 [1:07:05<19:34,  1.95s/it, lr: 1.0e-04 loss: 2.236e-01]
a-cold-wall:  80%|#######9  | 2397/3000 [1:07:07<19:34,  1.95s/it, lr: 1.0e-04 loss: 5.303e-01]
a-cold-wall:  80%|#######9  | 2397/3000 [1:07:07<19:34,  1.95s/it, lr: 1.0e-04 loss: 5.303e-01]
a-cold-wall:  80%|#######9  | 2398/3000 [1:07:07<18:01,  1.80s/it, lr: 1.0e-04 loss: 5.303e-01]
a-cold-wall:  80%|#######9  | 2398/3000 [1:07:07<18:01,  1.80s/it, lr: 1.0e-04 loss: 5.303e-01]
a-cold-wall:  80%|#######9  | 2398/3000 [1:07:08<18:01,  1.80s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  80%|#######9  | 2398/3000 [1:07:08<18:01,  1.80s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  80%|#######9  | 2399/3000 [1:07:08<14:56,  1.49s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  80%|#######9  | 2399/3000 [1:07:08<14:56,  1.49s/it, lr: 1.0e-04 loss: 2.368e-01]
a-cold-wall:  80%|#######9  | 2399/3000 [1:07:10<14:56,  1.49s/it, lr: 1.0e-04 loss: 1.553e-01]
a-cold-wall:  80%|#######9  | 2399/3000 [1:07:10<14:56,  1.49s/it, lr: 1.0e-04 loss: 1.553e-01]
a-cold-wall:  80%|########  | 2400/3000 [1:07:12<14:54,  1.49s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:  80%|########  | 2400/3000 [1:07:12<14:54,  1.49s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:  80%|########  | 2401/3000 [1:07:12<11:20,  1.14s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:  80%|########  | 2401/3000 [1:07:12<11:20,  1.14s/it, lr: 1.0e-04 loss: 7.684e-01]
a-cold-wall:  80%|########  | 2401/3000 [1:07:13<11:20,  1.14s/it, lr: 1.0e-04 loss: 6.380e-01]
a-cold-wall:  80%|########  | 2401/3000 [1:07:13<11:20,  1.14s/it, lr: 1.0e-04 loss: 6.380e-01]
a-cold-wall:  80%|########  | 2402/3000 [1:07:13<10:54,  1.10s/it, lr: 1.0e-04 loss: 6.380e-01]
a-cold-wall:  80%|########  | 2402/3000 [1:07:13<10:54,  1.10s/it, lr: 1.0e-04 loss: 6.380e-01]
a-cold-wall:  80%|########  | 2402/3000 [1:07:14<10:54,  1.10s/it, lr: 1.0e-04 loss: 4.004e-01]
a-cold-wall:  80%|########  | 2402/3000 [1:07:14<10:54,  1.10s/it, lr: 1.0e-04 loss: 4.004e-01]
a-cold-wall:  80%|########  | 2403/3000 [1:07:14<11:45,  1.18s/it, lr: 1.0e-04 loss: 4.004e-01]
a-cold-wall:  80%|########  | 2403/3000 [1:07:14<11:45,  1.18s/it, lr: 1.0e-04 loss: 4.004e-01]
a-cold-wall:  80%|########  | 2403/3000 [1:07:15<11:45,  1.18s/it, lr: 1.0e-04 loss: 6.285e-01]
a-cold-wall:  80%|########  | 2403/3000 [1:07:15<11:45,  1.18s/it, lr: 1.0e-04 loss: 6.285e-01]
a-cold-wall:  80%|########  | 2404/3000 [1:07:15<10:33,  1.06s/it, lr: 1.0e-04 loss: 6.285e-01]
a-cold-wall:  80%|########  | 2404/3000 [1:07:15<10:33,  1.06s/it, lr: 1.0e-04 loss: 6.285e-01]
a-cold-wall:  80%|########  | 2404/3000 [1:07:18<10:33,  1.06s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  80%|########  | 2404/3000 [1:07:18<10:33,  1.06s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  80%|########  | 2405/3000 [1:07:18<15:34,  1.57s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  80%|########  | 2405/3000 [1:07:18<15:34,  1.57s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  80%|########  | 2405/3000 [1:07:19<15:34,  1.57s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  80%|########  | 2405/3000 [1:07:19<15:34,  1.57s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  80%|########  | 2406/3000 [1:07:19<15:05,  1.52s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  80%|########  | 2406/3000 [1:07:19<15:05,  1.52s/it, lr: 1.0e-04 loss: 1.415e-01]
a-cold-wall:  80%|########  | 2406/3000 [1:07:20<15:05,  1.52s/it, lr: 1.0e-04 loss: 3.610e-01]
a-cold-wall:  80%|########  | 2406/3000 [1:07:20<15:05,  1.52s/it, lr: 1.0e-04 loss: 3.610e-01]
a-cold-wall:  80%|########  | 2407/3000 [1:07:20<13:29,  1.36s/it, lr: 1.0e-04 loss: 3.610e-01]
a-cold-wall:  80%|########  | 2407/3000 [1:07:20<13:29,  1.36s/it, lr: 1.0e-04 loss: 3.610e-01]
a-cold-wall:  80%|########  | 2407/3000 [1:07:21<13:29,  1.36s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  80%|########  | 2407/3000 [1:07:21<13:29,  1.36s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  80%|########  | 2408/3000 [1:07:21<11:54,  1.21s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  80%|########  | 2408/3000 [1:07:21<11:54,  1.21s/it, lr: 1.0e-04 loss: 1.220e-01]
a-cold-wall:  80%|########  | 2408/3000 [1:07:24<11:54,  1.21s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  80%|########  | 2408/3000 [1:07:24<11:54,  1.21s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  80%|########  | 2409/3000 [1:07:24<16:38,  1.69s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  80%|########  | 2409/3000 [1:07:24<16:38,  1.69s/it, lr: 1.0e-04 loss: 5.083e-01]
a-cold-wall:  80%|########  | 2409/3000 [1:07:25<16:38,  1.69s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  80%|########  | 2409/3000 [1:07:25<16:38,  1.69s/it, lr: 1.0e-04 loss: 6.886e-01]
a-cold-wall:  80%|########  | 2410/3000 [1:07:26<16:36,  1.69s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  80%|########  | 2410/3000 [1:07:26<16:36,  1.69s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  80%|########  | 2411/3000 [1:07:26<10:39,  1.09s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  80%|########  | 2411/3000 [1:07:26<10:39,  1.09s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  80%|########  | 2411/3000 [1:07:27<10:39,  1.09s/it, lr: 1.0e-04 loss: 6.512e-01]
a-cold-wall:  80%|########  | 2411/3000 [1:07:27<10:39,  1.09s/it, lr: 1.0e-04 loss: 6.512e-01]
a-cold-wall:  80%|########  | 2412/3000 [1:07:27<09:47,  1.00it/s, lr: 1.0e-04 loss: 6.512e-01]
a-cold-wall:  80%|########  | 2412/3000 [1:07:27<09:47,  1.00it/s, lr: 1.0e-04 loss: 6.512e-01]
a-cold-wall:  80%|########  | 2412/3000 [1:07:30<09:47,  1.00it/s, lr: 1.0e-04 loss: 2.647e-01]
a-cold-wall:  80%|########  | 2412/3000 [1:07:30<09:47,  1.00it/s, lr: 1.0e-04 loss: 2.647e-01]
a-cold-wall:  80%|########  | 2413/3000 [1:07:30<14:27,  1.48s/it, lr: 1.0e-04 loss: 2.647e-01]
a-cold-wall:  80%|########  | 2413/3000 [1:07:30<14:27,  1.48s/it, lr: 1.0e-04 loss: 2.647e-01]
a-cold-wall:  80%|########  | 2413/3000 [1:07:32<14:27,  1.48s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  80%|########  | 2413/3000 [1:07:32<14:27,  1.48s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  80%|########  | 2414/3000 [1:07:32<18:06,  1.85s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  80%|########  | 2414/3000 [1:07:32<18:06,  1.85s/it, lr: 1.0e-04 loss: 6.937e-01]
a-cold-wall:  80%|########  | 2414/3000 [1:07:35<18:06,  1.85s/it, lr: 1.0e-04 loss: 3.667e-01]
a-cold-wall:  80%|########  | 2414/3000 [1:07:35<18:06,  1.85s/it, lr: 1.0e-04 loss: 3.667e-01]
a-cold-wall:  80%|########  | 2415/3000 [1:07:35<17:51,  1.83s/it, lr: 1.0e-04 loss: 3.667e-01]
a-cold-wall:  80%|########  | 2415/3000 [1:07:35<17:51,  1.83s/it, lr: 1.0e-04 loss: 3.667e-01]
a-cold-wall:  80%|########  | 2415/3000 [1:07:35<17:51,  1.83s/it, lr: 1.0e-04 loss: 3.956e-01]
a-cold-wall:  80%|########  | 2415/3000 [1:07:35<17:51,  1.83s/it, lr: 1.0e-04 loss: 3.956e-01]
a-cold-wall:  81%|########  | 2416/3000 [1:07:35<14:48,  1.52s/it, lr: 1.0e-04 loss: 3.956e-01]
a-cold-wall:  81%|########  | 2416/3000 [1:07:35<14:48,  1.52s/it, lr: 1.0e-04 loss: 3.956e-01]
a-cold-wall:  81%|########  | 2416/3000 [1:07:37<14:48,  1.52s/it, lr: 1.0e-04 loss: 1.999e-01]
a-cold-wall:  81%|########  | 2416/3000 [1:07:37<14:48,  1.52s/it, lr: 1.0e-04 loss: 1.999e-01]
a-cold-wall:  81%|########  | 2417/3000 [1:07:37<14:29,  1.49s/it, lr: 1.0e-04 loss: 1.999e-01]
a-cold-wall:  81%|########  | 2417/3000 [1:07:37<14:29,  1.49s/it, lr: 1.0e-04 loss: 1.999e-01]
a-cold-wall:  81%|########  | 2417/3000 [1:07:40<14:29,  1.49s/it, lr: 1.0e-04 loss: 5.117e-02]
a-cold-wall:  81%|########  | 2417/3000 [1:07:40<14:29,  1.49s/it, lr: 1.0e-04 loss: 5.117e-02]
a-cold-wall:  81%|########  | 2418/3000 [1:07:40<18:22,  1.89s/it, lr: 1.0e-04 loss: 5.117e-02]
a-cold-wall:  81%|########  | 2418/3000 [1:07:40<18:22,  1.89s/it, lr: 1.0e-04 loss: 5.117e-02]
a-cold-wall:  81%|########  | 2418/3000 [1:07:41<18:22,  1.89s/it, lr: 1.0e-04 loss: 1.193e-02]
a-cold-wall:  81%|########  | 2418/3000 [1:07:41<18:22,  1.89s/it, lr: 1.0e-04 loss: 1.193e-02]
a-cold-wall:  81%|########  | 2419/3000 [1:07:41<15:05,  1.56s/it, lr: 1.0e-04 loss: 1.193e-02]
a-cold-wall:  81%|########  | 2419/3000 [1:07:41<15:05,  1.56s/it, lr: 1.0e-04 loss: 1.193e-02]
a-cold-wall:  81%|########  | 2419/3000 [1:07:42<15:05,  1.56s/it, lr: 1.0e-04 loss: 3.815e-01]
a-cold-wall:  81%|########  | 2419/3000 [1:07:42<15:05,  1.56s/it, lr: 1.0e-04 loss: 3.815e-01]
a-cold-wall:  81%|########  | 2420/3000 [1:07:43<15:04,  1.56s/it, lr: 1.0e-04 loss: 1.199e-01]
a-cold-wall:  81%|########  | 2420/3000 [1:07:43<15:04,  1.56s/it, lr: 1.0e-04 loss: 1.199e-01]
a-cold-wall:  81%|########  | 2421/3000 [1:07:43<11:17,  1.17s/it, lr: 1.0e-04 loss: 1.199e-01]
a-cold-wall:  81%|########  | 2421/3000 [1:07:43<11:17,  1.17s/it, lr: 1.0e-04 loss: 1.199e-01]
a-cold-wall:  81%|########  | 2421/3000 [1:07:45<11:17,  1.17s/it, lr: 1.0e-04 loss: 6.097e-01]
a-cold-wall:  81%|########  | 2421/3000 [1:07:45<11:17,  1.17s/it, lr: 1.0e-04 loss: 6.097e-01]
a-cold-wall:  81%|########  | 2422/3000 [1:07:45<11:53,  1.24s/it, lr: 1.0e-04 loss: 6.097e-01]
a-cold-wall:  81%|########  | 2422/3000 [1:07:45<11:53,  1.24s/it, lr: 1.0e-04 loss: 6.097e-01]
a-cold-wall:  81%|########  | 2422/3000 [1:07:48<11:53,  1.24s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  81%|########  | 2422/3000 [1:07:48<11:53,  1.24s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  81%|########  | 2423/3000 [1:07:48<15:52,  1.65s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  81%|########  | 2423/3000 [1:07:48<15:52,  1.65s/it, lr: 1.0e-04 loss: 2.023e-01]
a-cold-wall:  81%|########  | 2423/3000 [1:07:48<15:52,  1.65s/it, lr: 1.0e-04 loss: 5.772e-01]
a-cold-wall:  81%|########  | 2423/3000 [1:07:48<15:52,  1.65s/it, lr: 1.0e-04 loss: 5.772e-01]
a-cold-wall:  81%|########  | 2424/3000 [1:07:48<13:29,  1.41s/it, lr: 1.0e-04 loss: 5.772e-01]
a-cold-wall:  81%|########  | 2424/3000 [1:07:48<13:29,  1.41s/it, lr: 1.0e-04 loss: 5.772e-01]
a-cold-wall:  81%|########  | 2424/3000 [1:07:49<13:29,  1.41s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  81%|########  | 2424/3000 [1:07:49<13:29,  1.41s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  81%|########  | 2425/3000 [1:07:49<11:43,  1.22s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  81%|########  | 2425/3000 [1:07:49<11:43,  1.22s/it, lr: 1.0e-04 loss: 8.202e-01]
a-cold-wall:  81%|########  | 2425/3000 [1:07:50<11:43,  1.22s/it, lr: 1.0e-04 loss: 6.816e-01]
a-cold-wall:  81%|########  | 2425/3000 [1:07:50<11:43,  1.22s/it, lr: 1.0e-04 loss: 6.816e-01]
a-cold-wall:  81%|########  | 2426/3000 [1:07:50<10:26,  1.09s/it, lr: 1.0e-04 loss: 6.816e-01]
a-cold-wall:  81%|########  | 2426/3000 [1:07:50<10:26,  1.09s/it, lr: 1.0e-04 loss: 6.816e-01]
a-cold-wall:  81%|########  | 2426/3000 [1:07:51<10:26,  1.09s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  81%|########  | 2426/3000 [1:07:51<10:26,  1.09s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  81%|########  | 2427/3000 [1:07:51<11:16,  1.18s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  81%|########  | 2427/3000 [1:07:51<11:16,  1.18s/it, lr: 1.0e-04 loss: 3.710e-01]
a-cold-wall:  81%|########  | 2427/3000 [1:07:52<11:16,  1.18s/it, lr: 1.0e-04 loss: 3.910e-01]
a-cold-wall:  81%|########  | 2427/3000 [1:07:52<11:16,  1.18s/it, lr: 1.0e-04 loss: 3.910e-01]
a-cold-wall:  81%|########  | 2428/3000 [1:07:52<10:39,  1.12s/it, lr: 1.0e-04 loss: 3.910e-01]
a-cold-wall:  81%|########  | 2428/3000 [1:07:52<10:39,  1.12s/it, lr: 1.0e-04 loss: 3.910e-01]
a-cold-wall:  81%|########  | 2428/3000 [1:07:54<10:39,  1.12s/it, lr: 1.0e-04 loss: 5.374e-01]
a-cold-wall:  81%|########  | 2428/3000 [1:07:54<10:39,  1.12s/it, lr: 1.0e-04 loss: 5.374e-01]
a-cold-wall:  81%|########  | 2429/3000 [1:07:54<11:27,  1.20s/it, lr: 1.0e-04 loss: 5.374e-01]
a-cold-wall:  81%|########  | 2429/3000 [1:07:54<11:27,  1.20s/it, lr: 1.0e-04 loss: 5.374e-01]
a-cold-wall:  81%|########  | 2429/3000 [1:07:55<11:27,  1.20s/it, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  81%|########  | 2429/3000 [1:07:55<11:27,  1.20s/it, lr: 1.0e-04 loss: 1.336e-01]
a-cold-wall:  81%|########1 | 2430/3000 [1:07:56<11:26,  1.20s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  81%|########1 | 2430/3000 [1:07:56<11:26,  1.20s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  81%|########1 | 2431/3000 [1:07:56<07:51,  1.21it/s, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  81%|########1 | 2431/3000 [1:07:56<07:51,  1.21it/s, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  81%|########1 | 2431/3000 [1:07:59<07:51,  1.21it/s, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  81%|########1 | 2431/3000 [1:07:59<07:51,  1.21it/s, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  81%|########1 | 2432/3000 [1:07:59<12:36,  1.33s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  81%|########1 | 2432/3000 [1:07:59<12:36,  1.33s/it, lr: 1.0e-04 loss: 3.188e-01]
a-cold-wall:  81%|########1 | 2432/3000 [1:08:02<12:36,  1.33s/it, lr: 1.0e-04 loss: 7.290e-02]
a-cold-wall:  81%|########1 | 2432/3000 [1:08:02<12:36,  1.33s/it, lr: 1.0e-04 loss: 7.290e-02]
a-cold-wall:  81%|########1 | 2433/3000 [1:08:02<16:17,  1.72s/it, lr: 1.0e-04 loss: 7.290e-02]
a-cold-wall:  81%|########1 | 2433/3000 [1:08:02<16:17,  1.72s/it, lr: 1.0e-04 loss: 7.290e-02]
a-cold-wall:  81%|########1 | 2433/3000 [1:08:02<16:17,  1.72s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  81%|########1 | 2433/3000 [1:08:02<16:17,  1.72s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  81%|########1 | 2434/3000 [1:08:02<13:45,  1.46s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  81%|########1 | 2434/3000 [1:08:02<13:45,  1.46s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  81%|########1 | 2434/3000 [1:08:03<13:45,  1.46s/it, lr: 1.0e-04 loss: 4.377e-02]
a-cold-wall:  81%|########1 | 2434/3000 [1:08:03<13:45,  1.46s/it, lr: 1.0e-04 loss: 4.377e-02]
a-cold-wall:  81%|########1 | 2435/3000 [1:08:03<11:51,  1.26s/it, lr: 1.0e-04 loss: 4.377e-02]
a-cold-wall:  81%|########1 | 2435/3000 [1:08:03<11:51,  1.26s/it, lr: 1.0e-04 loss: 4.377e-02]
a-cold-wall:  81%|########1 | 2435/3000 [1:08:06<11:51,  1.26s/it, lr: 1.0e-04 loss: 9.218e-02]
a-cold-wall:  81%|########1 | 2435/3000 [1:08:06<11:51,  1.26s/it, lr: 1.0e-04 loss: 9.218e-02]
a-cold-wall:  81%|########1 | 2436/3000 [1:08:06<16:04,  1.71s/it, lr: 1.0e-04 loss: 9.218e-02]
a-cold-wall:  81%|########1 | 2436/3000 [1:08:06<16:04,  1.71s/it, lr: 1.0e-04 loss: 9.218e-02]
a-cold-wall:  81%|########1 | 2436/3000 [1:08:09<16:04,  1.71s/it, lr: 1.0e-04 loss: 1.285e-02]
a-cold-wall:  81%|########1 | 2436/3000 [1:08:09<16:04,  1.71s/it, lr: 1.0e-04 loss: 1.285e-02]
a-cold-wall:  81%|########1 | 2437/3000 [1:08:09<19:11,  2.04s/it, lr: 1.0e-04 loss: 1.285e-02]
a-cold-wall:  81%|########1 | 2437/3000 [1:08:09<19:11,  2.04s/it, lr: 1.0e-04 loss: 1.285e-02]
a-cold-wall:  81%|########1 | 2437/3000 [1:08:10<19:11,  2.04s/it, lr: 1.0e-04 loss: 2.916e-01]
a-cold-wall:  81%|########1 | 2437/3000 [1:08:10<19:11,  2.04s/it, lr: 1.0e-04 loss: 2.916e-01]
a-cold-wall:  81%|########1 | 2438/3000 [1:08:10<17:26,  1.86s/it, lr: 1.0e-04 loss: 2.916e-01]
a-cold-wall:  81%|########1 | 2438/3000 [1:08:10<17:26,  1.86s/it, lr: 1.0e-04 loss: 2.916e-01]
a-cold-wall:  81%|########1 | 2438/3000 [1:08:11<17:26,  1.86s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  81%|########1 | 2438/3000 [1:08:11<17:26,  1.86s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  81%|########1 | 2439/3000 [1:08:11<14:19,  1.53s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  81%|########1 | 2439/3000 [1:08:11<14:19,  1.53s/it, lr: 1.0e-04 loss: 2.265e-01]
a-cold-wall:  81%|########1 | 2439/3000 [1:08:12<14:19,  1.53s/it, lr: 1.0e-04 loss: 6.767e-01]
a-cold-wall:  81%|########1 | 2439/3000 [1:08:12<14:19,  1.53s/it, lr: 1.0e-04 loss: 6.767e-01]
a-cold-wall:  81%|########1 | 2440/3000 [1:08:15<14:17,  1.53s/it, lr: 1.0e-04 loss: 6.513e-02]
a-cold-wall:  81%|########1 | 2440/3000 [1:08:15<14:17,  1.53s/it, lr: 1.0e-04 loss: 6.513e-02]
a-cold-wall:  81%|########1 | 2441/3000 [1:08:15<13:51,  1.49s/it, lr: 1.0e-04 loss: 6.513e-02]
a-cold-wall:  81%|########1 | 2441/3000 [1:08:15<13:51,  1.49s/it, lr: 1.0e-04 loss: 6.513e-02]
a-cold-wall:  81%|########1 | 2441/3000 [1:08:16<13:51,  1.49s/it, lr: 1.0e-04 loss: 5.445e-01]
a-cold-wall:  81%|########1 | 2441/3000 [1:08:16<13:51,  1.49s/it, lr: 1.0e-04 loss: 5.445e-01]
a-cold-wall:  81%|########1 | 2442/3000 [1:08:16<13:41,  1.47s/it, lr: 1.0e-04 loss: 5.445e-01]
a-cold-wall:  81%|########1 | 2442/3000 [1:08:16<13:41,  1.47s/it, lr: 1.0e-04 loss: 5.445e-01]
a-cold-wall:  81%|########1 | 2442/3000 [1:08:18<13:41,  1.47s/it, lr: 1.0e-04 loss: 4.987e-01]
a-cold-wall:  81%|########1 | 2442/3000 [1:08:18<13:41,  1.47s/it, lr: 1.0e-04 loss: 4.987e-01]
a-cold-wall:  81%|########1 | 2443/3000 [1:08:18<13:54,  1.50s/it, lr: 1.0e-04 loss: 4.987e-01]
a-cold-wall:  81%|########1 | 2443/3000 [1:08:18<13:54,  1.50s/it, lr: 1.0e-04 loss: 4.987e-01]
a-cold-wall:  81%|########1 | 2443/3000 [1:08:19<13:54,  1.50s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  81%|########1 | 2443/3000 [1:08:19<13:54,  1.50s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  81%|########1 | 2444/3000 [1:08:19<13:33,  1.46s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  81%|########1 | 2444/3000 [1:08:19<13:33,  1.46s/it, lr: 1.0e-04 loss: 5.272e-01]
a-cold-wall:  81%|########1 | 2444/3000 [1:08:20<13:33,  1.46s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  81%|########1 | 2444/3000 [1:08:20<13:33,  1.46s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  82%|########1 | 2445/3000 [1:08:20<11:40,  1.26s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  82%|########1 | 2445/3000 [1:08:20<11:40,  1.26s/it, lr: 1.0e-04 loss: 3.719e-01]
a-cold-wall:  82%|########1 | 2445/3000 [1:08:21<11:40,  1.26s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  82%|########1 | 2445/3000 [1:08:21<11:40,  1.26s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  82%|########1 | 2446/3000 [1:08:21<12:05,  1.31s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  82%|########1 | 2446/3000 [1:08:21<12:05,  1.31s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  82%|########1 | 2446/3000 [1:08:24<12:05,  1.31s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  82%|########1 | 2446/3000 [1:08:24<12:05,  1.31s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  82%|########1 | 2447/3000 [1:08:24<16:12,  1.76s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  82%|########1 | 2447/3000 [1:08:24<16:12,  1.76s/it, lr: 1.0e-04 loss: 5.939e-01]
a-cold-wall:  82%|########1 | 2447/3000 [1:08:27<16:12,  1.76s/it, lr: 1.0e-04 loss: 4.525e-01]
a-cold-wall:  82%|########1 | 2447/3000 [1:08:27<16:12,  1.76s/it, lr: 1.0e-04 loss: 4.525e-01]
a-cold-wall:  82%|########1 | 2448/3000 [1:08:27<19:11,  2.09s/it, lr: 1.0e-04 loss: 4.525e-01]
a-cold-wall:  82%|########1 | 2448/3000 [1:08:27<19:11,  2.09s/it, lr: 1.0e-04 loss: 4.525e-01]
a-cold-wall:  82%|########1 | 2448/3000 [1:08:28<19:11,  2.09s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  82%|########1 | 2448/3000 [1:08:28<19:11,  2.09s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  82%|########1 | 2449/3000 [1:08:28<15:31,  1.69s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  82%|########1 | 2449/3000 [1:08:28<15:31,  1.69s/it, lr: 1.0e-04 loss: 2.846e-01]
a-cold-wall:  82%|########1 | 2449/3000 [1:08:30<15:31,  1.69s/it, lr: 1.0e-04 loss: 1.214e-01]
a-cold-wall:  82%|########1 | 2449/3000 [1:08:30<15:31,  1.69s/it, lr: 1.0e-04 loss: 1.214e-01]
a-cold-wall:  82%|########1 | 2450/3000 [1:08:31<15:29,  1.69s/it, lr: 1.0e-04 loss: 2.644e-01]
a-cold-wall:  82%|########1 | 2450/3000 [1:08:31<15:29,  1.69s/it, lr: 1.0e-04 loss: 2.644e-01]
a-cold-wall:  82%|########1 | 2451/3000 [1:08:31<09:58,  1.09s/it, lr: 1.0e-04 loss: 2.644e-01]
a-cold-wall:  82%|########1 | 2451/3000 [1:08:31<09:58,  1.09s/it, lr: 1.0e-04 loss: 2.644e-01]
a-cold-wall:  82%|########1 | 2451/3000 [1:08:32<09:58,  1.09s/it, lr: 1.0e-04 loss: 6.276e-01]
a-cold-wall:  82%|########1 | 2451/3000 [1:08:32<09:58,  1.09s/it, lr: 1.0e-04 loss: 6.276e-01]
a-cold-wall:  82%|########1 | 2452/3000 [1:08:32<09:11,  1.01s/it, lr: 1.0e-04 loss: 6.276e-01]
a-cold-wall:  82%|########1 | 2452/3000 [1:08:32<09:11,  1.01s/it, lr: 1.0e-04 loss: 6.276e-01]
a-cold-wall:  82%|########1 | 2452/3000 [1:08:33<09:11,  1.01s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  82%|########1 | 2452/3000 [1:08:33<09:11,  1.01s/it, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  82%|########1 | 2453/3000 [1:08:33<08:33,  1.07it/s, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  82%|########1 | 2453/3000 [1:08:33<08:33,  1.07it/s, lr: 1.0e-04 loss: 1.987e-01]
a-cold-wall:  82%|########1 | 2453/3000 [1:08:33<08:33,  1.07it/s, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  82%|########1 | 2453/3000 [1:08:33<08:33,  1.07it/s, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  82%|########1 | 2454/3000 [1:08:33<08:03,  1.13it/s, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  82%|########1 | 2454/3000 [1:08:33<08:03,  1.13it/s, lr: 1.0e-04 loss: 6.002e-01]
a-cold-wall:  82%|########1 | 2454/3000 [1:08:36<08:03,  1.13it/s, lr: 1.0e-04 loss: 5.077e-01]
a-cold-wall:  82%|########1 | 2454/3000 [1:08:36<08:03,  1.13it/s, lr: 1.0e-04 loss: 5.077e-01]
a-cold-wall:  82%|########1 | 2455/3000 [1:08:36<13:05,  1.44s/it, lr: 1.0e-04 loss: 5.077e-01]
a-cold-wall:  82%|########1 | 2455/3000 [1:08:36<13:05,  1.44s/it, lr: 1.0e-04 loss: 5.077e-01]
a-cold-wall:  82%|########1 | 2455/3000 [1:08:38<13:05,  1.44s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  82%|########1 | 2455/3000 [1:08:38<13:05,  1.44s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  82%|########1 | 2456/3000 [1:08:38<13:01,  1.44s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  82%|########1 | 2456/3000 [1:08:38<13:01,  1.44s/it, lr: 1.0e-04 loss: 6.379e-01]
a-cold-wall:  82%|########1 | 2456/3000 [1:08:39<13:01,  1.44s/it, lr: 1.0e-04 loss: 2.251e-01]
a-cold-wall:  82%|########1 | 2456/3000 [1:08:39<13:01,  1.44s/it, lr: 1.0e-04 loss: 2.251e-01]
a-cold-wall:  82%|########1 | 2457/3000 [1:08:39<13:30,  1.49s/it, lr: 1.0e-04 loss: 2.251e-01]
a-cold-wall:  82%|########1 | 2457/3000 [1:08:39<13:30,  1.49s/it, lr: 1.0e-04 loss: 2.251e-01]
a-cold-wall:  82%|########1 | 2457/3000 [1:08:41<13:30,  1.49s/it, lr: 1.0e-04 loss: 5.281e-01]
a-cold-wall:  82%|########1 | 2457/3000 [1:08:41<13:30,  1.49s/it, lr: 1.0e-04 loss: 5.281e-01]
a-cold-wall:  82%|########1 | 2458/3000 [1:08:41<13:21,  1.48s/it, lr: 1.0e-04 loss: 5.281e-01]
a-cold-wall:  82%|########1 | 2458/3000 [1:08:41<13:21,  1.48s/it, lr: 1.0e-04 loss: 5.281e-01]
a-cold-wall:  82%|########1 | 2458/3000 [1:08:42<13:21,  1.48s/it, lr: 1.0e-04 loss: 6.602e-01]
a-cold-wall:  82%|########1 | 2458/3000 [1:08:42<13:21,  1.48s/it, lr: 1.0e-04 loss: 6.602e-01]
a-cold-wall:  82%|########1 | 2459/3000 [1:08:42<13:11,  1.46s/it, lr: 1.0e-04 loss: 6.602e-01]
a-cold-wall:  82%|########1 | 2459/3000 [1:08:42<13:11,  1.46s/it, lr: 1.0e-04 loss: 6.602e-01]
a-cold-wall:  82%|########1 | 2459/3000 [1:08:44<13:11,  1.46s/it, lr: 1.0e-04 loss: 4.377e-01]
a-cold-wall:  82%|########1 | 2459/3000 [1:08:44<13:11,  1.46s/it, lr: 1.0e-04 loss: 4.377e-01]
a-cold-wall:  82%|########2 | 2460/3000 [1:08:44<13:10,  1.46s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  82%|########2 | 2460/3000 [1:08:44<13:10,  1.46s/it, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  82%|########2 | 2461/3000 [1:08:44<08:39,  1.04it/s, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  82%|########2 | 2461/3000 [1:08:44<08:39,  1.04it/s, lr: 1.0e-04 loss: 1.542e-01]
a-cold-wall:  82%|########2 | 2461/3000 [1:08:47<08:39,  1.04it/s, lr: 1.0e-04 loss: 3.274e-01]
a-cold-wall:  82%|########2 | 2461/3000 [1:08:47<08:39,  1.04it/s, lr: 1.0e-04 loss: 3.274e-01]
a-cold-wall:  82%|########2 | 2462/3000 [1:08:47<12:54,  1.44s/it, lr: 1.0e-04 loss: 3.274e-01]
a-cold-wall:  82%|########2 | 2462/3000 [1:08:47<12:54,  1.44s/it, lr: 1.0e-04 loss: 3.274e-01]
a-cold-wall:  82%|########2 | 2462/3000 [1:08:48<12:54,  1.44s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  82%|########2 | 2462/3000 [1:08:48<12:54,  1.44s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  82%|########2 | 2463/3000 [1:08:48<11:17,  1.26s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  82%|########2 | 2463/3000 [1:08:48<11:17,  1.26s/it, lr: 1.0e-04 loss: 5.582e-01]
a-cold-wall:  82%|########2 | 2463/3000 [1:08:49<11:17,  1.26s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  82%|########2 | 2463/3000 [1:08:49<11:17,  1.26s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  82%|########2 | 2464/3000 [1:08:49<10:02,  1.12s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  82%|########2 | 2464/3000 [1:08:49<10:02,  1.12s/it, lr: 1.0e-04 loss: 1.275e-01]
a-cold-wall:  82%|########2 | 2464/3000 [1:08:50<10:02,  1.12s/it, lr: 1.0e-04 loss: 5.661e-01]
a-cold-wall:  82%|########2 | 2464/3000 [1:08:50<10:02,  1.12s/it, lr: 1.0e-04 loss: 5.661e-01]
a-cold-wall:  82%|########2 | 2465/3000 [1:08:50<09:04,  1.02s/it, lr: 1.0e-04 loss: 5.661e-01]
a-cold-wall:  82%|########2 | 2465/3000 [1:08:50<09:04,  1.02s/it, lr: 1.0e-04 loss: 5.661e-01]
a-cold-wall:  82%|########2 | 2465/3000 [1:08:50<09:04,  1.02s/it, lr: 1.0e-04 loss: 1.671e-01]
a-cold-wall:  82%|########2 | 2465/3000 [1:08:50<09:04,  1.02s/it, lr: 1.0e-04 loss: 1.671e-01]
a-cold-wall:  82%|########2 | 2466/3000 [1:08:50<08:21,  1.06it/s, lr: 1.0e-04 loss: 1.671e-01]
a-cold-wall:  82%|########2 | 2466/3000 [1:08:50<08:21,  1.06it/s, lr: 1.0e-04 loss: 1.671e-01]
a-cold-wall:  82%|########2 | 2466/3000 [1:08:53<08:21,  1.06it/s, lr: 1.0e-04 loss: 6.717e-01]
a-cold-wall:  82%|########2 | 2466/3000 [1:08:53<08:21,  1.06it/s, lr: 1.0e-04 loss: 6.717e-01]
a-cold-wall:  82%|########2 | 2467/3000 [1:08:53<13:17,  1.50s/it, lr: 1.0e-04 loss: 6.717e-01]
a-cold-wall:  82%|########2 | 2467/3000 [1:08:53<13:17,  1.50s/it, lr: 1.0e-04 loss: 6.717e-01]
a-cold-wall:  82%|########2 | 2467/3000 [1:08:56<13:17,  1.50s/it, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  82%|########2 | 2467/3000 [1:08:56<13:17,  1.50s/it, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  82%|########2 | 2468/3000 [1:08:56<16:49,  1.90s/it, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  82%|########2 | 2468/3000 [1:08:56<16:49,  1.90s/it, lr: 1.0e-04 loss: 3.174e-01]
a-cold-wall:  82%|########2 | 2468/3000 [1:08:57<16:49,  1.90s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  82%|########2 | 2468/3000 [1:08:57<16:49,  1.90s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  82%|########2 | 2469/3000 [1:08:57<13:48,  1.56s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  82%|########2 | 2469/3000 [1:08:57<13:48,  1.56s/it, lr: 1.0e-04 loss: 3.963e-01]
a-cold-wall:  82%|########2 | 2469/3000 [1:09:00<13:48,  1.56s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  82%|########2 | 2469/3000 [1:09:00<13:48,  1.56s/it, lr: 1.0e-04 loss: 3.475e-01]
a-cold-wall:  82%|########2 | 2470/3000 [1:09:03<13:46,  1.56s/it, lr: 1.0e-04 loss: 2.242e-02]
a-cold-wall:  82%|########2 | 2470/3000 [1:09:03<13:46,  1.56s/it, lr: 1.0e-04 loss: 2.242e-02]
a-cold-wall:  82%|########2 | 2471/3000 [1:09:03<13:20,  1.51s/it, lr: 1.0e-04 loss: 2.242e-02]
a-cold-wall:  82%|########2 | 2471/3000 [1:09:03<13:20,  1.51s/it, lr: 1.0e-04 loss: 2.242e-02]
a-cold-wall:  82%|########2 | 2471/3000 [1:09:04<13:20,  1.51s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  82%|########2 | 2471/3000 [1:09:04<13:20,  1.51s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  82%|########2 | 2472/3000 [1:09:04<11:40,  1.33s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  82%|########2 | 2472/3000 [1:09:04<11:40,  1.33s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  82%|########2 | 2472/3000 [1:09:05<11:40,  1.33s/it, lr: 1.0e-04 loss: 1.162e-01]
a-cold-wall:  82%|########2 | 2472/3000 [1:09:05<11:40,  1.33s/it, lr: 1.0e-04 loss: 1.162e-01]
a-cold-wall:  82%|########2 | 2473/3000 [1:09:05<11:57,  1.36s/it, lr: 1.0e-04 loss: 1.162e-01]
a-cold-wall:  82%|########2 | 2473/3000 [1:09:05<11:57,  1.36s/it, lr: 1.0e-04 loss: 1.162e-01]
a-cold-wall:  82%|########2 | 2473/3000 [1:09:06<11:57,  1.36s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  82%|########2 | 2473/3000 [1:09:06<11:57,  1.36s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  82%|########2 | 2474/3000 [1:09:06<12:04,  1.38s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  82%|########2 | 2474/3000 [1:09:06<12:04,  1.38s/it, lr: 1.0e-04 loss: 3.645e-01]
a-cold-wall:  82%|########2 | 2474/3000 [1:09:07<12:04,  1.38s/it, lr: 1.0e-04 loss: 5.717e-01]
a-cold-wall:  82%|########2 | 2474/3000 [1:09:07<12:04,  1.38s/it, lr: 1.0e-04 loss: 5.717e-01]
a-cold-wall:  82%|########2 | 2475/3000 [1:09:07<10:31,  1.20s/it, lr: 1.0e-04 loss: 5.717e-01]
a-cold-wall:  82%|########2 | 2475/3000 [1:09:07<10:31,  1.20s/it, lr: 1.0e-04 loss: 5.717e-01]
a-cold-wall:  82%|########2 | 2475/3000 [1:09:09<10:31,  1.20s/it, lr: 1.0e-04 loss: 3.472e-01]
a-cold-wall:  82%|########2 | 2475/3000 [1:09:09<10:31,  1.20s/it, lr: 1.0e-04 loss: 3.472e-01]
a-cold-wall:  83%|########2 | 2476/3000 [1:09:09<11:06,  1.27s/it, lr: 1.0e-04 loss: 3.472e-01]
a-cold-wall:  83%|########2 | 2476/3000 [1:09:09<11:06,  1.27s/it, lr: 1.0e-04 loss: 3.472e-01]
a-cold-wall:  83%|########2 | 2476/3000 [1:09:09<11:06,  1.27s/it, lr: 1.0e-04 loss: 1.166e-01]
a-cold-wall:  83%|########2 | 2476/3000 [1:09:09<11:06,  1.27s/it, lr: 1.0e-04 loss: 1.166e-01]
a-cold-wall:  83%|########2 | 2477/3000 [1:09:09<09:48,  1.13s/it, lr: 1.0e-04 loss: 1.166e-01]
a-cold-wall:  83%|########2 | 2477/3000 [1:09:09<09:48,  1.13s/it, lr: 1.0e-04 loss: 1.166e-01]
a-cold-wall:  83%|########2 | 2477/3000 [1:09:12<09:48,  1.13s/it, lr: 1.0e-04 loss: 2.011e-01]
a-cold-wall:  83%|########2 | 2477/3000 [1:09:12<09:48,  1.13s/it, lr: 1.0e-04 loss: 2.011e-01]
a-cold-wall:  83%|########2 | 2478/3000 [1:09:12<14:17,  1.64s/it, lr: 1.0e-04 loss: 2.011e-01]
a-cold-wall:  83%|########2 | 2478/3000 [1:09:12<14:17,  1.64s/it, lr: 1.0e-04 loss: 2.011e-01]
a-cold-wall:  83%|########2 | 2478/3000 [1:09:13<14:17,  1.64s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  83%|########2 | 2478/3000 [1:09:13<14:17,  1.64s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  83%|########2 | 2479/3000 [1:09:13<11:54,  1.37s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  83%|########2 | 2479/3000 [1:09:13<11:54,  1.37s/it, lr: 1.0e-04 loss: 2.083e-01]
a-cold-wall:  83%|########2 | 2479/3000 [1:09:16<11:54,  1.37s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  83%|########2 | 2479/3000 [1:09:16<11:54,  1.37s/it, lr: 1.0e-04 loss: 1.781e-01]
a-cold-wall:  83%|########2 | 2480/3000 [1:09:17<11:53,  1.37s/it, lr: 1.0e-04 loss: 7.399e-02]
a-cold-wall:  83%|########2 | 2480/3000 [1:09:17<11:53,  1.37s/it, lr: 1.0e-04 loss: 7.399e-02]
a-cold-wall:  83%|########2 | 2481/3000 [1:09:17<09:17,  1.07s/it, lr: 1.0e-04 loss: 7.399e-02]
a-cold-wall:  83%|########2 | 2481/3000 [1:09:17<09:17,  1.07s/it, lr: 1.0e-04 loss: 7.399e-02]
a-cold-wall:  83%|########2 | 2481/3000 [1:09:18<09:17,  1.07s/it, lr: 1.0e-04 loss: 3.486e-01]
a-cold-wall:  83%|########2 | 2481/3000 [1:09:18<09:17,  1.07s/it, lr: 1.0e-04 loss: 3.486e-01]
a-cold-wall:  83%|########2 | 2482/3000 [1:09:18<08:34,  1.01it/s, lr: 1.0e-04 loss: 3.486e-01]
a-cold-wall:  83%|########2 | 2482/3000 [1:09:18<08:34,  1.01it/s, lr: 1.0e-04 loss: 3.486e-01]
a-cold-wall:  83%|########2 | 2482/3000 [1:09:20<08:34,  1.01it/s, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  83%|########2 | 2482/3000 [1:09:20<08:34,  1.01it/s, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  83%|########2 | 2483/3000 [1:09:20<09:52,  1.15s/it, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  83%|########2 | 2483/3000 [1:09:20<09:52,  1.15s/it, lr: 1.0e-04 loss: 6.258e-01]
a-cold-wall:  83%|########2 | 2483/3000 [1:09:22<09:52,  1.15s/it, lr: 1.0e-04 loss: 4.911e-01]
a-cold-wall:  83%|########2 | 2483/3000 [1:09:22<09:52,  1.15s/it, lr: 1.0e-04 loss: 4.911e-01]
a-cold-wall:  83%|########2 | 2484/3000 [1:09:23<13:48,  1.61s/it, lr: 1.0e-04 loss: 4.911e-01]
a-cold-wall:  83%|########2 | 2484/3000 [1:09:23<13:48,  1.61s/it, lr: 1.0e-04 loss: 4.911e-01]
a-cold-wall:  83%|########2 | 2484/3000 [1:09:23<13:48,  1.61s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  83%|########2 | 2484/3000 [1:09:23<13:48,  1.61s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  83%|########2 | 2485/3000 [1:09:23<11:42,  1.36s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  83%|########2 | 2485/3000 [1:09:23<11:42,  1.36s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  83%|########2 | 2485/3000 [1:09:24<11:42,  1.36s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  83%|########2 | 2485/3000 [1:09:24<11:42,  1.36s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  83%|########2 | 2486/3000 [1:09:24<10:08,  1.18s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  83%|########2 | 2486/3000 [1:09:24<10:08,  1.18s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  83%|########2 | 2486/3000 [1:09:25<10:08,  1.18s/it, lr: 1.0e-04 loss: 4.158e-01]
a-cold-wall:  83%|########2 | 2486/3000 [1:09:25<10:08,  1.18s/it, lr: 1.0e-04 loss: 4.158e-01]
a-cold-wall:  83%|########2 | 2487/3000 [1:09:25<09:02,  1.06s/it, lr: 1.0e-04 loss: 4.158e-01]
a-cold-wall:  83%|########2 | 2487/3000 [1:09:25<09:02,  1.06s/it, lr: 1.0e-04 loss: 4.158e-01]
a-cold-wall:  83%|########2 | 2487/3000 [1:09:28<09:02,  1.06s/it, lr: 1.0e-04 loss: 5.140e-01]
a-cold-wall:  83%|########2 | 2487/3000 [1:09:28<09:02,  1.06s/it, lr: 1.0e-04 loss: 5.140e-01]
a-cold-wall:  83%|########2 | 2488/3000 [1:09:28<13:39,  1.60s/it, lr: 1.0e-04 loss: 5.140e-01]
a-cold-wall:  83%|########2 | 2488/3000 [1:09:28<13:39,  1.60s/it, lr: 1.0e-04 loss: 5.140e-01]
a-cold-wall:  83%|########2 | 2488/3000 [1:09:30<13:39,  1.60s/it, lr: 1.0e-04 loss: 7.015e-02]
a-cold-wall:  83%|########2 | 2488/3000 [1:09:30<13:39,  1.60s/it, lr: 1.0e-04 loss: 7.015e-02]
a-cold-wall:  83%|########2 | 2489/3000 [1:09:30<16:47,  1.97s/it, lr: 1.0e-04 loss: 7.015e-02]
a-cold-wall:  83%|########2 | 2489/3000 [1:09:30<16:47,  1.97s/it, lr: 1.0e-04 loss: 7.015e-02]
a-cold-wall:  83%|########2 | 2489/3000 [1:09:32<16:47,  1.97s/it, lr: 1.0e-04 loss: 1.683e-02]
a-cold-wall:  83%|########2 | 2489/3000 [1:09:32<16:47,  1.97s/it, lr: 1.0e-04 loss: 1.683e-02]
a-cold-wall:  83%|########2 | 2490/3000 [1:09:35<16:45,  1.97s/it, lr: 1.0e-04 loss: 1.789e-01]
a-cold-wall:  83%|########2 | 2490/3000 [1:09:35<16:45,  1.97s/it, lr: 1.0e-04 loss: 1.789e-01]
a-cold-wall:  83%|########3 | 2491/3000 [1:09:35<14:34,  1.72s/it, lr: 1.0e-04 loss: 1.789e-01]
a-cold-wall:  83%|########3 | 2491/3000 [1:09:35<14:34,  1.72s/it, lr: 1.0e-04 loss: 1.789e-01]
a-cold-wall:  83%|########3 | 2491/3000 [1:09:38<14:34,  1.72s/it, lr: 1.0e-04 loss: 1.380e-01]
a-cold-wall:  83%|########3 | 2491/3000 [1:09:38<14:34,  1.72s/it, lr: 1.0e-04 loss: 1.380e-01]
a-cold-wall:  83%|########3 | 2492/3000 [1:09:38<16:55,  2.00s/it, lr: 1.0e-04 loss: 1.380e-01]
a-cold-wall:  83%|########3 | 2492/3000 [1:09:38<16:55,  2.00s/it, lr: 1.0e-04 loss: 1.380e-01]
a-cold-wall:  83%|########3 | 2492/3000 [1:09:39<16:55,  2.00s/it, lr: 1.0e-04 loss: 5.695e-02]
a-cold-wall:  83%|########3 | 2492/3000 [1:09:39<16:55,  2.00s/it, lr: 1.0e-04 loss: 5.695e-02]
a-cold-wall:  83%|########3 | 2493/3000 [1:09:39<15:37,  1.85s/it, lr: 1.0e-04 loss: 5.695e-02]
a-cold-wall:  83%|########3 | 2493/3000 [1:09:39<15:37,  1.85s/it, lr: 1.0e-04 loss: 5.695e-02]
a-cold-wall:  83%|########3 | 2493/3000 [1:09:40<15:37,  1.85s/it, lr: 1.0e-04 loss: 6.582e-01]
a-cold-wall:  83%|########3 | 2493/3000 [1:09:40<15:37,  1.85s/it, lr: 1.0e-04 loss: 6.582e-01]
a-cold-wall:  83%|########3 | 2494/3000 [1:09:40<14:35,  1.73s/it, lr: 1.0e-04 loss: 6.582e-01]
a-cold-wall:  83%|########3 | 2494/3000 [1:09:40<14:35,  1.73s/it, lr: 1.0e-04 loss: 6.582e-01]
a-cold-wall:  83%|########3 | 2494/3000 [1:09:42<14:35,  1.73s/it, lr: 1.0e-04 loss: 6.043e-01]
a-cold-wall:  83%|########3 | 2494/3000 [1:09:42<14:35,  1.73s/it, lr: 1.0e-04 loss: 6.043e-01]
a-cold-wall:  83%|########3 | 2495/3000 [1:09:42<13:49,  1.64s/it, lr: 1.0e-04 loss: 6.043e-01]
a-cold-wall:  83%|########3 | 2495/3000 [1:09:42<13:49,  1.64s/it, lr: 1.0e-04 loss: 6.043e-01]
a-cold-wall:  83%|########3 | 2495/3000 [1:09:43<13:49,  1.64s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:  83%|########3 | 2495/3000 [1:09:43<13:49,  1.64s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:  83%|########3 | 2496/3000 [1:09:43<13:12,  1.57s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:  83%|########3 | 2496/3000 [1:09:43<13:12,  1.57s/it, lr: 1.0e-04 loss: 5.688e-01]
a-cold-wall:  83%|########3 | 2496/3000 [1:09:46<13:12,  1.57s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:  83%|########3 | 2496/3000 [1:09:46<13:12,  1.57s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:  83%|########3 | 2497/3000 [1:09:46<16:13,  1.93s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:  83%|########3 | 2497/3000 [1:09:46<16:13,  1.93s/it, lr: 1.0e-04 loss: 4.222e-01]
a-cold-wall:  83%|########3 | 2497/3000 [1:09:48<16:13,  1.93s/it, lr: 1.0e-04 loss: 6.838e-01]
a-cold-wall:  83%|########3 | 2497/3000 [1:09:48<16:13,  1.93s/it, lr: 1.0e-04 loss: 6.838e-01]
a-cold-wall:  83%|########3 | 2498/3000 [1:09:48<15:21,  1.83s/it, lr: 1.0e-04 loss: 6.838e-01]
a-cold-wall:  83%|########3 | 2498/3000 [1:09:48<15:21,  1.83s/it, lr: 1.0e-04 loss: 6.838e-01]
a-cold-wall:  83%|########3 | 2498/3000 [1:09:49<15:21,  1.83s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  83%|########3 | 2498/3000 [1:09:49<15:21,  1.83s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  83%|########3 | 2499/3000 [1:09:49<14:14,  1.71s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  83%|########3 | 2499/3000 [1:09:49<14:14,  1.71s/it, lr: 1.0e-04 loss: 1.838e-01]
a-cold-wall:  83%|########3 | 2499/3000 [1:09:51<14:14,  1.71s/it, lr: 1.0e-04 loss: 4.187e-01]
a-cold-wall:  83%|########3 | 2499/3000 [1:09:51<14:14,  1.71s/it, lr: 1.0e-04 loss: 4.187e-01]
Saving at step 2500
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000002500.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000001500.safetensors
Unloading assistant lora



Generating Images: 0it [00:00, ?it/s]
Generating Images: 0it [00:00, ?it/s]


                                     
                                     Loading assistant lora

a-cold-wall:  83%|########3 | 2500/3000 [1:09:52<14:12,  1.71s/it, lr: 1.0e-04 loss: 7.466e-01]
a-cold-wall:  83%|########3 | 2500/3000 [1:09:52<14:12,  1.71s/it, lr: 1.0e-04 loss: 7.466e-01]
a-cold-wall:  83%|########3 | 2501/3000 [1:09:52<10:48,  1.30s/it, lr: 1.0e-04 loss: 7.466e-01]
a-cold-wall:  83%|########3 | 2501/3000 [1:09:52<10:48,  1.30s/it, lr: 1.0e-04 loss: 7.466e-01]
a-cold-wall:  83%|########3 | 2501/3000 [1:09:55<10:48,  1.30s/it, lr: 1.0e-04 loss: 9.277e-02]
a-cold-wall:  83%|########3 | 2501/3000 [1:09:55<10:48,  1.30s/it, lr: 1.0e-04 loss: 9.277e-02]
a-cold-wall:  83%|########3 | 2502/3000 [1:09:55<13:56,  1.68s/it, lr: 1.0e-04 loss: 9.277e-02]
a-cold-wall:  83%|########3 | 2502/3000 [1:09:55<13:56,  1.68s/it, lr: 1.0e-04 loss: 9.277e-02]
a-cold-wall:  83%|########3 | 2502/3000 [1:09:56<13:56,  1.68s/it, lr: 1.0e-04 loss: 2.567e-01]
a-cold-wall:  83%|########3 | 2502/3000 [1:09:56<13:56,  1.68s/it, lr: 1.0e-04 loss: 2.567e-01]
a-cold-wall:  83%|########3 | 2503/3000 [1:09:56<11:54,  1.44s/it, lr: 1.0e-04 loss: 2.567e-01]
a-cold-wall:  83%|########3 | 2503/3000 [1:09:56<11:54,  1.44s/it, lr: 1.0e-04 loss: 2.567e-01]
a-cold-wall:  83%|########3 | 2503/3000 [1:09:59<11:54,  1.44s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  83%|########3 | 2503/3000 [1:09:59<11:54,  1.44s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  83%|########3 | 2504/3000 [1:09:59<15:04,  1.82s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  83%|########3 | 2504/3000 [1:09:59<15:04,  1.82s/it, lr: 1.0e-04 loss: 4.876e-01]
a-cold-wall:  83%|########3 | 2504/3000 [1:10:01<15:04,  1.82s/it, lr: 1.0e-04 loss: 6.222e-01]
a-cold-wall:  83%|########3 | 2504/3000 [1:10:01<15:04,  1.82s/it, lr: 1.0e-04 loss: 6.222e-01]
a-cold-wall:  84%|########3 | 2505/3000 [1:10:01<17:19,  2.10s/it, lr: 1.0e-04 loss: 6.222e-01]
a-cold-wall:  84%|########3 | 2505/3000 [1:10:01<17:19,  2.10s/it, lr: 1.0e-04 loss: 6.222e-01]
a-cold-wall:  84%|########3 | 2505/3000 [1:10:04<17:19,  2.10s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  84%|########3 | 2505/3000 [1:10:04<17:19,  2.10s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  84%|########3 | 2506/3000 [1:10:04<19:04,  2.32s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  84%|########3 | 2506/3000 [1:10:04<19:04,  2.32s/it, lr: 1.0e-04 loss: 6.405e-01]
a-cold-wall:  84%|########3 | 2506/3000 [1:10:07<19:04,  2.32s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  84%|########3 | 2506/3000 [1:10:07<19:04,  2.32s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  84%|########3 | 2507/3000 [1:10:07<20:17,  2.47s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  84%|########3 | 2507/3000 [1:10:07<20:17,  2.47s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  84%|########3 | 2507/3000 [1:10:10<20:17,  2.47s/it, lr: 1.0e-04 loss: 1.990e-01]
a-cold-wall:  84%|########3 | 2507/3000 [1:10:10<20:17,  2.47s/it, lr: 1.0e-04 loss: 1.990e-01]
a-cold-wall:  84%|########3 | 2508/3000 [1:10:10<21:04,  2.57s/it, lr: 1.0e-04 loss: 1.990e-01]
a-cold-wall:  84%|########3 | 2508/3000 [1:10:10<21:04,  2.57s/it, lr: 1.0e-04 loss: 1.990e-01]
a-cold-wall:  84%|########3 | 2508/3000 [1:10:13<21:04,  2.57s/it, lr: 1.0e-04 loss: 1.377e-01]
a-cold-wall:  84%|########3 | 2508/3000 [1:10:13<21:04,  2.57s/it, lr: 1.0e-04 loss: 1.377e-01]
a-cold-wall:  84%|########3 | 2509/3000 [1:10:13<21:36,  2.64s/it, lr: 1.0e-04 loss: 1.377e-01]
a-cold-wall:  84%|########3 | 2509/3000 [1:10:13<21:36,  2.64s/it, lr: 1.0e-04 loss: 1.377e-01]
a-cold-wall:  84%|########3 | 2509/3000 [1:10:14<21:36,  2.64s/it, lr: 1.0e-04 loss: 2.155e-01]
a-cold-wall:  84%|########3 | 2509/3000 [1:10:14<21:36,  2.64s/it, lr: 1.0e-04 loss: 2.155e-01]
a-cold-wall:  84%|########3 | 2510/3000 [1:10:16<21:33,  2.64s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  84%|########3 | 2510/3000 [1:10:16<21:33,  2.64s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  84%|########3 | 2511/3000 [1:10:16<16:54,  2.08s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  84%|########3 | 2511/3000 [1:10:16<16:54,  2.08s/it, lr: 1.0e-04 loss: 6.564e-01]
a-cold-wall:  84%|########3 | 2511/3000 [1:10:18<16:54,  2.08s/it, lr: 1.0e-04 loss: 7.212e-01]
a-cold-wall:  84%|########3 | 2511/3000 [1:10:18<16:54,  2.08s/it, lr: 1.0e-04 loss: 7.212e-01]
a-cold-wall:  84%|########3 | 2512/3000 [1:10:18<15:31,  1.91s/it, lr: 1.0e-04 loss: 7.212e-01]
a-cold-wall:  84%|########3 | 2512/3000 [1:10:18<15:31,  1.91s/it, lr: 1.0e-04 loss: 7.212e-01]
a-cold-wall:  84%|########3 | 2512/3000 [1:10:19<15:31,  1.91s/it, lr: 1.0e-04 loss: 6.358e-01]
a-cold-wall:  84%|########3 | 2512/3000 [1:10:19<15:31,  1.91s/it, lr: 1.0e-04 loss: 6.358e-01]
a-cold-wall:  84%|########3 | 2513/3000 [1:10:19<14:47,  1.82s/it, lr: 1.0e-04 loss: 6.358e-01]
a-cold-wall:  84%|########3 | 2513/3000 [1:10:19<14:47,  1.82s/it, lr: 1.0e-04 loss: 6.358e-01]
a-cold-wall:  84%|########3 | 2513/3000 [1:10:22<14:47,  1.82s/it, lr: 1.0e-04 loss: 1.507e-01]
a-cold-wall:  84%|########3 | 2513/3000 [1:10:22<14:47,  1.82s/it, lr: 1.0e-04 loss: 1.507e-01]
a-cold-wall:  84%|########3 | 2514/3000 [1:10:22<17:00,  2.10s/it, lr: 1.0e-04 loss: 1.507e-01]
a-cold-wall:  84%|########3 | 2514/3000 [1:10:22<17:00,  2.10s/it, lr: 1.0e-04 loss: 1.507e-01]
a-cold-wall:  84%|########3 | 2514/3000 [1:10:23<17:00,  2.10s/it, lr: 1.0e-04 loss: 6.136e-02]
a-cold-wall:  84%|########3 | 2514/3000 [1:10:23<17:00,  2.10s/it, lr: 1.0e-04 loss: 6.136e-02]
a-cold-wall:  84%|########3 | 2515/3000 [1:10:23<13:55,  1.72s/it, lr: 1.0e-04 loss: 6.136e-02]
a-cold-wall:  84%|########3 | 2515/3000 [1:10:23<13:55,  1.72s/it, lr: 1.0e-04 loss: 6.136e-02]
a-cold-wall:  84%|########3 | 2515/3000 [1:10:24<13:55,  1.72s/it, lr: 1.0e-04 loss: 1.925e-02]
a-cold-wall:  84%|########3 | 2515/3000 [1:10:24<13:55,  1.72s/it, lr: 1.0e-04 loss: 1.925e-02]
a-cold-wall:  84%|########3 | 2516/3000 [1:10:24<12:07,  1.50s/it, lr: 1.0e-04 loss: 1.925e-02]
a-cold-wall:  84%|########3 | 2516/3000 [1:10:24<12:07,  1.50s/it, lr: 1.0e-04 loss: 1.925e-02]
a-cold-wall:  84%|########3 | 2516/3000 [1:10:25<12:07,  1.50s/it, lr: 1.0e-04 loss: 1.981e-01]
a-cold-wall:  84%|########3 | 2516/3000 [1:10:25<12:07,  1.50s/it, lr: 1.0e-04 loss: 1.981e-01]
a-cold-wall:  84%|########3 | 2517/3000 [1:10:25<10:49,  1.34s/it, lr: 1.0e-04 loss: 1.981e-01]
a-cold-wall:  84%|########3 | 2517/3000 [1:10:25<10:49,  1.34s/it, lr: 1.0e-04 loss: 1.981e-01]
a-cold-wall:  84%|########3 | 2517/3000 [1:10:28<10:49,  1.34s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  84%|########3 | 2517/3000 [1:10:28<10:49,  1.34s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  84%|########3 | 2518/3000 [1:10:28<14:13,  1.77s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  84%|########3 | 2518/3000 [1:10:28<14:13,  1.77s/it, lr: 1.0e-04 loss: 5.896e-01]
a-cold-wall:  84%|########3 | 2518/3000 [1:10:28<14:13,  1.77s/it, lr: 1.0e-04 loss: 4.797e-01]
a-cold-wall:  84%|########3 | 2518/3000 [1:10:28<14:13,  1.77s/it, lr: 1.0e-04 loss: 4.797e-01]
a-cold-wall:  84%|########3 | 2519/3000 [1:10:28<11:57,  1.49s/it, lr: 1.0e-04 loss: 4.797e-01]
a-cold-wall:  84%|########3 | 2519/3000 [1:10:28<11:57,  1.49s/it, lr: 1.0e-04 loss: 4.797e-01]
a-cold-wall:  84%|########3 | 2519/3000 [1:10:30<11:57,  1.49s/it, lr: 1.0e-04 loss: 5.028e-01]
a-cold-wall:  84%|########3 | 2519/3000 [1:10:30<11:57,  1.49s/it, lr: 1.0e-04 loss: 5.028e-01]
a-cold-wall:  84%|########4 | 2520/3000 [1:10:33<11:56,  1.49s/it, lr: 1.0e-04 loss: 5.597e-01]
a-cold-wall:  84%|########4 | 2520/3000 [1:10:33<11:56,  1.49s/it, lr: 1.0e-04 loss: 5.597e-01]
a-cold-wall:  84%|########4 | 2521/3000 [1:10:33<11:36,  1.45s/it, lr: 1.0e-04 loss: 5.597e-01]
a-cold-wall:  84%|########4 | 2521/3000 [1:10:33<11:36,  1.45s/it, lr: 1.0e-04 loss: 5.597e-01]
a-cold-wall:  84%|########4 | 2521/3000 [1:10:34<11:36,  1.45s/it, lr: 1.0e-04 loss: 4.442e-02]
a-cold-wall:  84%|########4 | 2521/3000 [1:10:34<11:36,  1.45s/it, lr: 1.0e-04 loss: 4.442e-02]
a-cold-wall:  84%|########4 | 2522/3000 [1:10:34<10:12,  1.28s/it, lr: 1.0e-04 loss: 4.442e-02]
a-cold-wall:  84%|########4 | 2522/3000 [1:10:34<10:12,  1.28s/it, lr: 1.0e-04 loss: 4.442e-02]
a-cold-wall:  84%|########4 | 2522/3000 [1:10:35<10:12,  1.28s/it, lr: 1.0e-04 loss: 8.072e-02]
a-cold-wall:  84%|########4 | 2522/3000 [1:10:35<10:12,  1.28s/it, lr: 1.0e-04 loss: 8.072e-02]
a-cold-wall:  84%|########4 | 2523/3000 [1:10:35<10:26,  1.31s/it, lr: 1.0e-04 loss: 8.072e-02]
a-cold-wall:  84%|########4 | 2523/3000 [1:10:35<10:26,  1.31s/it, lr: 1.0e-04 loss: 8.072e-02]
a-cold-wall:  84%|########4 | 2523/3000 [1:10:38<10:26,  1.31s/it, lr: 1.0e-04 loss: 3.117e-01]
a-cold-wall:  84%|########4 | 2523/3000 [1:10:38<10:26,  1.31s/it, lr: 1.0e-04 loss: 3.117e-01]
a-cold-wall:  84%|########4 | 2524/3000 [1:10:38<13:39,  1.72s/it, lr: 1.0e-04 loss: 3.117e-01]
a-cold-wall:  84%|########4 | 2524/3000 [1:10:38<13:39,  1.72s/it, lr: 1.0e-04 loss: 3.117e-01]
a-cold-wall:  84%|########4 | 2524/3000 [1:10:39<13:39,  1.72s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  84%|########4 | 2524/3000 [1:10:39<13:39,  1.72s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  84%|########4 | 2525/3000 [1:10:39<11:27,  1.45s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  84%|########4 | 2525/3000 [1:10:39<11:27,  1.45s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  84%|########4 | 2525/3000 [1:10:40<11:27,  1.45s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  84%|########4 | 2525/3000 [1:10:40<11:27,  1.45s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  84%|########4 | 2526/3000 [1:10:40<09:53,  1.25s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  84%|########4 | 2526/3000 [1:10:40<09:53,  1.25s/it, lr: 1.0e-04 loss: 6.022e-01]
a-cold-wall:  84%|########4 | 2526/3000 [1:10:43<09:53,  1.25s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  84%|########4 | 2526/3000 [1:10:43<09:53,  1.25s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  84%|########4 | 2527/3000 [1:10:43<13:31,  1.72s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  84%|########4 | 2527/3000 [1:10:43<13:31,  1.72s/it, lr: 1.0e-04 loss: 6.326e-01]
a-cold-wall:  84%|########4 | 2527/3000 [1:10:46<13:31,  1.72s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  84%|########4 | 2527/3000 [1:10:46<13:31,  1.72s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  84%|########4 | 2528/3000 [1:10:46<16:31,  2.10s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  84%|########4 | 2528/3000 [1:10:46<16:31,  2.10s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  84%|########4 | 2528/3000 [1:10:46<16:31,  2.10s/it, lr: 1.0e-04 loss: 5.599e-01]
a-cold-wall:  84%|########4 | 2528/3000 [1:10:46<16:31,  2.10s/it, lr: 1.0e-04 loss: 5.599e-01]
a-cold-wall:  84%|########4 | 2529/3000 [1:10:46<13:22,  1.70s/it, lr: 1.0e-04 loss: 5.599e-01]
a-cold-wall:  84%|########4 | 2529/3000 [1:10:46<13:22,  1.70s/it, lr: 1.0e-04 loss: 5.599e-01]
a-cold-wall:  84%|########4 | 2529/3000 [1:10:47<13:22,  1.70s/it, lr: 1.0e-04 loss: 3.088e-01]
a-cold-wall:  84%|########4 | 2529/3000 [1:10:47<13:22,  1.70s/it, lr: 1.0e-04 loss: 3.088e-01]
a-cold-wall:  84%|########4 | 2530/3000 [1:10:50<13:21,  1.70s/it, lr: 1.0e-04 loss: 1.619e-01]
a-cold-wall:  84%|########4 | 2530/3000 [1:10:50<13:21,  1.70s/it, lr: 1.0e-04 loss: 1.619e-01]
a-cold-wall:  84%|########4 | 2531/3000 [1:10:50<12:26,  1.59s/it, lr: 1.0e-04 loss: 1.619e-01]
a-cold-wall:  84%|########4 | 2531/3000 [1:10:50<12:26,  1.59s/it, lr: 1.0e-04 loss: 1.619e-01]
a-cold-wall:  84%|########4 | 2531/3000 [1:10:51<12:26,  1.59s/it, lr: 1.0e-04 loss: 2.043e-01]
a-cold-wall:  84%|########4 | 2531/3000 [1:10:51<12:26,  1.59s/it, lr: 1.0e-04 loss: 2.043e-01]
a-cold-wall:  84%|########4 | 2532/3000 [1:10:51<12:04,  1.55s/it, lr: 1.0e-04 loss: 2.043e-01]
a-cold-wall:  84%|########4 | 2532/3000 [1:10:51<12:04,  1.55s/it, lr: 1.0e-04 loss: 2.043e-01]
a-cold-wall:  84%|########4 | 2532/3000 [1:10:53<12:04,  1.55s/it, lr: 1.0e-04 loss: 3.077e-01]
a-cold-wall:  84%|########4 | 2532/3000 [1:10:53<12:04,  1.55s/it, lr: 1.0e-04 loss: 3.077e-01]
a-cold-wall:  84%|########4 | 2533/3000 [1:10:53<11:45,  1.51s/it, lr: 1.0e-04 loss: 3.077e-01]
a-cold-wall:  84%|########4 | 2533/3000 [1:10:53<11:45,  1.51s/it, lr: 1.0e-04 loss: 3.077e-01]
a-cold-wall:  84%|########4 | 2533/3000 [1:10:54<11:45,  1.51s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  84%|########4 | 2533/3000 [1:10:54<11:45,  1.51s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  84%|########4 | 2534/3000 [1:10:54<10:08,  1.30s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  84%|########4 | 2534/3000 [1:10:54<10:08,  1.30s/it, lr: 1.0e-04 loss: 1.488e-01]
a-cold-wall:  84%|########4 | 2534/3000 [1:10:54<10:08,  1.30s/it, lr: 1.0e-04 loss: 7.800e-01]
a-cold-wall:  84%|########4 | 2534/3000 [1:10:54<10:08,  1.30s/it, lr: 1.0e-04 loss: 7.800e-01]
a-cold-wall:  84%|########4 | 2535/3000 [1:10:54<08:55,  1.15s/it, lr: 1.0e-04 loss: 7.800e-01]
a-cold-wall:  84%|########4 | 2535/3000 [1:10:54<08:55,  1.15s/it, lr: 1.0e-04 loss: 7.800e-01]
a-cold-wall:  84%|########4 | 2535/3000 [1:10:55<08:55,  1.15s/it, lr: 1.0e-04 loss: 5.346e-01]
a-cold-wall:  84%|########4 | 2535/3000 [1:10:55<08:55,  1.15s/it, lr: 1.0e-04 loss: 5.346e-01]
a-cold-wall:  85%|########4 | 2536/3000 [1:10:55<07:59,  1.03s/it, lr: 1.0e-04 loss: 5.346e-01]
a-cold-wall:  85%|########4 | 2536/3000 [1:10:55<07:59,  1.03s/it, lr: 1.0e-04 loss: 5.346e-01]
a-cold-wall:  85%|########4 | 2536/3000 [1:10:58<07:59,  1.03s/it, lr: 1.0e-04 loss: 8.912e-02]
a-cold-wall:  85%|########4 | 2536/3000 [1:10:58<07:59,  1.03s/it, lr: 1.0e-04 loss: 8.912e-02]
a-cold-wall:  85%|########4 | 2537/3000 [1:10:58<11:59,  1.55s/it, lr: 1.0e-04 loss: 8.912e-02]
a-cold-wall:  85%|########4 | 2537/3000 [1:10:58<11:59,  1.55s/it, lr: 1.0e-04 loss: 8.912e-02]
a-cold-wall:  85%|########4 | 2537/3000 [1:10:59<11:59,  1.55s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  85%|########4 | 2537/3000 [1:10:59<11:59,  1.55s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  85%|########4 | 2538/3000 [1:10:59<11:38,  1.51s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  85%|########4 | 2538/3000 [1:10:59<11:38,  1.51s/it, lr: 1.0e-04 loss: 1.544e-01]
a-cold-wall:  85%|########4 | 2538/3000 [1:11:02<11:38,  1.51s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  85%|########4 | 2538/3000 [1:11:02<11:38,  1.51s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  85%|########4 | 2539/3000 [1:11:02<14:35,  1.90s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  85%|########4 | 2539/3000 [1:11:02<14:35,  1.90s/it, lr: 1.0e-04 loss: 7.380e-01]
a-cold-wall:  85%|########4 | 2539/3000 [1:11:04<14:35,  1.90s/it, lr: 1.0e-04 loss: 5.846e-01]
a-cold-wall:  85%|########4 | 2539/3000 [1:11:04<14:35,  1.90s/it, lr: 1.0e-04 loss: 5.846e-01]
a-cold-wall:  85%|########4 | 2540/3000 [1:11:06<14:33,  1.90s/it, lr: 1.0e-04 loss: 3.912e-01]
a-cold-wall:  85%|########4 | 2540/3000 [1:11:06<14:33,  1.90s/it, lr: 1.0e-04 loss: 3.912e-01]
a-cold-wall:  85%|########4 | 2541/3000 [1:11:06<12:50,  1.68s/it, lr: 1.0e-04 loss: 3.912e-01]
a-cold-wall:  85%|########4 | 2541/3000 [1:11:06<12:50,  1.68s/it, lr: 1.0e-04 loss: 3.912e-01]
a-cold-wall:  85%|########4 | 2541/3000 [1:11:07<12:50,  1.68s/it, lr: 1.0e-04 loss: 5.856e-01]
a-cold-wall:  85%|########4 | 2541/3000 [1:11:07<12:50,  1.68s/it, lr: 1.0e-04 loss: 5.856e-01]
a-cold-wall:  85%|########4 | 2542/3000 [1:11:07<11:31,  1.51s/it, lr: 1.0e-04 loss: 5.856e-01]
a-cold-wall:  85%|########4 | 2542/3000 [1:11:07<11:31,  1.51s/it, lr: 1.0e-04 loss: 5.856e-01]
a-cold-wall:  85%|########4 | 2542/3000 [1:11:08<11:31,  1.51s/it, lr: 1.0e-04 loss: 2.925e-02]
a-cold-wall:  85%|########4 | 2542/3000 [1:11:08<11:31,  1.51s/it, lr: 1.0e-04 loss: 2.925e-02]
a-cold-wall:  85%|########4 | 2543/3000 [1:11:08<09:59,  1.31s/it, lr: 1.0e-04 loss: 2.925e-02]
a-cold-wall:  85%|########4 | 2543/3000 [1:11:08<09:59,  1.31s/it, lr: 1.0e-04 loss: 2.925e-02]
a-cold-wall:  85%|########4 | 2543/3000 [1:11:09<09:59,  1.31s/it, lr: 1.0e-04 loss: 4.132e-01]
a-cold-wall:  85%|########4 | 2543/3000 [1:11:09<09:59,  1.31s/it, lr: 1.0e-04 loss: 4.132e-01]
a-cold-wall:  85%|########4 | 2544/3000 [1:11:09<08:48,  1.16s/it, lr: 1.0e-04 loss: 4.132e-01]
a-cold-wall:  85%|########4 | 2544/3000 [1:11:09<08:48,  1.16s/it, lr: 1.0e-04 loss: 4.132e-01]
a-cold-wall:  85%|########4 | 2544/3000 [1:11:10<08:48,  1.16s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:  85%|########4 | 2544/3000 [1:11:10<08:48,  1.16s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:  85%|########4 | 2545/3000 [1:11:10<07:55,  1.04s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:  85%|########4 | 2545/3000 [1:11:10<07:55,  1.04s/it, lr: 1.0e-04 loss: 6.555e-01]
a-cold-wall:  85%|########4 | 2545/3000 [1:11:10<07:55,  1.04s/it, lr: 1.0e-04 loss: 1.934e-01]
a-cold-wall:  85%|########4 | 2545/3000 [1:11:10<07:55,  1.04s/it, lr: 1.0e-04 loss: 1.934e-01]
a-cold-wall:  85%|########4 | 2546/3000 [1:11:10<07:15,  1.04it/s, lr: 1.0e-04 loss: 1.934e-01]
a-cold-wall:  85%|########4 | 2546/3000 [1:11:10<07:15,  1.04it/s, lr: 1.0e-04 loss: 1.934e-01]
a-cold-wall:  85%|########4 | 2546/3000 [1:11:13<07:15,  1.04it/s, lr: 1.0e-04 loss: 3.584e-01]
a-cold-wall:  85%|########4 | 2546/3000 [1:11:13<07:15,  1.04it/s, lr: 1.0e-04 loss: 3.584e-01]
a-cold-wall:  85%|########4 | 2547/3000 [1:11:13<11:24,  1.51s/it, lr: 1.0e-04 loss: 3.584e-01]
a-cold-wall:  85%|########4 | 2547/3000 [1:11:13<11:24,  1.51s/it, lr: 1.0e-04 loss: 3.584e-01]
a-cold-wall:  85%|########4 | 2547/3000 [1:11:14<11:24,  1.51s/it, lr: 1.0e-04 loss: 3.405e-01]
a-cold-wall:  85%|########4 | 2547/3000 [1:11:14<11:24,  1.51s/it, lr: 1.0e-04 loss: 3.405e-01]
a-cold-wall:  85%|########4 | 2548/3000 [1:11:14<09:42,  1.29s/it, lr: 1.0e-04 loss: 3.405e-01]
a-cold-wall:  85%|########4 | 2548/3000 [1:11:14<09:42,  1.29s/it, lr: 1.0e-04 loss: 3.405e-01]
a-cold-wall:  85%|########4 | 2548/3000 [1:11:17<09:42,  1.29s/it, lr: 1.0e-04 loss: 4.337e-01]
a-cold-wall:  85%|########4 | 2548/3000 [1:11:17<09:42,  1.29s/it, lr: 1.0e-04 loss: 4.337e-01]
a-cold-wall:  85%|########4 | 2549/3000 [1:11:17<13:06,  1.74s/it, lr: 1.0e-04 loss: 4.337e-01]
a-cold-wall:  85%|########4 | 2549/3000 [1:11:17<13:06,  1.74s/it, lr: 1.0e-04 loss: 4.337e-01]
a-cold-wall:  85%|########4 | 2549/3000 [1:11:20<13:06,  1.74s/it, lr: 1.0e-04 loss: 4.136e-01]
a-cold-wall:  85%|########4 | 2549/3000 [1:11:20<13:06,  1.74s/it, lr: 1.0e-04 loss: 4.136e-01]
a-cold-wall:  85%|########5 | 2550/3000 [1:11:21<13:04,  1.74s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  85%|########5 | 2550/3000 [1:11:21<13:04,  1.74s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  85%|########5 | 2551/3000 [1:11:21<09:42,  1.30s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  85%|########5 | 2551/3000 [1:11:21<09:42,  1.30s/it, lr: 1.0e-04 loss: 2.782e-01]
a-cold-wall:  85%|########5 | 2551/3000 [1:11:22<09:42,  1.30s/it, lr: 1.0e-04 loss: 5.210e-01]
a-cold-wall:  85%|########5 | 2551/3000 [1:11:22<09:42,  1.30s/it, lr: 1.0e-04 loss: 5.210e-01]
a-cold-wall:  85%|########5 | 2552/3000 [1:11:22<08:40,  1.16s/it, lr: 1.0e-04 loss: 5.210e-01]
a-cold-wall:  85%|########5 | 2552/3000 [1:11:22<08:40,  1.16s/it, lr: 1.0e-04 loss: 5.210e-01]
a-cold-wall:  85%|########5 | 2552/3000 [1:11:23<08:40,  1.16s/it, lr: 1.0e-04 loss: 6.955e-01]
a-cold-wall:  85%|########5 | 2552/3000 [1:11:23<08:40,  1.16s/it, lr: 1.0e-04 loss: 6.955e-01]
a-cold-wall:  85%|########5 | 2553/3000 [1:11:23<07:51,  1.05s/it, lr: 1.0e-04 loss: 6.955e-01]
a-cold-wall:  85%|########5 | 2553/3000 [1:11:23<07:51,  1.05s/it, lr: 1.0e-04 loss: 6.955e-01]
a-cold-wall:  85%|########5 | 2553/3000 [1:11:24<07:51,  1.05s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  85%|########5 | 2553/3000 [1:11:24<07:51,  1.05s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  85%|########5 | 2554/3000 [1:11:24<08:35,  1.16s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  85%|########5 | 2554/3000 [1:11:24<08:35,  1.16s/it, lr: 1.0e-04 loss: 1.065e-01]
a-cold-wall:  85%|########5 | 2554/3000 [1:11:26<08:35,  1.16s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  85%|########5 | 2554/3000 [1:11:26<08:35,  1.16s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  85%|########5 | 2555/3000 [1:11:26<09:36,  1.30s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  85%|########5 | 2555/3000 [1:11:26<09:36,  1.30s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  85%|########5 | 2555/3000 [1:11:27<09:36,  1.30s/it, lr: 1.0e-04 loss: 1.881e-01]
a-cold-wall:  85%|########5 | 2555/3000 [1:11:27<09:36,  1.30s/it, lr: 1.0e-04 loss: 1.881e-01]
a-cold-wall:  85%|########5 | 2556/3000 [1:11:27<08:26,  1.14s/it, lr: 1.0e-04 loss: 1.881e-01]
a-cold-wall:  85%|########5 | 2556/3000 [1:11:27<08:26,  1.14s/it, lr: 1.0e-04 loss: 1.881e-01]
a-cold-wall:  85%|########5 | 2556/3000 [1:11:28<08:26,  1.14s/it, lr: 1.0e-04 loss: 6.461e-01]
a-cold-wall:  85%|########5 | 2556/3000 [1:11:28<08:26,  1.14s/it, lr: 1.0e-04 loss: 6.461e-01]
a-cold-wall:  85%|########5 | 2557/3000 [1:11:28<09:06,  1.23s/it, lr: 1.0e-04 loss: 6.461e-01]
a-cold-wall:  85%|########5 | 2557/3000 [1:11:28<09:06,  1.23s/it, lr: 1.0e-04 loss: 6.461e-01]
a-cold-wall:  85%|########5 | 2557/3000 [1:11:29<09:06,  1.23s/it, lr: 1.0e-04 loss: 1.523e-01]
a-cold-wall:  85%|########5 | 2557/3000 [1:11:29<09:06,  1.23s/it, lr: 1.0e-04 loss: 1.523e-01]
a-cold-wall:  85%|########5 | 2558/3000 [1:11:29<08:03,  1.09s/it, lr: 1.0e-04 loss: 1.523e-01]
a-cold-wall:  85%|########5 | 2558/3000 [1:11:29<08:03,  1.09s/it, lr: 1.0e-04 loss: 1.523e-01]
a-cold-wall:  85%|########5 | 2558/3000 [1:11:30<08:03,  1.09s/it, lr: 1.0e-04 loss: 3.717e-01]
a-cold-wall:  85%|########5 | 2558/3000 [1:11:30<08:03,  1.09s/it, lr: 1.0e-04 loss: 3.717e-01]
a-cold-wall:  85%|########5 | 2559/3000 [1:11:30<08:45,  1.19s/it, lr: 1.0e-04 loss: 3.717e-01]
a-cold-wall:  85%|########5 | 2559/3000 [1:11:30<08:45,  1.19s/it, lr: 1.0e-04 loss: 3.717e-01]
a-cold-wall:  85%|########5 | 2559/3000 [1:11:32<08:45,  1.19s/it, lr: 1.0e-04 loss: 3.631e-01]
a-cold-wall:  85%|########5 | 2559/3000 [1:11:32<08:45,  1.19s/it, lr: 1.0e-04 loss: 3.631e-01]
a-cold-wall:  85%|########5 | 2560/3000 [1:11:35<08:44,  1.19s/it, lr: 1.0e-04 loss: 3.208e-01]
a-cold-wall:  85%|########5 | 2560/3000 [1:11:35<08:44,  1.19s/it, lr: 1.0e-04 loss: 3.208e-01]
a-cold-wall:  85%|########5 | 2561/3000 [1:11:35<09:34,  1.31s/it, lr: 1.0e-04 loss: 3.208e-01]
a-cold-wall:  85%|########5 | 2561/3000 [1:11:35<09:34,  1.31s/it, lr: 1.0e-04 loss: 3.208e-01]
a-cold-wall:  85%|########5 | 2561/3000 [1:11:36<09:34,  1.31s/it, lr: 1.0e-04 loss: 4.869e-01]
a-cold-wall:  85%|########5 | 2561/3000 [1:11:36<09:34,  1.31s/it, lr: 1.0e-04 loss: 4.869e-01]
a-cold-wall:  85%|########5 | 2562/3000 [1:11:36<09:45,  1.34s/it, lr: 1.0e-04 loss: 4.869e-01]
a-cold-wall:  85%|########5 | 2562/3000 [1:11:36<09:45,  1.34s/it, lr: 1.0e-04 loss: 4.869e-01]
a-cold-wall:  85%|########5 | 2562/3000 [1:11:37<09:45,  1.34s/it, lr: 1.0e-04 loss: 2.586e-01]
a-cold-wall:  85%|########5 | 2562/3000 [1:11:37<09:45,  1.34s/it, lr: 1.0e-04 loss: 2.586e-01]
a-cold-wall:  85%|########5 | 2563/3000 [1:11:37<09:54,  1.36s/it, lr: 1.0e-04 loss: 2.586e-01]
a-cold-wall:  85%|########5 | 2563/3000 [1:11:37<09:54,  1.36s/it, lr: 1.0e-04 loss: 2.586e-01]
a-cold-wall:  85%|########5 | 2563/3000 [1:11:39<09:54,  1.36s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  85%|########5 | 2563/3000 [1:11:39<09:54,  1.36s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  85%|########5 | 2564/3000 [1:11:39<10:04,  1.39s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  85%|########5 | 2564/3000 [1:11:39<10:04,  1.39s/it, lr: 1.0e-04 loss: 5.103e-01]
a-cold-wall:  85%|########5 | 2564/3000 [1:11:42<10:04,  1.39s/it, lr: 1.0e-04 loss: 7.583e-01]
a-cold-wall:  85%|########5 | 2564/3000 [1:11:42<10:04,  1.39s/it, lr: 1.0e-04 loss: 7.583e-01]
a-cold-wall:  86%|########5 | 2565/3000 [1:11:42<13:06,  1.81s/it, lr: 1.0e-04 loss: 7.583e-01]
a-cold-wall:  86%|########5 | 2565/3000 [1:11:42<13:06,  1.81s/it, lr: 1.0e-04 loss: 7.583e-01]
a-cold-wall:  86%|########5 | 2565/3000 [1:11:43<13:06,  1.81s/it, lr: 1.0e-04 loss: 5.430e-01]
a-cold-wall:  86%|########5 | 2565/3000 [1:11:43<13:06,  1.81s/it, lr: 1.0e-04 loss: 5.430e-01]
a-cold-wall:  86%|########5 | 2566/3000 [1:11:43<10:55,  1.51s/it, lr: 1.0e-04 loss: 5.430e-01]
a-cold-wall:  86%|########5 | 2566/3000 [1:11:43<10:55,  1.51s/it, lr: 1.0e-04 loss: 5.430e-01]
a-cold-wall:  86%|########5 | 2566/3000 [1:11:45<10:55,  1.51s/it, lr: 1.0e-04 loss: 2.457e-01]
a-cold-wall:  86%|########5 | 2566/3000 [1:11:45<10:55,  1.51s/it, lr: 1.0e-04 loss: 2.457e-01]
a-cold-wall:  86%|########5 | 2567/3000 [1:11:45<13:44,  1.90s/it, lr: 1.0e-04 loss: 2.457e-01]
a-cold-wall:  86%|########5 | 2567/3000 [1:11:45<13:44,  1.90s/it, lr: 1.0e-04 loss: 2.457e-01]
a-cold-wall:  86%|########5 | 2567/3000 [1:11:47<13:44,  1.90s/it, lr: 1.0e-04 loss: 2.494e-01]
a-cold-wall:  86%|########5 | 2567/3000 [1:11:47<13:44,  1.90s/it, lr: 1.0e-04 loss: 2.494e-01]
a-cold-wall:  86%|########5 | 2568/3000 [1:11:47<12:08,  1.69s/it, lr: 1.0e-04 loss: 2.494e-01]
a-cold-wall:  86%|########5 | 2568/3000 [1:11:47<12:08,  1.69s/it, lr: 1.0e-04 loss: 2.494e-01]
a-cold-wall:  86%|########5 | 2568/3000 [1:11:48<12:08,  1.69s/it, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  86%|########5 | 2568/3000 [1:11:48<12:08,  1.69s/it, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  86%|########5 | 2569/3000 [1:11:48<11:35,  1.61s/it, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  86%|########5 | 2569/3000 [1:11:48<11:35,  1.61s/it, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  86%|########5 | 2569/3000 [1:11:51<11:35,  1.61s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  86%|########5 | 2569/3000 [1:11:51<11:35,  1.61s/it, lr: 1.0e-04 loss: 6.604e-01]
a-cold-wall:  86%|########5 | 2570/3000 [1:11:54<11:34,  1.61s/it, lr: 1.0e-04 loss: 4.598e-01]
a-cold-wall:  86%|########5 | 2570/3000 [1:11:54<11:34,  1.61s/it, lr: 1.0e-04 loss: 4.598e-01]
a-cold-wall:  86%|########5 | 2571/3000 [1:11:54<11:01,  1.54s/it, lr: 1.0e-04 loss: 4.598e-01]
a-cold-wall:  86%|########5 | 2571/3000 [1:11:54<11:01,  1.54s/it, lr: 1.0e-04 loss: 4.598e-01]
a-cold-wall:  86%|########5 | 2571/3000 [1:11:55<11:01,  1.54s/it, lr: 1.0e-04 loss: 9.757e-02]
a-cold-wall:  86%|########5 | 2571/3000 [1:11:55<11:01,  1.54s/it, lr: 1.0e-04 loss: 9.757e-02]
a-cold-wall:  86%|########5 | 2572/3000 [1:11:55<09:37,  1.35s/it, lr: 1.0e-04 loss: 9.757e-02]
a-cold-wall:  86%|########5 | 2572/3000 [1:11:55<09:37,  1.35s/it, lr: 1.0e-04 loss: 9.757e-02]
a-cold-wall:  86%|########5 | 2572/3000 [1:11:57<09:37,  1.35s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########5 | 2572/3000 [1:11:57<09:37,  1.35s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########5 | 2573/3000 [1:11:57<12:27,  1.75s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########5 | 2573/3000 [1:11:57<12:27,  1.75s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########5 | 2573/3000 [1:11:58<12:27,  1.75s/it, lr: 1.0e-04 loss: 1.017e-01]
a-cold-wall:  86%|########5 | 2573/3000 [1:11:58<12:27,  1.75s/it, lr: 1.0e-04 loss: 1.017e-01]
a-cold-wall:  86%|########5 | 2574/3000 [1:11:58<10:57,  1.54s/it, lr: 1.0e-04 loss: 1.017e-01]
a-cold-wall:  86%|########5 | 2574/3000 [1:11:58<10:57,  1.54s/it, lr: 1.0e-04 loss: 1.017e-01]
a-cold-wall:  86%|########5 | 2574/3000 [1:12:01<10:57,  1.54s/it, lr: 1.0e-04 loss: 6.309e-01]
a-cold-wall:  86%|########5 | 2574/3000 [1:12:01<10:57,  1.54s/it, lr: 1.0e-04 loss: 6.309e-01]
a-cold-wall:  86%|########5 | 2575/3000 [1:12:01<13:35,  1.92s/it, lr: 1.0e-04 loss: 6.309e-01]
a-cold-wall:  86%|########5 | 2575/3000 [1:12:01<13:35,  1.92s/it, lr: 1.0e-04 loss: 6.309e-01]
a-cold-wall:  86%|########5 | 2575/3000 [1:12:03<13:35,  1.92s/it, lr: 1.0e-04 loss: 2.562e-02]
a-cold-wall:  86%|########5 | 2575/3000 [1:12:03<13:35,  1.92s/it, lr: 1.0e-04 loss: 2.562e-02]
a-cold-wall:  86%|########5 | 2576/3000 [1:12:03<12:35,  1.78s/it, lr: 1.0e-04 loss: 2.562e-02]
a-cold-wall:  86%|########5 | 2576/3000 [1:12:03<12:35,  1.78s/it, lr: 1.0e-04 loss: 2.562e-02]
a-cold-wall:  86%|########5 | 2576/3000 [1:12:04<12:35,  1.78s/it, lr: 1.0e-04 loss: 2.864e-01]
a-cold-wall:  86%|########5 | 2576/3000 [1:12:04<12:35,  1.78s/it, lr: 1.0e-04 loss: 2.864e-01]
a-cold-wall:  86%|########5 | 2577/3000 [1:12:04<11:50,  1.68s/it, lr: 1.0e-04 loss: 2.864e-01]
a-cold-wall:  86%|########5 | 2577/3000 [1:12:04<11:50,  1.68s/it, lr: 1.0e-04 loss: 2.864e-01]
a-cold-wall:  86%|########5 | 2577/3000 [1:12:07<11:50,  1.68s/it, lr: 1.0e-04 loss: 7.861e-02]
a-cold-wall:  86%|########5 | 2577/3000 [1:12:07<11:50,  1.68s/it, lr: 1.0e-04 loss: 7.861e-02]
a-cold-wall:  86%|########5 | 2578/3000 [1:12:07<14:16,  2.03s/it, lr: 1.0e-04 loss: 7.861e-02]
a-cold-wall:  86%|########5 | 2578/3000 [1:12:07<14:16,  2.03s/it, lr: 1.0e-04 loss: 7.861e-02]
a-cold-wall:  86%|########5 | 2578/3000 [1:12:10<14:16,  2.03s/it, lr: 1.0e-04 loss: 3.257e-02]
a-cold-wall:  86%|########5 | 2578/3000 [1:12:10<14:16,  2.03s/it, lr: 1.0e-04 loss: 3.257e-02]
a-cold-wall:  86%|########5 | 2579/3000 [1:12:10<15:58,  2.28s/it, lr: 1.0e-04 loss: 3.257e-02]
a-cold-wall:  86%|########5 | 2579/3000 [1:12:10<15:58,  2.28s/it, lr: 1.0e-04 loss: 3.257e-02]
a-cold-wall:  86%|########5 | 2579/3000 [1:12:11<15:58,  2.28s/it, lr: 1.0e-04 loss: 2.525e-01]
a-cold-wall:  86%|########5 | 2579/3000 [1:12:11<15:58,  2.28s/it, lr: 1.0e-04 loss: 2.525e-01]
a-cold-wall:  86%|########6 | 2580/3000 [1:12:13<15:56,  2.28s/it, lr: 1.0e-04 loss: 7.492e-01]
a-cold-wall:  86%|########6 | 2580/3000 [1:12:13<15:56,  2.28s/it, lr: 1.0e-04 loss: 7.492e-01]
a-cold-wall:  86%|########6 | 2581/3000 [1:12:13<10:54,  1.56s/it, lr: 1.0e-04 loss: 7.492e-01]
a-cold-wall:  86%|########6 | 2581/3000 [1:12:13<10:54,  1.56s/it, lr: 1.0e-04 loss: 7.492e-01]
a-cold-wall:  86%|########6 | 2581/3000 [1:12:16<10:54,  1.56s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########6 | 2581/3000 [1:12:16<10:54,  1.56s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########6 | 2582/3000 [1:12:16<13:06,  1.88s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########6 | 2582/3000 [1:12:16<13:06,  1.88s/it, lr: 1.0e-04 loss: 5.296e-01]
a-cold-wall:  86%|########6 | 2582/3000 [1:12:17<13:06,  1.88s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  86%|########6 | 2582/3000 [1:12:17<13:06,  1.88s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  86%|########6 | 2583/3000 [1:12:17<11:29,  1.65s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  86%|########6 | 2583/3000 [1:12:17<11:29,  1.65s/it, lr: 1.0e-04 loss: 3.341e-01]
a-cold-wall:  86%|########6 | 2583/3000 [1:12:17<11:29,  1.65s/it, lr: 1.0e-04 loss: 5.910e-01]
a-cold-wall:  86%|########6 | 2583/3000 [1:12:17<11:29,  1.65s/it, lr: 1.0e-04 loss: 5.910e-01]
a-cold-wall:  86%|########6 | 2584/3000 [1:12:17<09:45,  1.41s/it, lr: 1.0e-04 loss: 5.910e-01]
a-cold-wall:  86%|########6 | 2584/3000 [1:12:17<09:45,  1.41s/it, lr: 1.0e-04 loss: 5.910e-01]
a-cold-wall:  86%|########6 | 2584/3000 [1:12:18<09:45,  1.41s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  86%|########6 | 2584/3000 [1:12:18<09:45,  1.41s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  86%|########6 | 2585/3000 [1:12:18<08:26,  1.22s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  86%|########6 | 2585/3000 [1:12:18<08:26,  1.22s/it, lr: 1.0e-04 loss: 1.947e-01]
a-cold-wall:  86%|########6 | 2585/3000 [1:12:20<08:26,  1.22s/it, lr: 1.0e-04 loss: 7.140e-01]
a-cold-wall:  86%|########6 | 2585/3000 [1:12:20<08:26,  1.22s/it, lr: 1.0e-04 loss: 7.140e-01]
a-cold-wall:  86%|########6 | 2586/3000 [1:12:20<08:49,  1.28s/it, lr: 1.0e-04 loss: 7.140e-01]
a-cold-wall:  86%|########6 | 2586/3000 [1:12:20<08:49,  1.28s/it, lr: 1.0e-04 loss: 7.140e-01]
a-cold-wall:  86%|########6 | 2586/3000 [1:12:22<08:49,  1.28s/it, lr: 1.0e-04 loss: 1.368e-01]
a-cold-wall:  86%|########6 | 2586/3000 [1:12:22<08:49,  1.28s/it, lr: 1.0e-04 loss: 1.368e-01]
a-cold-wall:  86%|########6 | 2587/3000 [1:12:22<12:00,  1.75s/it, lr: 1.0e-04 loss: 1.368e-01]
a-cold-wall:  86%|########6 | 2587/3000 [1:12:22<12:00,  1.75s/it, lr: 1.0e-04 loss: 1.368e-01]
a-cold-wall:  86%|########6 | 2587/3000 [1:12:24<12:00,  1.75s/it, lr: 1.0e-04 loss: 7.950e-01]
a-cold-wall:  86%|########6 | 2587/3000 [1:12:24<12:00,  1.75s/it, lr: 1.0e-04 loss: 7.950e-01]
a-cold-wall:  86%|########6 | 2588/3000 [1:12:24<11:23,  1.66s/it, lr: 1.0e-04 loss: 7.950e-01]
a-cold-wall:  86%|########6 | 2588/3000 [1:12:24<11:23,  1.66s/it, lr: 1.0e-04 loss: 7.950e-01]
a-cold-wall:  86%|########6 | 2588/3000 [1:12:25<11:23,  1.66s/it, lr: 1.0e-04 loss: 2.720e-01]
a-cold-wall:  86%|########6 | 2588/3000 [1:12:25<11:23,  1.66s/it, lr: 1.0e-04 loss: 2.720e-01]
a-cold-wall:  86%|########6 | 2589/3000 [1:12:25<09:32,  1.39s/it, lr: 1.0e-04 loss: 2.720e-01]
a-cold-wall:  86%|########6 | 2589/3000 [1:12:25<09:32,  1.39s/it, lr: 1.0e-04 loss: 2.720e-01]
a-cold-wall:  86%|########6 | 2589/3000 [1:12:26<09:32,  1.39s/it, lr: 1.0e-04 loss: 4.175e-01]
a-cold-wall:  86%|########6 | 2589/3000 [1:12:26<09:32,  1.39s/it, lr: 1.0e-04 loss: 4.175e-01]
a-cold-wall:  86%|########6 | 2590/3000 [1:12:29<09:30,  1.39s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  86%|########6 | 2590/3000 [1:12:29<09:30,  1.39s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  86%|########6 | 2591/3000 [1:12:29<09:39,  1.42s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  86%|########6 | 2591/3000 [1:12:29<09:39,  1.42s/it, lr: 1.0e-04 loss: 5.056e-01]
a-cold-wall:  86%|########6 | 2591/3000 [1:12:30<09:39,  1.42s/it, lr: 1.0e-04 loss: 5.155e-01]
a-cold-wall:  86%|########6 | 2591/3000 [1:12:30<09:39,  1.42s/it, lr: 1.0e-04 loss: 5.155e-01]
a-cold-wall:  86%|########6 | 2592/3000 [1:12:30<08:32,  1.26s/it, lr: 1.0e-04 loss: 5.155e-01]
a-cold-wall:  86%|########6 | 2592/3000 [1:12:30<08:32,  1.26s/it, lr: 1.0e-04 loss: 5.155e-01]
a-cold-wall:  86%|########6 | 2592/3000 [1:12:33<08:32,  1.26s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  86%|########6 | 2592/3000 [1:12:33<08:32,  1.26s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  86%|########6 | 2593/3000 [1:12:33<11:23,  1.68s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  86%|########6 | 2593/3000 [1:12:33<11:23,  1.68s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  86%|########6 | 2593/3000 [1:12:34<11:23,  1.68s/it, lr: 1.0e-04 loss: 5.130e-01]
a-cold-wall:  86%|########6 | 2593/3000 [1:12:34<11:23,  1.68s/it, lr: 1.0e-04 loss: 5.130e-01]
a-cold-wall:  86%|########6 | 2594/3000 [1:12:34<10:52,  1.61s/it, lr: 1.0e-04 loss: 5.130e-01]
a-cold-wall:  86%|########6 | 2594/3000 [1:12:34<10:52,  1.61s/it, lr: 1.0e-04 loss: 5.130e-01]
a-cold-wall:  86%|########6 | 2594/3000 [1:12:37<10:52,  1.61s/it, lr: 1.0e-04 loss: 5.463e-01]
a-cold-wall:  86%|########6 | 2594/3000 [1:12:37<10:52,  1.61s/it, lr: 1.0e-04 loss: 5.463e-01]
a-cold-wall:  86%|########6 | 2595/3000 [1:12:37<13:15,  1.96s/it, lr: 1.0e-04 loss: 5.463e-01]
a-cold-wall:  86%|########6 | 2595/3000 [1:12:37<13:15,  1.96s/it, lr: 1.0e-04 loss: 5.463e-01]
a-cold-wall:  86%|########6 | 2595/3000 [1:12:38<13:15,  1.96s/it, lr: 1.0e-04 loss: 2.402e-02]
a-cold-wall:  86%|########6 | 2595/3000 [1:12:38<13:15,  1.96s/it, lr: 1.0e-04 loss: 2.402e-02]
a-cold-wall:  87%|########6 | 2596/3000 [1:12:38<12:06,  1.80s/it, lr: 1.0e-04 loss: 2.402e-02]
a-cold-wall:  87%|########6 | 2596/3000 [1:12:38<12:06,  1.80s/it, lr: 1.0e-04 loss: 2.402e-02]
a-cold-wall:  87%|########6 | 2596/3000 [1:12:40<12:06,  1.80s/it, lr: 1.0e-04 loss: 2.708e-01]
a-cold-wall:  87%|########6 | 2596/3000 [1:12:40<12:06,  1.80s/it, lr: 1.0e-04 loss: 2.708e-01]
a-cold-wall:  87%|########6 | 2597/3000 [1:12:40<11:47,  1.75s/it, lr: 1.0e-04 loss: 2.708e-01]
a-cold-wall:  87%|########6 | 2597/3000 [1:12:40<11:47,  1.75s/it, lr: 1.0e-04 loss: 2.708e-01]
a-cold-wall:  87%|########6 | 2597/3000 [1:12:41<11:47,  1.75s/it, lr: 1.0e-04 loss: 1.779e-01]
a-cold-wall:  87%|########6 | 2597/3000 [1:12:41<11:47,  1.75s/it, lr: 1.0e-04 loss: 1.779e-01]
a-cold-wall:  87%|########6 | 2598/3000 [1:12:41<11:05,  1.66s/it, lr: 1.0e-04 loss: 1.779e-01]
a-cold-wall:  87%|########6 | 2598/3000 [1:12:41<11:05,  1.66s/it, lr: 1.0e-04 loss: 1.779e-01]
a-cold-wall:  87%|########6 | 2598/3000 [1:12:42<11:05,  1.66s/it, lr: 1.0e-04 loss: 2.033e-02]
a-cold-wall:  87%|########6 | 2598/3000 [1:12:42<11:05,  1.66s/it, lr: 1.0e-04 loss: 2.033e-02]
a-cold-wall:  87%|########6 | 2599/3000 [1:12:42<09:16,  1.39s/it, lr: 1.0e-04 loss: 2.033e-02]
a-cold-wall:  87%|########6 | 2599/3000 [1:12:42<09:16,  1.39s/it, lr: 1.0e-04 loss: 2.033e-02]
a-cold-wall:  87%|########6 | 2599/3000 [1:12:45<09:16,  1.39s/it, lr: 1.0e-04 loss: 6.617e-01]
a-cold-wall:  87%|########6 | 2599/3000 [1:12:45<09:16,  1.39s/it, lr: 1.0e-04 loss: 6.617e-01]
a-cold-wall:  87%|########6 | 2600/3000 [1:12:46<09:15,  1.39s/it, lr: 1.0e-04 loss: 5.370e-01]
a-cold-wall:  87%|########6 | 2600/3000 [1:12:46<09:15,  1.39s/it, lr: 1.0e-04 loss: 5.370e-01]
a-cold-wall:  87%|########6 | 2601/3000 [1:12:46<07:10,  1.08s/it, lr: 1.0e-04 loss: 5.370e-01]
a-cold-wall:  87%|########6 | 2601/3000 [1:12:46<07:10,  1.08s/it, lr: 1.0e-04 loss: 5.370e-01]
a-cold-wall:  87%|########6 | 2601/3000 [1:12:49<07:10,  1.08s/it, lr: 1.0e-04 loss: 3.627e-02]
a-cold-wall:  87%|########6 | 2601/3000 [1:12:49<07:10,  1.08s/it, lr: 1.0e-04 loss: 3.627e-02]
a-cold-wall:  87%|########6 | 2602/3000 [1:12:49<10:07,  1.53s/it, lr: 1.0e-04 loss: 3.627e-02]
a-cold-wall:  87%|########6 | 2602/3000 [1:12:49<10:07,  1.53s/it, lr: 1.0e-04 loss: 3.627e-02]
a-cold-wall:  87%|########6 | 2602/3000 [1:12:50<10:07,  1.53s/it, lr: 1.0e-04 loss: 6.778e-01]
a-cold-wall:  87%|########6 | 2602/3000 [1:12:50<10:07,  1.53s/it, lr: 1.0e-04 loss: 6.778e-01]
a-cold-wall:  87%|########6 | 2603/3000 [1:12:50<08:45,  1.32s/it, lr: 1.0e-04 loss: 6.778e-01]
a-cold-wall:  87%|########6 | 2603/3000 [1:12:50<08:45,  1.32s/it, lr: 1.0e-04 loss: 6.778e-01]
a-cold-wall:  87%|########6 | 2603/3000 [1:12:52<08:45,  1.32s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  87%|########6 | 2603/3000 [1:12:52<08:45,  1.32s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  87%|########6 | 2604/3000 [1:12:52<08:55,  1.35s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  87%|########6 | 2604/3000 [1:12:52<08:55,  1.35s/it, lr: 1.0e-04 loss: 5.502e-01]
a-cold-wall:  87%|########6 | 2604/3000 [1:12:54<08:55,  1.35s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  87%|########6 | 2604/3000 [1:12:54<08:55,  1.35s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  87%|########6 | 2605/3000 [1:12:54<11:43,  1.78s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  87%|########6 | 2605/3000 [1:12:54<11:43,  1.78s/it, lr: 1.0e-04 loss: 4.749e-01]
a-cold-wall:  87%|########6 | 2605/3000 [1:12:57<11:43,  1.78s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  87%|########6 | 2605/3000 [1:12:57<11:43,  1.78s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  87%|########6 | 2606/3000 [1:12:57<13:44,  2.09s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  87%|########6 | 2606/3000 [1:12:57<13:44,  2.09s/it, lr: 1.0e-04 loss: 1.453e-01]
a-cold-wall:  87%|########6 | 2606/3000 [1:12:59<13:44,  2.09s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  87%|########6 | 2606/3000 [1:12:59<13:44,  2.09s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  87%|########6 | 2607/3000 [1:12:59<12:27,  1.90s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  87%|########6 | 2607/3000 [1:12:59<12:27,  1.90s/it, lr: 1.0e-04 loss: 5.255e-01]
a-cold-wall:  87%|########6 | 2607/3000 [1:12:59<12:27,  1.90s/it, lr: 1.0e-04 loss: 1.229e-01]
a-cold-wall:  87%|########6 | 2607/3000 [1:12:59<12:27,  1.90s/it, lr: 1.0e-04 loss: 1.229e-01]
a-cold-wall:  87%|########6 | 2608/3000 [1:12:59<10:13,  1.57s/it, lr: 1.0e-04 loss: 1.229e-01]
a-cold-wall:  87%|########6 | 2608/3000 [1:12:59<10:13,  1.57s/it, lr: 1.0e-04 loss: 1.229e-01]
a-cold-wall:  87%|########6 | 2608/3000 [1:13:02<10:13,  1.57s/it, lr: 1.0e-04 loss: 7.358e-01]
a-cold-wall:  87%|########6 | 2608/3000 [1:13:02<10:13,  1.57s/it, lr: 1.0e-04 loss: 7.358e-01]
a-cold-wall:  87%|########6 | 2609/3000 [1:13:02<12:40,  1.94s/it, lr: 1.0e-04 loss: 7.358e-01]
a-cold-wall:  87%|########6 | 2609/3000 [1:13:02<12:40,  1.94s/it, lr: 1.0e-04 loss: 7.358e-01]
a-cold-wall:  87%|########6 | 2609/3000 [1:13:05<12:40,  1.94s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  87%|########6 | 2609/3000 [1:13:05<12:40,  1.94s/it, lr: 1.0e-04 loss: 2.645e-01]
a-cold-wall:  87%|########7 | 2610/3000 [1:13:06<12:38,  1.94s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  87%|########7 | 2610/3000 [1:13:06<12:38,  1.94s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  87%|########7 | 2611/3000 [1:13:06<07:57,  1.23s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  87%|########7 | 2611/3000 [1:13:06<07:57,  1.23s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  87%|########7 | 2611/3000 [1:13:07<07:57,  1.23s/it, lr: 1.0e-04 loss: 4.523e-01]
a-cold-wall:  87%|########7 | 2611/3000 [1:13:07<07:57,  1.23s/it, lr: 1.0e-04 loss: 4.523e-01]
a-cold-wall:  87%|########7 | 2612/3000 [1:13:07<07:11,  1.11s/it, lr: 1.0e-04 loss: 4.523e-01]
a-cold-wall:  87%|########7 | 2612/3000 [1:13:07<07:11,  1.11s/it, lr: 1.0e-04 loss: 4.523e-01]
a-cold-wall:  87%|########7 | 2612/3000 [1:13:10<07:11,  1.11s/it, lr: 1.0e-04 loss: 5.257e-01]
a-cold-wall:  87%|########7 | 2612/3000 [1:13:10<07:11,  1.11s/it, lr: 1.0e-04 loss: 5.257e-01]
a-cold-wall:  87%|########7 | 2613/3000 [1:13:10<10:09,  1.57s/it, lr: 1.0e-04 loss: 5.257e-01]
a-cold-wall:  87%|########7 | 2613/3000 [1:13:10<10:09,  1.57s/it, lr: 1.0e-04 loss: 5.257e-01]
a-cold-wall:  87%|########7 | 2613/3000 [1:13:11<10:09,  1.57s/it, lr: 1.0e-04 loss: 2.331e-01]
a-cold-wall:  87%|########7 | 2613/3000 [1:13:11<10:09,  1.57s/it, lr: 1.0e-04 loss: 2.331e-01]
a-cold-wall:  87%|########7 | 2614/3000 [1:13:11<09:47,  1.52s/it, lr: 1.0e-04 loss: 2.331e-01]
a-cold-wall:  87%|########7 | 2614/3000 [1:13:11<09:47,  1.52s/it, lr: 1.0e-04 loss: 2.331e-01]
a-cold-wall:  87%|########7 | 2614/3000 [1:13:12<09:47,  1.52s/it, lr: 1.0e-04 loss: 3.783e-01]
a-cold-wall:  87%|########7 | 2614/3000 [1:13:12<09:47,  1.52s/it, lr: 1.0e-04 loss: 3.783e-01]
a-cold-wall:  87%|########7 | 2615/3000 [1:13:12<08:23,  1.31s/it, lr: 1.0e-04 loss: 3.783e-01]
a-cold-wall:  87%|########7 | 2615/3000 [1:13:12<08:23,  1.31s/it, lr: 1.0e-04 loss: 3.783e-01]
a-cold-wall:  87%|########7 | 2615/3000 [1:13:13<08:23,  1.31s/it, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  87%|########7 | 2615/3000 [1:13:13<08:23,  1.31s/it, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  87%|########7 | 2616/3000 [1:13:13<07:21,  1.15s/it, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  87%|########7 | 2616/3000 [1:13:13<07:21,  1.15s/it, lr: 1.0e-04 loss: 2.382e-01]
a-cold-wall:  87%|########7 | 2616/3000 [1:13:13<07:21,  1.15s/it, lr: 1.0e-04 loss: 4.814e-01]
a-cold-wall:  87%|########7 | 2616/3000 [1:13:13<07:21,  1.15s/it, lr: 1.0e-04 loss: 4.814e-01]
a-cold-wall:  87%|########7 | 2617/3000 [1:13:13<06:36,  1.04s/it, lr: 1.0e-04 loss: 4.814e-01]
a-cold-wall:  87%|########7 | 2617/3000 [1:13:13<06:36,  1.04s/it, lr: 1.0e-04 loss: 4.814e-01]
a-cold-wall:  87%|########7 | 2617/3000 [1:13:14<06:36,  1.04s/it, lr: 1.0e-04 loss: 6.671e-02]
a-cold-wall:  87%|########7 | 2617/3000 [1:13:14<06:36,  1.04s/it, lr: 1.0e-04 loss: 6.671e-02]
a-cold-wall:  87%|########7 | 2618/3000 [1:13:14<06:04,  1.05it/s, lr: 1.0e-04 loss: 6.671e-02]
a-cold-wall:  87%|########7 | 2618/3000 [1:13:14<06:04,  1.05it/s, lr: 1.0e-04 loss: 6.671e-02]
a-cold-wall:  87%|########7 | 2618/3000 [1:13:17<06:04,  1.05it/s, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  87%|########7 | 2618/3000 [1:13:17<06:04,  1.05it/s, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  87%|########7 | 2619/3000 [1:13:17<09:42,  1.53s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  87%|########7 | 2619/3000 [1:13:17<09:42,  1.53s/it, lr: 1.0e-04 loss: 6.275e-01]
a-cold-wall:  87%|########7 | 2619/3000 [1:13:19<09:42,  1.53s/it, lr: 1.0e-04 loss: 2.432e-01]
a-cold-wall:  87%|########7 | 2619/3000 [1:13:19<09:42,  1.53s/it, lr: 1.0e-04 loss: 2.432e-01]
a-cold-wall:  87%|########7 | 2620/3000 [1:13:20<09:41,  1.53s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  87%|########7 | 2620/3000 [1:13:20<09:41,  1.53s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  87%|########7 | 2621/3000 [1:13:20<07:18,  1.16s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  87%|########7 | 2621/3000 [1:13:20<07:18,  1.16s/it, lr: 1.0e-04 loss: 5.284e-01]
a-cold-wall:  87%|########7 | 2621/3000 [1:13:21<07:18,  1.16s/it, lr: 1.0e-04 loss: 1.305e-01]
a-cold-wall:  87%|########7 | 2621/3000 [1:13:21<07:18,  1.16s/it, lr: 1.0e-04 loss: 1.305e-01]
a-cold-wall:  87%|########7 | 2622/3000 [1:13:21<07:42,  1.22s/it, lr: 1.0e-04 loss: 1.305e-01]
a-cold-wall:  87%|########7 | 2622/3000 [1:13:21<07:42,  1.22s/it, lr: 1.0e-04 loss: 1.305e-01]
a-cold-wall:  87%|########7 | 2622/3000 [1:13:24<07:42,  1.22s/it, lr: 1.0e-04 loss: 4.208e-01]
a-cold-wall:  87%|########7 | 2622/3000 [1:13:24<07:42,  1.22s/it, lr: 1.0e-04 loss: 4.208e-01]
a-cold-wall:  87%|########7 | 2623/3000 [1:13:24<10:34,  1.68s/it, lr: 1.0e-04 loss: 4.208e-01]
a-cold-wall:  87%|########7 | 2623/3000 [1:13:24<10:34,  1.68s/it, lr: 1.0e-04 loss: 4.208e-01]
a-cold-wall:  87%|########7 | 2623/3000 [1:13:25<10:34,  1.68s/it, lr: 1.0e-04 loss: 4.405e-02]
a-cold-wall:  87%|########7 | 2623/3000 [1:13:25<10:34,  1.68s/it, lr: 1.0e-04 loss: 4.405e-02]
a-cold-wall:  87%|########7 | 2624/3000 [1:13:25<08:59,  1.43s/it, lr: 1.0e-04 loss: 4.405e-02]
a-cold-wall:  87%|########7 | 2624/3000 [1:13:25<08:59,  1.43s/it, lr: 1.0e-04 loss: 4.405e-02]
a-cold-wall:  87%|########7 | 2624/3000 [1:13:29<08:59,  1.43s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  87%|########7 | 2624/3000 [1:13:29<08:59,  1.43s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  88%|########7 | 2625/3000 [1:13:29<11:35,  1.85s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  88%|########7 | 2625/3000 [1:13:29<11:35,  1.85s/it, lr: 1.0e-04 loss: 3.807e-01]
a-cold-wall:  88%|########7 | 2625/3000 [1:13:30<11:35,  1.85s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  88%|########7 | 2625/3000 [1:13:30<11:35,  1.85s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  88%|########7 | 2626/3000 [1:13:30<10:48,  1.73s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  88%|########7 | 2626/3000 [1:13:30<10:48,  1.73s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  88%|########7 | 2626/3000 [1:13:31<10:48,  1.73s/it, lr: 1.0e-04 loss: 4.442e-01]
a-cold-wall:  88%|########7 | 2626/3000 [1:13:31<10:48,  1.73s/it, lr: 1.0e-04 loss: 4.442e-01]
a-cold-wall:  88%|########7 | 2627/3000 [1:13:31<09:00,  1.45s/it, lr: 1.0e-04 loss: 4.442e-01]
a-cold-wall:  88%|########7 | 2627/3000 [1:13:31<09:00,  1.45s/it, lr: 1.0e-04 loss: 4.442e-01]
a-cold-wall:  88%|########7 | 2627/3000 [1:13:32<09:00,  1.45s/it, lr: 1.0e-04 loss: 7.514e-01]
a-cold-wall:  88%|########7 | 2627/3000 [1:13:32<09:00,  1.45s/it, lr: 1.0e-04 loss: 7.514e-01]
a-cold-wall:  88%|########7 | 2628/3000 [1:13:32<07:44,  1.25s/it, lr: 1.0e-04 loss: 7.514e-01]
a-cold-wall:  88%|########7 | 2628/3000 [1:13:32<07:44,  1.25s/it, lr: 1.0e-04 loss: 7.514e-01]
a-cold-wall:  88%|########7 | 2628/3000 [1:13:33<07:44,  1.25s/it, lr: 1.0e-04 loss: 6.630e-01]
a-cold-wall:  88%|########7 | 2628/3000 [1:13:33<07:44,  1.25s/it, lr: 1.0e-04 loss: 6.630e-01]
a-cold-wall:  88%|########7 | 2629/3000 [1:13:33<08:04,  1.31s/it, lr: 1.0e-04 loss: 6.630e-01]
a-cold-wall:  88%|########7 | 2629/3000 [1:13:33<08:04,  1.31s/it, lr: 1.0e-04 loss: 6.630e-01]
a-cold-wall:  88%|########7 | 2629/3000 [1:13:36<08:04,  1.31s/it, lr: 1.0e-04 loss: 6.615e-02]
a-cold-wall:  88%|########7 | 2629/3000 [1:13:36<08:04,  1.31s/it, lr: 1.0e-04 loss: 6.615e-02]
a-cold-wall:  88%|########7 | 2630/3000 [1:13:37<08:03,  1.31s/it, lr: 1.0e-04 loss: 4.938e-01]
a-cold-wall:  88%|########7 | 2630/3000 [1:13:37<08:03,  1.31s/it, lr: 1.0e-04 loss: 4.938e-01]
a-cold-wall:  88%|########7 | 2631/3000 [1:13:37<05:25,  1.14it/s, lr: 1.0e-04 loss: 4.938e-01]
a-cold-wall:  88%|########7 | 2631/3000 [1:13:37<05:25,  1.14it/s, lr: 1.0e-04 loss: 4.938e-01]
a-cold-wall:  88%|########7 | 2631/3000 [1:13:38<05:25,  1.14it/s, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  88%|########7 | 2631/3000 [1:13:38<05:25,  1.14it/s, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  88%|########7 | 2632/3000 [1:13:38<06:15,  1.02s/it, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  88%|########7 | 2632/3000 [1:13:38<06:15,  1.02s/it, lr: 1.0e-04 loss: 3.633e-01]
a-cold-wall:  88%|########7 | 2632/3000 [1:13:39<06:15,  1.02s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  88%|########7 | 2632/3000 [1:13:39<06:15,  1.02s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  88%|########7 | 2633/3000 [1:13:40<06:54,  1.13s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  88%|########7 | 2633/3000 [1:13:40<06:54,  1.13s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  88%|########7 | 2633/3000 [1:13:40<06:54,  1.13s/it, lr: 1.0e-04 loss: 3.328e-01]
a-cold-wall:  88%|########7 | 2633/3000 [1:13:40<06:54,  1.13s/it, lr: 1.0e-04 loss: 3.328e-01]
a-cold-wall:  88%|########7 | 2634/3000 [1:13:40<06:16,  1.03s/it, lr: 1.0e-04 loss: 3.328e-01]
a-cold-wall:  88%|########7 | 2634/3000 [1:13:40<06:16,  1.03s/it, lr: 1.0e-04 loss: 3.328e-01]
a-cold-wall:  88%|########7 | 2634/3000 [1:13:41<06:16,  1.03s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  88%|########7 | 2634/3000 [1:13:41<06:16,  1.03s/it, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  88%|########7 | 2635/3000 [1:13:41<05:48,  1.05it/s, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  88%|########7 | 2635/3000 [1:13:41<05:48,  1.05it/s, lr: 1.0e-04 loss: 1.347e-01]
a-cold-wall:  88%|########7 | 2635/3000 [1:13:42<05:48,  1.05it/s, lr: 1.0e-04 loss: 6.421e-01]
a-cold-wall:  88%|########7 | 2635/3000 [1:13:42<05:48,  1.05it/s, lr: 1.0e-04 loss: 6.421e-01]
a-cold-wall:  88%|########7 | 2636/3000 [1:13:42<05:25,  1.12it/s, lr: 1.0e-04 loss: 6.421e-01]
a-cold-wall:  88%|########7 | 2636/3000 [1:13:42<05:25,  1.12it/s, lr: 1.0e-04 loss: 6.421e-01]
a-cold-wall:  88%|########7 | 2636/3000 [1:13:43<05:25,  1.12it/s, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  88%|########7 | 2636/3000 [1:13:43<05:25,  1.12it/s, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  88%|########7 | 2637/3000 [1:13:43<06:21,  1.05s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  88%|########7 | 2637/3000 [1:13:43<06:21,  1.05s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall:  88%|########7 | 2637/3000 [1:13:46<06:21,  1.05s/it, lr: 1.0e-04 loss: 3.217e-01]
a-cold-wall:  88%|########7 | 2637/3000 [1:13:46<06:21,  1.05s/it, lr: 1.0e-04 loss: 3.217e-01]
a-cold-wall:  88%|########7 | 2638/3000 [1:13:46<09:53,  1.64s/it, lr: 1.0e-04 loss: 3.217e-01]
a-cold-wall:  88%|########7 | 2638/3000 [1:13:46<09:53,  1.64s/it, lr: 1.0e-04 loss: 3.217e-01]
a-cold-wall:  88%|########7 | 2638/3000 [1:13:49<09:53,  1.64s/it, lr: 1.0e-04 loss: 3.706e-01]
a-cold-wall:  88%|########7 | 2638/3000 [1:13:49<09:53,  1.64s/it, lr: 1.0e-04 loss: 3.706e-01]
a-cold-wall:  88%|########7 | 2639/3000 [1:13:49<12:00,  2.00s/it, lr: 1.0e-04 loss: 3.706e-01]
a-cold-wall:  88%|########7 | 2639/3000 [1:13:49<12:00,  2.00s/it, lr: 1.0e-04 loss: 3.706e-01]
a-cold-wall:  88%|########7 | 2639/3000 [1:13:51<12:00,  2.00s/it, lr: 1.0e-04 loss: 5.577e-01]
a-cold-wall:  88%|########7 | 2639/3000 [1:13:51<12:00,  2.00s/it, lr: 1.0e-04 loss: 5.577e-01]
a-cold-wall:  88%|########8 | 2640/3000 [1:13:53<11:58,  2.00s/it, lr: 1.0e-04 loss: 5.827e-01]
a-cold-wall:  88%|########8 | 2640/3000 [1:13:53<11:58,  2.00s/it, lr: 1.0e-04 loss: 5.827e-01]
a-cold-wall:  88%|########8 | 2641/3000 [1:13:53<10:25,  1.74s/it, lr: 1.0e-04 loss: 5.827e-01]
a-cold-wall:  88%|########8 | 2641/3000 [1:13:53<10:25,  1.74s/it, lr: 1.0e-04 loss: 5.827e-01]
a-cold-wall:  88%|########8 | 2641/3000 [1:13:54<10:25,  1.74s/it, lr: 1.0e-04 loss: 7.524e-01]
a-cold-wall:  88%|########8 | 2641/3000 [1:13:54<10:25,  1.74s/it, lr: 1.0e-04 loss: 7.524e-01]
a-cold-wall:  88%|########8 | 2642/3000 [1:13:54<08:56,  1.50s/it, lr: 1.0e-04 loss: 7.524e-01]
a-cold-wall:  88%|########8 | 2642/3000 [1:13:54<08:56,  1.50s/it, lr: 1.0e-04 loss: 7.524e-01]
a-cold-wall:  88%|########8 | 2642/3000 [1:13:57<08:56,  1.50s/it, lr: 1.0e-04 loss: 4.342e-01]
a-cold-wall:  88%|########8 | 2642/3000 [1:13:57<08:56,  1.50s/it, lr: 1.0e-04 loss: 4.342e-01]
a-cold-wall:  88%|########8 | 2643/3000 [1:13:57<11:02,  1.86s/it, lr: 1.0e-04 loss: 4.342e-01]
a-cold-wall:  88%|########8 | 2643/3000 [1:13:57<11:02,  1.86s/it, lr: 1.0e-04 loss: 4.342e-01]
a-cold-wall:  88%|########8 | 2643/3000 [1:13:58<11:02,  1.86s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  88%|########8 | 2643/3000 [1:13:58<11:02,  1.86s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  88%|########8 | 2644/3000 [1:13:58<09:13,  1.56s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  88%|########8 | 2644/3000 [1:13:58<09:13,  1.56s/it, lr: 1.0e-04 loss: 1.459e-01]
a-cold-wall:  88%|########8 | 2644/3000 [1:14:01<09:13,  1.56s/it, lr: 1.0e-04 loss: 5.101e-01]
a-cold-wall:  88%|########8 | 2644/3000 [1:14:01<09:13,  1.56s/it, lr: 1.0e-04 loss: 5.101e-01]
a-cold-wall:  88%|########8 | 2645/3000 [1:14:01<11:22,  1.92s/it, lr: 1.0e-04 loss: 5.101e-01]
a-cold-wall:  88%|########8 | 2645/3000 [1:14:01<11:22,  1.92s/it, lr: 1.0e-04 loss: 5.101e-01]
a-cold-wall:  88%|########8 | 2645/3000 [1:14:02<11:22,  1.92s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  88%|########8 | 2645/3000 [1:14:02<11:22,  1.92s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  88%|########8 | 2646/3000 [1:14:02<10:30,  1.78s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  88%|########8 | 2646/3000 [1:14:02<10:30,  1.78s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  88%|########8 | 2646/3000 [1:14:03<10:30,  1.78s/it, lr: 1.0e-04 loss: 2.466e-01]
a-cold-wall:  88%|########8 | 2646/3000 [1:14:03<10:30,  1.78s/it, lr: 1.0e-04 loss: 2.466e-01]
a-cold-wall:  88%|########8 | 2647/3000 [1:14:03<08:43,  1.48s/it, lr: 1.0e-04 loss: 2.466e-01]
a-cold-wall:  88%|########8 | 2647/3000 [1:14:03<08:43,  1.48s/it, lr: 1.0e-04 loss: 2.466e-01]
a-cold-wall:  88%|########8 | 2647/3000 [1:14:04<08:43,  1.48s/it, lr: 1.0e-04 loss: 7.153e-01]
a-cold-wall:  88%|########8 | 2647/3000 [1:14:04<08:43,  1.48s/it, lr: 1.0e-04 loss: 7.153e-01]
a-cold-wall:  88%|########8 | 2648/3000 [1:14:04<08:37,  1.47s/it, lr: 1.0e-04 loss: 7.153e-01]
a-cold-wall:  88%|########8 | 2648/3000 [1:14:04<08:37,  1.47s/it, lr: 1.0e-04 loss: 7.153e-01]
a-cold-wall:  88%|########8 | 2648/3000 [1:14:07<08:37,  1.47s/it, lr: 1.0e-04 loss: 5.059e-01]
a-cold-wall:  88%|########8 | 2648/3000 [1:14:07<08:37,  1.47s/it, lr: 1.0e-04 loss: 5.059e-01]
a-cold-wall:  88%|########8 | 2649/3000 [1:14:07<11:00,  1.88s/it, lr: 1.0e-04 loss: 5.059e-01]
a-cold-wall:  88%|########8 | 2649/3000 [1:14:07<11:00,  1.88s/it, lr: 1.0e-04 loss: 5.059e-01]
a-cold-wall:  88%|########8 | 2649/3000 [1:14:09<11:00,  1.88s/it, lr: 1.0e-04 loss: 2.986e-01]
a-cold-wall:  88%|########8 | 2649/3000 [1:14:09<11:00,  1.88s/it, lr: 1.0e-04 loss: 2.986e-01]
a-cold-wall:  88%|########8 | 2650/3000 [1:14:10<10:58,  1.88s/it, lr: 1.0e-04 loss: 1.154e-01]
a-cold-wall:  88%|########8 | 2650/3000 [1:14:10<10:58,  1.88s/it, lr: 1.0e-04 loss: 1.154e-01]
a-cold-wall:  88%|########8 | 2651/3000 [1:14:10<07:51,  1.35s/it, lr: 1.0e-04 loss: 1.154e-01]
a-cold-wall:  88%|########8 | 2651/3000 [1:14:10<07:51,  1.35s/it, lr: 1.0e-04 loss: 1.154e-01]
a-cold-wall:  88%|########8 | 2651/3000 [1:14:12<07:51,  1.35s/it, lr: 1.0e-04 loss: 4.441e-02]
a-cold-wall:  88%|########8 | 2651/3000 [1:14:12<07:51,  1.35s/it, lr: 1.0e-04 loss: 4.441e-02]
a-cold-wall:  88%|########8 | 2652/3000 [1:14:12<08:14,  1.42s/it, lr: 1.0e-04 loss: 4.441e-02]
a-cold-wall:  88%|########8 | 2652/3000 [1:14:12<08:14,  1.42s/it, lr: 1.0e-04 loss: 4.441e-02]
a-cold-wall:  88%|########8 | 2652/3000 [1:14:13<08:14,  1.42s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  88%|########8 | 2652/3000 [1:14:13<08:14,  1.42s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  88%|########8 | 2653/3000 [1:14:13<08:12,  1.42s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  88%|########8 | 2653/3000 [1:14:13<08:12,  1.42s/it, lr: 1.0e-04 loss: 1.911e-01]
a-cold-wall:  88%|########8 | 2653/3000 [1:14:15<08:12,  1.42s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  88%|########8 | 2653/3000 [1:14:15<08:12,  1.42s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  88%|########8 | 2654/3000 [1:14:15<08:13,  1.43s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  88%|########8 | 2654/3000 [1:14:15<08:13,  1.43s/it, lr: 1.0e-04 loss: 1.172e-01]
a-cold-wall:  88%|########8 | 2654/3000 [1:14:15<08:13,  1.43s/it, lr: 1.0e-04 loss: 5.296e-02]
a-cold-wall:  88%|########8 | 2654/3000 [1:14:15<08:13,  1.43s/it, lr: 1.0e-04 loss: 5.296e-02]
a-cold-wall:  88%|########8 | 2655/3000 [1:14:15<07:06,  1.24s/it, lr: 1.0e-04 loss: 5.296e-02]
a-cold-wall:  88%|########8 | 2655/3000 [1:14:15<07:06,  1.24s/it, lr: 1.0e-04 loss: 5.296e-02]
a-cold-wall:  88%|########8 | 2655/3000 [1:14:18<07:06,  1.24s/it, lr: 1.0e-04 loss: 6.533e-02]
a-cold-wall:  88%|########8 | 2655/3000 [1:14:18<07:06,  1.24s/it, lr: 1.0e-04 loss: 6.533e-02]
a-cold-wall:  89%|########8 | 2656/3000 [1:14:18<09:41,  1.69s/it, lr: 1.0e-04 loss: 6.533e-02]
a-cold-wall:  89%|########8 | 2656/3000 [1:14:18<09:41,  1.69s/it, lr: 1.0e-04 loss: 6.533e-02]
a-cold-wall:  89%|########8 | 2656/3000 [1:14:19<09:41,  1.69s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  89%|########8 | 2656/3000 [1:14:19<09:41,  1.69s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  89%|########8 | 2657/3000 [1:14:19<09:08,  1.60s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  89%|########8 | 2657/3000 [1:14:19<09:08,  1.60s/it, lr: 1.0e-04 loss: 2.492e-01]
a-cold-wall:  89%|########8 | 2657/3000 [1:14:22<09:08,  1.60s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  89%|########8 | 2657/3000 [1:14:22<09:08,  1.60s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  89%|########8 | 2658/3000 [1:14:22<11:12,  1.97s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  89%|########8 | 2658/3000 [1:14:22<11:12,  1.97s/it, lr: 1.0e-04 loss: 2.904e-01]
a-cold-wall:  89%|########8 | 2658/3000 [1:14:23<11:12,  1.97s/it, lr: 1.0e-04 loss: 1.550e-01]
a-cold-wall:  89%|########8 | 2658/3000 [1:14:23<11:12,  1.97s/it, lr: 1.0e-04 loss: 1.550e-01]
a-cold-wall:  89%|########8 | 2659/3000 [1:14:23<09:08,  1.61s/it, lr: 1.0e-04 loss: 1.550e-01]
a-cold-wall:  89%|########8 | 2659/3000 [1:14:23<09:08,  1.61s/it, lr: 1.0e-04 loss: 1.550e-01]
a-cold-wall:  89%|########8 | 2659/3000 [1:14:24<09:08,  1.61s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  89%|########8 | 2659/3000 [1:14:24<09:08,  1.61s/it, lr: 1.0e-04 loss: 6.075e-01]
a-cold-wall:  89%|########8 | 2660/3000 [1:14:27<09:06,  1.61s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall:  89%|########8 | 2660/3000 [1:14:27<09:06,  1.61s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall:  89%|########8 | 2661/3000 [1:14:27<08:37,  1.53s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall:  89%|########8 | 2661/3000 [1:14:27<08:37,  1.53s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall:  89%|########8 | 2661/3000 [1:14:30<08:37,  1.53s/it, lr: 1.0e-04 loss: 5.439e-01]
a-cold-wall:  89%|########8 | 2661/3000 [1:14:30<08:37,  1.53s/it, lr: 1.0e-04 loss: 5.439e-01]
a-cold-wall:  89%|########8 | 2662/3000 [1:14:30<10:23,  1.85s/it, lr: 1.0e-04 loss: 5.439e-01]
a-cold-wall:  89%|########8 | 2662/3000 [1:14:30<10:23,  1.85s/it, lr: 1.0e-04 loss: 5.439e-01]
a-cold-wall:  89%|########8 | 2662/3000 [1:14:33<10:23,  1.85s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  89%|########8 | 2662/3000 [1:14:33<10:23,  1.85s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  89%|########8 | 2663/3000 [1:14:33<11:47,  2.10s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  89%|########8 | 2663/3000 [1:14:33<11:47,  2.10s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  89%|########8 | 2663/3000 [1:14:36<11:47,  2.10s/it, lr: 1.0e-04 loss: 5.166e-01]
a-cold-wall:  89%|########8 | 2663/3000 [1:14:36<11:47,  2.10s/it, lr: 1.0e-04 loss: 5.166e-01]
a-cold-wall:  89%|########8 | 2664/3000 [1:14:36<12:54,  2.31s/it, lr: 1.0e-04 loss: 5.166e-01]
a-cold-wall:  89%|########8 | 2664/3000 [1:14:36<12:54,  2.31s/it, lr: 1.0e-04 loss: 5.166e-01]
a-cold-wall:  89%|########8 | 2664/3000 [1:14:39<12:54,  2.31s/it, lr: 1.0e-04 loss: 7.331e-02]
a-cold-wall:  89%|########8 | 2664/3000 [1:14:39<12:54,  2.31s/it, lr: 1.0e-04 loss: 7.331e-02]
a-cold-wall:  89%|########8 | 2665/3000 [1:14:39<14:04,  2.52s/it, lr: 1.0e-04 loss: 7.331e-02]
a-cold-wall:  89%|########8 | 2665/3000 [1:14:39<14:04,  2.52s/it, lr: 1.0e-04 loss: 7.331e-02]
a-cold-wall:  89%|########8 | 2665/3000 [1:14:40<14:04,  2.52s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  89%|########8 | 2665/3000 [1:14:40<14:04,  2.52s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  89%|########8 | 2666/3000 [1:14:40<12:16,  2.21s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  89%|########8 | 2666/3000 [1:14:40<12:16,  2.21s/it, lr: 1.0e-04 loss: 6.455e-01]
a-cold-wall:  89%|########8 | 2666/3000 [1:14:43<12:16,  2.21s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:  89%|########8 | 2666/3000 [1:14:43<12:16,  2.21s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:  89%|########8 | 2667/3000 [1:14:43<13:14,  2.38s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:  89%|########8 | 2667/3000 [1:14:43<13:14,  2.38s/it, lr: 1.0e-04 loss: 2.587e-01]
a-cold-wall:  89%|########8 | 2667/3000 [1:14:44<13:14,  2.38s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:  89%|########8 | 2667/3000 [1:14:44<13:14,  2.38s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:  89%|########8 | 2668/3000 [1:14:44<10:33,  1.91s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:  89%|########8 | 2668/3000 [1:14:44<10:33,  1.91s/it, lr: 1.0e-04 loss: 6.327e-01]
a-cold-wall:  89%|########8 | 2668/3000 [1:14:45<10:33,  1.91s/it, lr: 1.0e-04 loss: 3.108e-01]
a-cold-wall:  89%|########8 | 2668/3000 [1:14:45<10:33,  1.91s/it, lr: 1.0e-04 loss: 3.108e-01]
a-cold-wall:  89%|########8 | 2669/3000 [1:14:45<09:42,  1.76s/it, lr: 1.0e-04 loss: 3.108e-01]
a-cold-wall:  89%|########8 | 2669/3000 [1:14:45<09:42,  1.76s/it, lr: 1.0e-04 loss: 3.108e-01]
a-cold-wall:  89%|########8 | 2669/3000 [1:14:47<09:42,  1.76s/it, lr: 1.0e-04 loss: 8.533e-01]
a-cold-wall:  89%|########8 | 2669/3000 [1:14:47<09:42,  1.76s/it, lr: 1.0e-04 loss: 8.533e-01]
a-cold-wall:  89%|########9 | 2670/3000 [1:14:48<09:41,  1.76s/it, lr: 1.0e-04 loss: 3.214e-01]
a-cold-wall:  89%|########9 | 2670/3000 [1:14:48<09:41,  1.76s/it, lr: 1.0e-04 loss: 3.214e-01]
a-cold-wall:  89%|########9 | 2671/3000 [1:14:48<06:10,  1.13s/it, lr: 1.0e-04 loss: 3.214e-01]
a-cold-wall:  89%|########9 | 2671/3000 [1:14:48<06:10,  1.13s/it, lr: 1.0e-04 loss: 3.214e-01]
a-cold-wall:  89%|########9 | 2671/3000 [1:14:48<06:10,  1.13s/it, lr: 1.0e-04 loss: 2.984e-01]
a-cold-wall:  89%|########9 | 2671/3000 [1:14:48<06:10,  1.13s/it, lr: 1.0e-04 loss: 2.984e-01]
a-cold-wall:  89%|########9 | 2672/3000 [1:14:48<05:38,  1.03s/it, lr: 1.0e-04 loss: 2.984e-01]
a-cold-wall:  89%|########9 | 2672/3000 [1:14:48<05:38,  1.03s/it, lr: 1.0e-04 loss: 2.984e-01]
a-cold-wall:  89%|########9 | 2672/3000 [1:14:50<05:38,  1.03s/it, lr: 1.0e-04 loss: 4.451e-01]
a-cold-wall:  89%|########9 | 2672/3000 [1:14:50<05:38,  1.03s/it, lr: 1.0e-04 loss: 4.451e-01]
a-cold-wall:  89%|########9 | 2673/3000 [1:14:50<06:08,  1.13s/it, lr: 1.0e-04 loss: 4.451e-01]
a-cold-wall:  89%|########9 | 2673/3000 [1:14:50<06:08,  1.13s/it, lr: 1.0e-04 loss: 4.451e-01]
a-cold-wall:  89%|########9 | 2673/3000 [1:14:50<06:08,  1.13s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:  89%|########9 | 2673/3000 [1:14:50<06:08,  1.13s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:  89%|########9 | 2674/3000 [1:14:50<05:33,  1.02s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:  89%|########9 | 2674/3000 [1:14:50<05:33,  1.02s/it, lr: 1.0e-04 loss: 6.282e-01]
a-cold-wall:  89%|########9 | 2674/3000 [1:14:52<05:33,  1.02s/it, lr: 1.0e-04 loss: 6.647e-01]
a-cold-wall:  89%|########9 | 2674/3000 [1:14:52<05:33,  1.02s/it, lr: 1.0e-04 loss: 6.647e-01]
a-cold-wall:  89%|########9 | 2675/3000 [1:14:52<06:07,  1.13s/it, lr: 1.0e-04 loss: 6.647e-01]
a-cold-wall:  89%|########9 | 2675/3000 [1:14:52<06:07,  1.13s/it, lr: 1.0e-04 loss: 6.647e-01]
a-cold-wall:  89%|########9 | 2675/3000 [1:14:53<06:07,  1.13s/it, lr: 1.0e-04 loss: 5.586e-01]
a-cold-wall:  89%|########9 | 2675/3000 [1:14:53<06:07,  1.13s/it, lr: 1.0e-04 loss: 5.586e-01]
a-cold-wall:  89%|########9 | 2676/3000 [1:14:53<05:32,  1.03s/it, lr: 1.0e-04 loss: 5.586e-01]
a-cold-wall:  89%|########9 | 2676/3000 [1:14:53<05:32,  1.03s/it, lr: 1.0e-04 loss: 5.586e-01]
a-cold-wall:  89%|########9 | 2676/3000 [1:14:53<05:32,  1.03s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  89%|########9 | 2676/3000 [1:14:53<05:32,  1.03s/it, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  89%|########9 | 2677/3000 [1:14:53<05:04,  1.06it/s, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  89%|########9 | 2677/3000 [1:14:53<05:04,  1.06it/s, lr: 1.0e-04 loss: 7.082e-01]
a-cold-wall:  89%|########9 | 2677/3000 [1:14:56<05:04,  1.06it/s, lr: 1.0e-04 loss: 5.702e-02]
a-cold-wall:  89%|########9 | 2677/3000 [1:14:56<05:04,  1.06it/s, lr: 1.0e-04 loss: 5.702e-02]
a-cold-wall:  89%|########9 | 2678/3000 [1:14:56<08:12,  1.53s/it, lr: 1.0e-04 loss: 5.702e-02]
a-cold-wall:  89%|########9 | 2678/3000 [1:14:56<08:12,  1.53s/it, lr: 1.0e-04 loss: 5.702e-02]
a-cold-wall:  89%|########9 | 2678/3000 [1:14:57<08:12,  1.53s/it, lr: 1.0e-04 loss: 5.931e-01]
a-cold-wall:  89%|########9 | 2678/3000 [1:14:57<08:12,  1.53s/it, lr: 1.0e-04 loss: 5.931e-01]
a-cold-wall:  89%|########9 | 2679/3000 [1:14:57<06:57,  1.30s/it, lr: 1.0e-04 loss: 5.931e-01]
a-cold-wall:  89%|########9 | 2679/3000 [1:14:57<06:57,  1.30s/it, lr: 1.0e-04 loss: 5.931e-01]
a-cold-wall:  89%|########9 | 2679/3000 [1:15:00<06:57,  1.30s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  89%|########9 | 2679/3000 [1:15:00<06:57,  1.30s/it, lr: 1.0e-04 loss: 2.076e-01]
a-cold-wall:  89%|########9 | 2680/3000 [1:15:01<06:56,  1.30s/it, lr: 1.0e-04 loss: 5.545e-02]
a-cold-wall:  89%|########9 | 2680/3000 [1:15:01<06:56,  1.30s/it, lr: 1.0e-04 loss: 5.545e-02]
a-cold-wall:  89%|########9 | 2681/3000 [1:15:01<04:38,  1.15it/s, lr: 1.0e-04 loss: 5.545e-02]
a-cold-wall:  89%|########9 | 2681/3000 [1:15:01<04:38,  1.15it/s, lr: 1.0e-04 loss: 5.545e-02]
a-cold-wall:  89%|########9 | 2681/3000 [1:15:02<04:38,  1.15it/s, lr: 1.0e-04 loss: 5.386e-01]
a-cold-wall:  89%|########9 | 2681/3000 [1:15:02<04:38,  1.15it/s, lr: 1.0e-04 loss: 5.386e-01]
a-cold-wall:  89%|########9 | 2682/3000 [1:15:02<05:18,  1.00s/it, lr: 1.0e-04 loss: 5.386e-01]
a-cold-wall:  89%|########9 | 2682/3000 [1:15:02<05:18,  1.00s/it, lr: 1.0e-04 loss: 5.386e-01]
a-cold-wall:  89%|########9 | 2682/3000 [1:15:05<05:18,  1.00s/it, lr: 1.0e-04 loss: 6.920e-01]
a-cold-wall:  89%|########9 | 2682/3000 [1:15:05<05:18,  1.00s/it, lr: 1.0e-04 loss: 6.920e-01]
a-cold-wall:  89%|########9 | 2683/3000 [1:15:05<07:50,  1.48s/it, lr: 1.0e-04 loss: 6.920e-01]
a-cold-wall:  89%|########9 | 2683/3000 [1:15:05<07:50,  1.48s/it, lr: 1.0e-04 loss: 6.920e-01]
a-cold-wall:  89%|########9 | 2683/3000 [1:15:08<07:50,  1.48s/it, lr: 1.0e-04 loss: 4.199e-01]
a-cold-wall:  89%|########9 | 2683/3000 [1:15:08<07:50,  1.48s/it, lr: 1.0e-04 loss: 4.199e-01]
a-cold-wall:  89%|########9 | 2684/3000 [1:15:08<09:46,  1.86s/it, lr: 1.0e-04 loss: 4.199e-01]
a-cold-wall:  89%|########9 | 2684/3000 [1:15:08<09:46,  1.86s/it, lr: 1.0e-04 loss: 4.199e-01]
a-cold-wall:  89%|########9 | 2684/3000 [1:15:09<09:46,  1.86s/it, lr: 1.0e-04 loss: 1.827e-01]
a-cold-wall:  89%|########9 | 2684/3000 [1:15:09<09:46,  1.86s/it, lr: 1.0e-04 loss: 1.827e-01]
a-cold-wall:  90%|########9 | 2685/3000 [1:15:09<09:05,  1.73s/it, lr: 1.0e-04 loss: 1.827e-01]
a-cold-wall:  90%|########9 | 2685/3000 [1:15:09<09:05,  1.73s/it, lr: 1.0e-04 loss: 1.827e-01]
a-cold-wall:  90%|########9 | 2685/3000 [1:15:10<09:05,  1.73s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  90%|########9 | 2685/3000 [1:15:10<09:05,  1.73s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  90%|########9 | 2686/3000 [1:15:10<08:35,  1.64s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  90%|########9 | 2686/3000 [1:15:10<08:35,  1.64s/it, lr: 1.0e-04 loss: 4.657e-01]
a-cold-wall:  90%|########9 | 2686/3000 [1:15:11<08:35,  1.64s/it, lr: 1.0e-04 loss: 5.035e-02]
a-cold-wall:  90%|########9 | 2686/3000 [1:15:11<08:35,  1.64s/it, lr: 1.0e-04 loss: 5.035e-02]
a-cold-wall:  90%|########9 | 2687/3000 [1:15:11<07:12,  1.38s/it, lr: 1.0e-04 loss: 5.035e-02]
a-cold-wall:  90%|########9 | 2687/3000 [1:15:11<07:12,  1.38s/it, lr: 1.0e-04 loss: 5.035e-02]
a-cold-wall:  90%|########9 | 2687/3000 [1:15:14<07:12,  1.38s/it, lr: 1.0e-04 loss: 7.580e-01]
a-cold-wall:  90%|########9 | 2687/3000 [1:15:14<07:12,  1.38s/it, lr: 1.0e-04 loss: 7.580e-01]
a-cold-wall:  90%|########9 | 2688/3000 [1:15:14<09:22,  1.80s/it, lr: 1.0e-04 loss: 7.580e-01]
a-cold-wall:  90%|########9 | 2688/3000 [1:15:14<09:22,  1.80s/it, lr: 1.0e-04 loss: 7.580e-01]
a-cold-wall:  90%|########9 | 2688/3000 [1:15:17<09:22,  1.80s/it, lr: 1.0e-04 loss: 1.804e-01]
a-cold-wall:  90%|########9 | 2688/3000 [1:15:17<09:22,  1.80s/it, lr: 1.0e-04 loss: 1.804e-01]
a-cold-wall:  90%|########9 | 2689/3000 [1:15:17<10:57,  2.11s/it, lr: 1.0e-04 loss: 1.804e-01]
a-cold-wall:  90%|########9 | 2689/3000 [1:15:17<10:57,  2.11s/it, lr: 1.0e-04 loss: 1.804e-01]
a-cold-wall:  90%|########9 | 2689/3000 [1:15:18<10:57,  2.11s/it, lr: 1.0e-04 loss: 3.351e-02]
a-cold-wall:  90%|########9 | 2689/3000 [1:15:18<10:57,  2.11s/it, lr: 1.0e-04 loss: 3.351e-02]
a-cold-wall:  90%|########9 | 2690/3000 [1:15:21<10:55,  2.11s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  90%|########9 | 2690/3000 [1:15:21<10:55,  2.11s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  90%|########9 | 2691/3000 [1:15:21<09:14,  1.79s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  90%|########9 | 2691/3000 [1:15:21<09:14,  1.79s/it, lr: 1.0e-04 loss: 4.446e-01]
a-cold-wall:  90%|########9 | 2691/3000 [1:15:22<09:14,  1.79s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  90%|########9 | 2691/3000 [1:15:22<09:14,  1.79s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  90%|########9 | 2692/3000 [1:15:22<07:52,  1.54s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  90%|########9 | 2692/3000 [1:15:22<07:52,  1.54s/it, lr: 1.0e-04 loss: 1.429e-01]
a-cold-wall:  90%|########9 | 2692/3000 [1:15:25<07:52,  1.54s/it, lr: 1.0e-04 loss: 5.593e-02]
a-cold-wall:  90%|########9 | 2692/3000 [1:15:25<07:52,  1.54s/it, lr: 1.0e-04 loss: 5.593e-02]
a-cold-wall:  90%|########9 | 2693/3000 [1:15:25<09:46,  1.91s/it, lr: 1.0e-04 loss: 5.593e-02]
a-cold-wall:  90%|########9 | 2693/3000 [1:15:25<09:46,  1.91s/it, lr: 1.0e-04 loss: 5.593e-02]
a-cold-wall:  90%|########9 | 2693/3000 [1:15:28<09:46,  1.91s/it, lr: 1.0e-04 loss: 3.160e-01]
a-cold-wall:  90%|########9 | 2693/3000 [1:15:28<09:46,  1.91s/it, lr: 1.0e-04 loss: 3.160e-01]
a-cold-wall:  90%|########9 | 2694/3000 [1:15:28<10:59,  2.16s/it, lr: 1.0e-04 loss: 3.160e-01]
a-cold-wall:  90%|########9 | 2694/3000 [1:15:28<10:59,  2.16s/it, lr: 1.0e-04 loss: 3.160e-01]
a-cold-wall:  90%|########9 | 2694/3000 [1:15:29<10:59,  2.16s/it, lr: 1.0e-04 loss: 5.117e-01]
a-cold-wall:  90%|########9 | 2694/3000 [1:15:29<10:59,  2.16s/it, lr: 1.0e-04 loss: 5.117e-01]
a-cold-wall:  90%|########9 | 2695/3000 [1:15:29<10:03,  1.98s/it, lr: 1.0e-04 loss: 5.117e-01]
a-cold-wall:  90%|########9 | 2695/3000 [1:15:29<10:03,  1.98s/it, lr: 1.0e-04 loss: 5.117e-01]
a-cold-wall:  90%|########9 | 2695/3000 [1:15:30<10:03,  1.98s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  90%|########9 | 2695/3000 [1:15:30<10:03,  1.98s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  90%|########9 | 2696/3000 [1:15:30<08:15,  1.63s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  90%|########9 | 2696/3000 [1:15:30<08:15,  1.63s/it, lr: 1.0e-04 loss: 6.552e-01]
a-cold-wall:  90%|########9 | 2696/3000 [1:15:31<08:15,  1.63s/it, lr: 1.0e-04 loss: 3.540e-01]
a-cold-wall:  90%|########9 | 2696/3000 [1:15:31<08:15,  1.63s/it, lr: 1.0e-04 loss: 3.540e-01]
a-cold-wall:  90%|########9 | 2697/3000 [1:15:31<06:56,  1.37s/it, lr: 1.0e-04 loss: 3.540e-01]
a-cold-wall:  90%|########9 | 2697/3000 [1:15:31<06:56,  1.37s/it, lr: 1.0e-04 loss: 3.540e-01]
a-cold-wall:  90%|########9 | 2697/3000 [1:15:34<06:56,  1.37s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:  90%|########9 | 2697/3000 [1:15:34<06:56,  1.37s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:  90%|########9 | 2698/3000 [1:15:34<09:03,  1.80s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:  90%|########9 | 2698/3000 [1:15:34<09:03,  1.80s/it, lr: 1.0e-04 loss: 1.187e-01]
a-cold-wall:  90%|########9 | 2698/3000 [1:15:34<09:03,  1.80s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  90%|########9 | 2698/3000 [1:15:34<09:03,  1.80s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  90%|########9 | 2699/3000 [1:15:34<07:28,  1.49s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  90%|########9 | 2699/3000 [1:15:34<07:28,  1.49s/it, lr: 1.0e-04 loss: 2.675e-01]
a-cold-wall:  90%|########9 | 2699/3000 [1:15:35<07:28,  1.49s/it, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  90%|########9 | 2699/3000 [1:15:35<07:28,  1.49s/it, lr: 1.0e-04 loss: 5.209e-01]
a-cold-wall:  90%|######### | 2700/3000 [1:15:36<07:26,  1.49s/it, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  90%|######### | 2700/3000 [1:15:36<07:26,  1.49s/it, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  90%|######### | 2701/3000 [1:15:36<04:52,  1.02it/s, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  90%|######### | 2701/3000 [1:15:36<04:52,  1.02it/s, lr: 1.0e-04 loss: 3.942e-01]
a-cold-wall:  90%|######### | 2701/3000 [1:15:39<04:52,  1.02it/s, lr: 1.0e-04 loss: 6.298e-01]
a-cold-wall:  90%|######### | 2701/3000 [1:15:39<04:52,  1.02it/s, lr: 1.0e-04 loss: 6.298e-01]
a-cold-wall:  90%|######### | 2702/3000 [1:15:39<07:09,  1.44s/it, lr: 1.0e-04 loss: 6.298e-01]
a-cold-wall:  90%|######### | 2702/3000 [1:15:39<07:09,  1.44s/it, lr: 1.0e-04 loss: 6.298e-01]
a-cold-wall:  90%|######### | 2702/3000 [1:15:40<07:09,  1.44s/it, lr: 1.0e-04 loss: 8.326e-02]
a-cold-wall:  90%|######### | 2702/3000 [1:15:40<07:09,  1.44s/it, lr: 1.0e-04 loss: 8.326e-02]
a-cold-wall:  90%|######### | 2703/3000 [1:15:40<06:14,  1.26s/it, lr: 1.0e-04 loss: 8.326e-02]
a-cold-wall:  90%|######### | 2703/3000 [1:15:40<06:14,  1.26s/it, lr: 1.0e-04 loss: 8.326e-02]
a-cold-wall:  90%|######### | 2703/3000 [1:15:40<06:14,  1.26s/it, lr: 1.0e-04 loss: 4.095e-01]
a-cold-wall:  90%|######### | 2703/3000 [1:15:40<06:14,  1.26s/it, lr: 1.0e-04 loss: 4.095e-01]
a-cold-wall:  90%|######### | 2704/3000 [1:15:40<05:31,  1.12s/it, lr: 1.0e-04 loss: 4.095e-01]
a-cold-wall:  90%|######### | 2704/3000 [1:15:40<05:31,  1.12s/it, lr: 1.0e-04 loss: 4.095e-01]
a-cold-wall:  90%|######### | 2704/3000 [1:15:43<05:31,  1.12s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:  90%|######### | 2704/3000 [1:15:43<05:31,  1.12s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:  90%|######### | 2705/3000 [1:15:43<07:54,  1.61s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:  90%|######### | 2705/3000 [1:15:43<07:54,  1.61s/it, lr: 1.0e-04 loss: 5.392e-01]
a-cold-wall:  90%|######### | 2705/3000 [1:15:46<07:54,  1.61s/it, lr: 1.0e-04 loss: 4.059e-01]
a-cold-wall:  90%|######### | 2705/3000 [1:15:46<07:54,  1.61s/it, lr: 1.0e-04 loss: 4.059e-01]
a-cold-wall:  90%|######### | 2706/3000 [1:15:46<09:38,  1.97s/it, lr: 1.0e-04 loss: 4.059e-01]
a-cold-wall:  90%|######### | 2706/3000 [1:15:46<09:38,  1.97s/it, lr: 1.0e-04 loss: 4.059e-01]
a-cold-wall:  90%|######### | 2706/3000 [1:15:48<09:38,  1.97s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  90%|######### | 2706/3000 [1:15:48<09:38,  1.97s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  90%|######### | 2707/3000 [1:15:48<09:08,  1.87s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  90%|######### | 2707/3000 [1:15:48<09:08,  1.87s/it, lr: 1.0e-04 loss: 1.230e-01]
a-cold-wall:  90%|######### | 2707/3000 [1:15:49<09:08,  1.87s/it, lr: 1.0e-04 loss: 5.293e-01]
a-cold-wall:  90%|######### | 2707/3000 [1:15:49<09:08,  1.87s/it, lr: 1.0e-04 loss: 5.293e-01]
a-cold-wall:  90%|######### | 2708/3000 [1:15:49<08:28,  1.74s/it, lr: 1.0e-04 loss: 5.293e-01]
a-cold-wall:  90%|######### | 2708/3000 [1:15:49<08:28,  1.74s/it, lr: 1.0e-04 loss: 5.293e-01]
a-cold-wall:  90%|######### | 2708/3000 [1:15:50<08:28,  1.74s/it, lr: 1.0e-04 loss: 2.465e-01]
a-cold-wall:  90%|######### | 2708/3000 [1:15:50<08:28,  1.74s/it, lr: 1.0e-04 loss: 2.465e-01]
a-cold-wall:  90%|######### | 2709/3000 [1:15:50<07:01,  1.45s/it, lr: 1.0e-04 loss: 2.465e-01]
a-cold-wall:  90%|######### | 2709/3000 [1:15:50<07:01,  1.45s/it, lr: 1.0e-04 loss: 2.465e-01]
a-cold-wall:  90%|######### | 2709/3000 [1:15:51<07:01,  1.45s/it, lr: 1.0e-04 loss: 5.138e-01]
a-cold-wall:  90%|######### | 2709/3000 [1:15:51<07:01,  1.45s/it, lr: 1.0e-04 loss: 5.138e-01]
a-cold-wall:  90%|######### | 2710/3000 [1:15:54<06:59,  1.45s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  90%|######### | 2710/3000 [1:15:54<06:59,  1.45s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  90%|######### | 2711/3000 [1:15:54<06:55,  1.44s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  90%|######### | 2711/3000 [1:15:54<06:55,  1.44s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  90%|######### | 2711/3000 [1:15:56<06:55,  1.44s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  90%|######### | 2711/3000 [1:15:56<06:55,  1.44s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  90%|######### | 2712/3000 [1:15:56<06:52,  1.43s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  90%|######### | 2712/3000 [1:15:56<06:52,  1.43s/it, lr: 1.0e-04 loss: 1.201e-01]
a-cold-wall:  90%|######### | 2712/3000 [1:15:56<06:52,  1.43s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  90%|######### | 2712/3000 [1:15:56<06:52,  1.43s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  90%|######### | 2713/3000 [1:15:56<05:58,  1.25s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  90%|######### | 2713/3000 [1:15:56<05:58,  1.25s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  90%|######### | 2713/3000 [1:15:57<05:58,  1.25s/it, lr: 1.0e-04 loss: 3.709e-01]
a-cold-wall:  90%|######### | 2713/3000 [1:15:57<05:58,  1.25s/it, lr: 1.0e-04 loss: 3.709e-01]
a-cold-wall:  90%|######### | 2714/3000 [1:15:57<05:18,  1.11s/it, lr: 1.0e-04 loss: 3.709e-01]
a-cold-wall:  90%|######### | 2714/3000 [1:15:57<05:18,  1.11s/it, lr: 1.0e-04 loss: 3.709e-01]
a-cold-wall:  90%|######### | 2714/3000 [1:16:00<05:18,  1.11s/it, lr: 1.0e-04 loss: 7.974e-02]
a-cold-wall:  90%|######### | 2714/3000 [1:16:00<05:18,  1.11s/it, lr: 1.0e-04 loss: 7.974e-02]
a-cold-wall:  90%|######### | 2715/3000 [1:16:00<07:38,  1.61s/it, lr: 1.0e-04 loss: 7.974e-02]
a-cold-wall:  90%|######### | 2715/3000 [1:16:00<07:38,  1.61s/it, lr: 1.0e-04 loss: 7.974e-02]
a-cold-wall:  90%|######### | 2715/3000 [1:16:01<07:38,  1.61s/it, lr: 1.0e-04 loss: 2.657e-01]
a-cold-wall:  90%|######### | 2715/3000 [1:16:01<07:38,  1.61s/it, lr: 1.0e-04 loss: 2.657e-01]
a-cold-wall:  91%|######### | 2716/3000 [1:16:01<06:33,  1.39s/it, lr: 1.0e-04 loss: 2.657e-01]
a-cold-wall:  91%|######### | 2716/3000 [1:16:01<06:33,  1.39s/it, lr: 1.0e-04 loss: 2.657e-01]
a-cold-wall:  91%|######### | 2716/3000 [1:16:01<06:33,  1.39s/it, lr: 1.0e-04 loss: 6.738e-01]
a-cold-wall:  91%|######### | 2716/3000 [1:16:01<06:33,  1.39s/it, lr: 1.0e-04 loss: 6.738e-01]
a-cold-wall:  91%|######### | 2717/3000 [1:16:01<05:38,  1.20s/it, lr: 1.0e-04 loss: 6.738e-01]
a-cold-wall:  91%|######### | 2717/3000 [1:16:01<05:38,  1.20s/it, lr: 1.0e-04 loss: 6.738e-01]
a-cold-wall:  91%|######### | 2717/3000 [1:16:03<05:38,  1.20s/it, lr: 1.0e-04 loss: 1.469e-01]
a-cold-wall:  91%|######### | 2717/3000 [1:16:03<05:38,  1.20s/it, lr: 1.0e-04 loss: 1.469e-01]
a-cold-wall:  91%|######### | 2718/3000 [1:16:03<05:55,  1.26s/it, lr: 1.0e-04 loss: 1.469e-01]
a-cold-wall:  91%|######### | 2718/3000 [1:16:03<05:55,  1.26s/it, lr: 1.0e-04 loss: 1.469e-01]
a-cold-wall:  91%|######### | 2718/3000 [1:16:04<05:55,  1.26s/it, lr: 1.0e-04 loss: 6.751e-02]
a-cold-wall:  91%|######### | 2718/3000 [1:16:04<05:55,  1.26s/it, lr: 1.0e-04 loss: 6.751e-02]
a-cold-wall:  91%|######### | 2719/3000 [1:16:04<06:07,  1.31s/it, lr: 1.0e-04 loss: 6.751e-02]
a-cold-wall:  91%|######### | 2719/3000 [1:16:04<06:07,  1.31s/it, lr: 1.0e-04 loss: 6.751e-02]
a-cold-wall:  91%|######### | 2719/3000 [1:16:05<06:07,  1.31s/it, lr: 1.0e-04 loss: 4.917e-01]
a-cold-wall:  91%|######### | 2719/3000 [1:16:05<06:07,  1.31s/it, lr: 1.0e-04 loss: 4.917e-01]
a-cold-wall:  91%|######### | 2720/3000 [1:16:06<06:06,  1.31s/it, lr: 1.0e-04 loss: 2.517e-01]
a-cold-wall:  91%|######### | 2720/3000 [1:16:06<06:06,  1.31s/it, lr: 1.0e-04 loss: 2.517e-01]
a-cold-wall:  91%|######### | 2721/3000 [1:16:06<04:06,  1.13it/s, lr: 1.0e-04 loss: 2.517e-01]
a-cold-wall:  91%|######### | 2721/3000 [1:16:06<04:06,  1.13it/s, lr: 1.0e-04 loss: 2.517e-01]
a-cold-wall:  91%|######### | 2721/3000 [1:16:07<04:06,  1.13it/s, lr: 1.0e-04 loss: 3.648e-01]
a-cold-wall:  91%|######### | 2721/3000 [1:16:07<04:06,  1.13it/s, lr: 1.0e-04 loss: 3.648e-01]
a-cold-wall:  91%|######### | 2722/3000 [1:16:07<04:41,  1.01s/it, lr: 1.0e-04 loss: 3.648e-01]
a-cold-wall:  91%|######### | 2722/3000 [1:16:07<04:41,  1.01s/it, lr: 1.0e-04 loss: 3.648e-01]
a-cold-wall:  91%|######### | 2722/3000 [1:16:10<04:41,  1.01s/it, lr: 1.0e-04 loss: 8.192e-01]
a-cold-wall:  91%|######### | 2722/3000 [1:16:10<04:41,  1.01s/it, lr: 1.0e-04 loss: 8.192e-01]
a-cold-wall:  91%|######### | 2723/3000 [1:16:10<06:55,  1.50s/it, lr: 1.0e-04 loss: 8.192e-01]
a-cold-wall:  91%|######### | 2723/3000 [1:16:10<06:55,  1.50s/it, lr: 1.0e-04 loss: 8.192e-01]
a-cold-wall:  91%|######### | 2723/3000 [1:16:12<06:55,  1.50s/it, lr: 1.0e-04 loss: 6.239e-01]
a-cold-wall:  91%|######### | 2723/3000 [1:16:12<06:55,  1.50s/it, lr: 1.0e-04 loss: 6.239e-01]
a-cold-wall:  91%|######### | 2724/3000 [1:16:12<06:48,  1.48s/it, lr: 1.0e-04 loss: 6.239e-01]
a-cold-wall:  91%|######### | 2724/3000 [1:16:12<06:48,  1.48s/it, lr: 1.0e-04 loss: 6.239e-01]
a-cold-wall:  91%|######### | 2724/3000 [1:16:13<06:48,  1.48s/it, lr: 1.0e-04 loss: 5.638e-01]
a-cold-wall:  91%|######### | 2724/3000 [1:16:13<06:48,  1.48s/it, lr: 1.0e-04 loss: 5.638e-01]
a-cold-wall:  91%|######### | 2725/3000 [1:16:13<06:07,  1.34s/it, lr: 1.0e-04 loss: 5.638e-01]
a-cold-wall:  91%|######### | 2725/3000 [1:16:13<06:07,  1.34s/it, lr: 1.0e-04 loss: 5.638e-01]
a-cold-wall:  91%|######### | 2725/3000 [1:16:16<06:07,  1.34s/it, lr: 1.0e-04 loss: 4.039e-01]
a-cold-wall:  91%|######### | 2725/3000 [1:16:16<06:07,  1.34s/it, lr: 1.0e-04 loss: 4.039e-01]
a-cold-wall:  91%|######### | 2726/3000 [1:16:16<08:04,  1.77s/it, lr: 1.0e-04 loss: 4.039e-01]
a-cold-wall:  91%|######### | 2726/3000 [1:16:16<08:04,  1.77s/it, lr: 1.0e-04 loss: 4.039e-01]
a-cold-wall:  91%|######### | 2726/3000 [1:16:17<08:04,  1.77s/it, lr: 1.0e-04 loss: 1.805e-01]
a-cold-wall:  91%|######### | 2726/3000 [1:16:17<08:04,  1.77s/it, lr: 1.0e-04 loss: 1.805e-01]
a-cold-wall:  91%|######### | 2727/3000 [1:16:17<07:34,  1.66s/it, lr: 1.0e-04 loss: 1.805e-01]
a-cold-wall:  91%|######### | 2727/3000 [1:16:17<07:34,  1.66s/it, lr: 1.0e-04 loss: 1.805e-01]
a-cold-wall:  91%|######### | 2727/3000 [1:16:18<07:34,  1.66s/it, lr: 1.0e-04 loss: 7.366e-02]
a-cold-wall:  91%|######### | 2727/3000 [1:16:18<07:34,  1.66s/it, lr: 1.0e-04 loss: 7.366e-02]
a-cold-wall:  91%|######### | 2728/3000 [1:16:18<06:19,  1.40s/it, lr: 1.0e-04 loss: 7.366e-02]
a-cold-wall:  91%|######### | 2728/3000 [1:16:18<06:19,  1.40s/it, lr: 1.0e-04 loss: 7.366e-02]
a-cold-wall:  91%|######### | 2728/3000 [1:16:21<06:19,  1.40s/it, lr: 1.0e-04 loss: 5.153e-01]
a-cold-wall:  91%|######### | 2728/3000 [1:16:21<06:19,  1.40s/it, lr: 1.0e-04 loss: 5.153e-01]
a-cold-wall:  91%|######### | 2729/3000 [1:16:21<08:20,  1.85s/it, lr: 1.0e-04 loss: 5.153e-01]
a-cold-wall:  91%|######### | 2729/3000 [1:16:21<08:20,  1.85s/it, lr: 1.0e-04 loss: 5.153e-01]
a-cold-wall:  91%|######### | 2729/3000 [1:16:22<08:20,  1.85s/it, lr: 1.0e-04 loss: 7.348e-01]
a-cold-wall:  91%|######### | 2729/3000 [1:16:22<08:20,  1.85s/it, lr: 1.0e-04 loss: 7.348e-01]
a-cold-wall:  91%|#########1| 2730/3000 [1:16:23<08:19,  1.85s/it, lr: 1.0e-04 loss: 3.386e-02]
a-cold-wall:  91%|#########1| 2730/3000 [1:16:23<08:19,  1.85s/it, lr: 1.0e-04 loss: 3.386e-02]
a-cold-wall:  91%|#########1| 2731/3000 [1:16:23<05:15,  1.17s/it, lr: 1.0e-04 loss: 3.386e-02]
a-cold-wall:  91%|#########1| 2731/3000 [1:16:23<05:15,  1.17s/it, lr: 1.0e-04 loss: 3.386e-02]
a-cold-wall:  91%|#########1| 2731/3000 [1:16:24<05:15,  1.17s/it, lr: 1.0e-04 loss: 4.986e-02]
a-cold-wall:  91%|#########1| 2731/3000 [1:16:24<05:15,  1.17s/it, lr: 1.0e-04 loss: 4.986e-02]
a-cold-wall:  91%|#########1| 2732/3000 [1:16:24<05:31,  1.24s/it, lr: 1.0e-04 loss: 4.986e-02]
a-cold-wall:  91%|#########1| 2732/3000 [1:16:24<05:31,  1.24s/it, lr: 1.0e-04 loss: 4.986e-02]
a-cold-wall:  91%|#########1| 2732/3000 [1:16:27<05:31,  1.24s/it, lr: 1.0e-04 loss: 7.132e-02]
a-cold-wall:  91%|#########1| 2732/3000 [1:16:27<05:31,  1.24s/it, lr: 1.0e-04 loss: 7.132e-02]
a-cold-wall:  91%|#########1| 2733/3000 [1:16:27<07:36,  1.71s/it, lr: 1.0e-04 loss: 7.132e-02]
a-cold-wall:  91%|#########1| 2733/3000 [1:16:27<07:36,  1.71s/it, lr: 1.0e-04 loss: 7.132e-02]
a-cold-wall:  91%|#########1| 2733/3000 [1:16:29<07:36,  1.71s/it, lr: 1.0e-04 loss: 9.961e-02]
a-cold-wall:  91%|#########1| 2733/3000 [1:16:29<07:36,  1.71s/it, lr: 1.0e-04 loss: 9.961e-02]
a-cold-wall:  91%|#########1| 2734/3000 [1:16:29<07:12,  1.63s/it, lr: 1.0e-04 loss: 9.961e-02]
a-cold-wall:  91%|#########1| 2734/3000 [1:16:29<07:12,  1.63s/it, lr: 1.0e-04 loss: 9.961e-02]
a-cold-wall:  91%|#########1| 2734/3000 [1:16:29<07:12,  1.63s/it, lr: 1.0e-04 loss: 2.189e-01]
a-cold-wall:  91%|#########1| 2734/3000 [1:16:29<07:12,  1.63s/it, lr: 1.0e-04 loss: 2.189e-01]
a-cold-wall:  91%|#########1| 2735/3000 [1:16:29<06:06,  1.38s/it, lr: 1.0e-04 loss: 2.189e-01]
a-cold-wall:  91%|#########1| 2735/3000 [1:16:29<06:06,  1.38s/it, lr: 1.0e-04 loss: 2.189e-01]
a-cold-wall:  91%|#########1| 2735/3000 [1:16:30<06:06,  1.38s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  91%|#########1| 2735/3000 [1:16:30<06:06,  1.38s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  91%|#########1| 2736/3000 [1:16:30<05:23,  1.22s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  91%|#########1| 2736/3000 [1:16:30<05:23,  1.22s/it, lr: 1.0e-04 loss: 1.534e-01]
a-cold-wall:  91%|#########1| 2736/3000 [1:16:33<05:23,  1.22s/it, lr: 1.0e-04 loss: 1.031e-01]
a-cold-wall:  91%|#########1| 2736/3000 [1:16:33<05:23,  1.22s/it, lr: 1.0e-04 loss: 1.031e-01]
a-cold-wall:  91%|#########1| 2737/3000 [1:16:33<07:24,  1.69s/it, lr: 1.0e-04 loss: 1.031e-01]
a-cold-wall:  91%|#########1| 2737/3000 [1:16:33<07:24,  1.69s/it, lr: 1.0e-04 loss: 1.031e-01]
a-cold-wall:  91%|#########1| 2737/3000 [1:16:34<07:24,  1.69s/it, lr: 1.0e-04 loss: 3.107e-01]
a-cold-wall:  91%|#########1| 2737/3000 [1:16:34<07:24,  1.69s/it, lr: 1.0e-04 loss: 3.107e-01]
a-cold-wall:  91%|#########1| 2738/3000 [1:16:34<07:02,  1.61s/it, lr: 1.0e-04 loss: 3.107e-01]
a-cold-wall:  91%|#########1| 2738/3000 [1:16:34<07:02,  1.61s/it, lr: 1.0e-04 loss: 3.107e-01]
a-cold-wall:  91%|#########1| 2738/3000 [1:16:35<07:02,  1.61s/it, lr: 1.0e-04 loss: 2.668e-01]
a-cold-wall:  91%|#########1| 2738/3000 [1:16:35<07:02,  1.61s/it, lr: 1.0e-04 loss: 2.668e-01]
a-cold-wall:  91%|#########1| 2739/3000 [1:16:35<05:54,  1.36s/it, lr: 1.0e-04 loss: 2.668e-01]
a-cold-wall:  91%|#########1| 2739/3000 [1:16:35<05:54,  1.36s/it, lr: 1.0e-04 loss: 2.668e-01]
a-cold-wall:  91%|#########1| 2739/3000 [1:16:38<05:54,  1.36s/it, lr: 1.0e-04 loss: 5.236e-01]
a-cold-wall:  91%|#########1| 2739/3000 [1:16:38<05:54,  1.36s/it, lr: 1.0e-04 loss: 5.236e-01]
a-cold-wall:  91%|#########1| 2740/3000 [1:16:41<05:53,  1.36s/it, lr: 1.0e-04 loss: 1.587e-01]
a-cold-wall:  91%|#########1| 2740/3000 [1:16:41<05:53,  1.36s/it, lr: 1.0e-04 loss: 1.587e-01]
a-cold-wall:  91%|#########1| 2741/3000 [1:16:41<05:59,  1.39s/it, lr: 1.0e-04 loss: 1.587e-01]
a-cold-wall:  91%|#########1| 2741/3000 [1:16:41<05:59,  1.39s/it, lr: 1.0e-04 loss: 1.587e-01]
a-cold-wall:  91%|#########1| 2741/3000 [1:16:42<05:59,  1.39s/it, lr: 1.0e-04 loss: 6.190e-01]
a-cold-wall:  91%|#########1| 2741/3000 [1:16:42<05:59,  1.39s/it, lr: 1.0e-04 loss: 6.190e-01]
a-cold-wall:  91%|#########1| 2742/3000 [1:16:42<05:17,  1.23s/it, lr: 1.0e-04 loss: 6.190e-01]
a-cold-wall:  91%|#########1| 2742/3000 [1:16:42<05:17,  1.23s/it, lr: 1.0e-04 loss: 6.190e-01]
a-cold-wall:  91%|#########1| 2742/3000 [1:16:45<05:17,  1.23s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  91%|#########1| 2742/3000 [1:16:45<05:17,  1.23s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  91%|#########1| 2743/3000 [1:16:45<07:03,  1.65s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  91%|#########1| 2743/3000 [1:16:45<07:03,  1.65s/it, lr: 1.0e-04 loss: 5.607e-01]
a-cold-wall:  91%|#########1| 2743/3000 [1:16:45<07:03,  1.65s/it, lr: 1.0e-04 loss: 7.111e-01]
a-cold-wall:  91%|#########1| 2743/3000 [1:16:45<07:03,  1.65s/it, lr: 1.0e-04 loss: 7.111e-01]
a-cold-wall:  91%|#########1| 2744/3000 [1:16:45<05:59,  1.40s/it, lr: 1.0e-04 loss: 7.111e-01]
a-cold-wall:  91%|#########1| 2744/3000 [1:16:45<05:59,  1.40s/it, lr: 1.0e-04 loss: 7.111e-01]
a-cold-wall:  91%|#########1| 2744/3000 [1:16:46<05:59,  1.40s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  91%|#########1| 2744/3000 [1:16:46<05:59,  1.40s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  92%|#########1| 2745/3000 [1:16:46<05:11,  1.22s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  92%|#########1| 2745/3000 [1:16:46<05:11,  1.22s/it, lr: 1.0e-04 loss: 6.036e-01]
a-cold-wall:  92%|#########1| 2745/3000 [1:16:47<05:11,  1.22s/it, lr: 1.0e-04 loss: 4.435e-01]
a-cold-wall:  92%|#########1| 2745/3000 [1:16:47<05:11,  1.22s/it, lr: 1.0e-04 loss: 4.435e-01]
a-cold-wall:  92%|#########1| 2746/3000 [1:16:47<04:36,  1.09s/it, lr: 1.0e-04 loss: 4.435e-01]
a-cold-wall:  92%|#########1| 2746/3000 [1:16:47<04:36,  1.09s/it, lr: 1.0e-04 loss: 4.435e-01]
a-cold-wall:  92%|#########1| 2746/3000 [1:16:50<04:36,  1.09s/it, lr: 1.0e-04 loss: 4.804e-01]
a-cold-wall:  92%|#########1| 2746/3000 [1:16:50<04:36,  1.09s/it, lr: 1.0e-04 loss: 4.804e-01]
a-cold-wall:  92%|#########1| 2747/3000 [1:16:50<06:49,  1.62s/it, lr: 1.0e-04 loss: 4.804e-01]
a-cold-wall:  92%|#########1| 2747/3000 [1:16:50<06:49,  1.62s/it, lr: 1.0e-04 loss: 4.804e-01]
a-cold-wall:  92%|#########1| 2747/3000 [1:16:51<06:49,  1.62s/it, lr: 1.0e-04 loss: 4.993e-01]
a-cold-wall:  92%|#########1| 2747/3000 [1:16:51<06:49,  1.62s/it, lr: 1.0e-04 loss: 4.993e-01]
a-cold-wall:  92%|#########1| 2748/3000 [1:16:51<06:16,  1.49s/it, lr: 1.0e-04 loss: 4.993e-01]
a-cold-wall:  92%|#########1| 2748/3000 [1:16:51<06:16,  1.49s/it, lr: 1.0e-04 loss: 4.993e-01]
a-cold-wall:  92%|#########1| 2748/3000 [1:16:52<06:16,  1.49s/it, lr: 1.0e-04 loss: 1.586e-02]
a-cold-wall:  92%|#########1| 2748/3000 [1:16:52<06:16,  1.49s/it, lr: 1.0e-04 loss: 1.586e-02]
a-cold-wall:  92%|#########1| 2749/3000 [1:16:52<05:19,  1.27s/it, lr: 1.0e-04 loss: 1.586e-02]
a-cold-wall:  92%|#########1| 2749/3000 [1:16:52<05:19,  1.27s/it, lr: 1.0e-04 loss: 1.586e-02]
a-cold-wall:  92%|#########1| 2749/3000 [1:16:52<05:19,  1.27s/it, lr: 1.0e-04 loss: 2.081e-01]
a-cold-wall:  92%|#########1| 2749/3000 [1:16:52<05:19,  1.27s/it, lr: 1.0e-04 loss: 2.081e-01]
Saving at step 2750
Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall_000002750.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt
Removing old save: /data/app/output/a-cold-wall/a-cold-wall_000001750.safetensors

a-cold-wall:  92%|#########1| 2750/3000 [1:16:55<05:18,  1.27s/it, lr: 1.0e-04 loss: 1.232e-01]
a-cold-wall:  92%|#########1| 2750/3000 [1:16:55<05:18,  1.27s/it, lr: 1.0e-04 loss: 1.232e-01]
a-cold-wall:  92%|#########1| 2751/3000 [1:16:56<05:49,  1.40s/it, lr: 1.0e-04 loss: 1.232e-01]
a-cold-wall:  92%|#########1| 2751/3000 [1:16:56<05:49,  1.40s/it, lr: 1.0e-04 loss: 1.232e-01]
a-cold-wall:  92%|#########1| 2751/3000 [1:16:58<05:49,  1.40s/it, lr: 1.0e-04 loss: 6.790e-02]
a-cold-wall:  92%|#########1| 2751/3000 [1:16:58<05:49,  1.40s/it, lr: 1.0e-04 loss: 6.790e-02]
a-cold-wall:  92%|#########1| 2752/3000 [1:16:58<07:15,  1.76s/it, lr: 1.0e-04 loss: 6.790e-02]
a-cold-wall:  92%|#########1| 2752/3000 [1:16:58<07:15,  1.76s/it, lr: 1.0e-04 loss: 6.790e-02]
a-cold-wall:  92%|#########1| 2752/3000 [1:17:00<07:15,  1.76s/it, lr: 1.0e-04 loss: 4.830e-01]
a-cold-wall:  92%|#########1| 2752/3000 [1:17:00<07:15,  1.76s/it, lr: 1.0e-04 loss: 4.830e-01]
a-cold-wall:  92%|#########1| 2753/3000 [1:17:00<06:53,  1.67s/it, lr: 1.0e-04 loss: 4.830e-01]
a-cold-wall:  92%|#########1| 2753/3000 [1:17:00<06:53,  1.67s/it, lr: 1.0e-04 loss: 4.830e-01]
a-cold-wall:  92%|#########1| 2753/3000 [1:17:03<06:53,  1.67s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  92%|#########1| 2753/3000 [1:17:03<06:53,  1.67s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  92%|#########1| 2754/3000 [1:17:03<08:09,  1.99s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  92%|#########1| 2754/3000 [1:17:03<08:09,  1.99s/it, lr: 1.0e-04 loss: 2.075e-01]
a-cold-wall:  92%|#########1| 2754/3000 [1:17:04<08:09,  1.99s/it, lr: 1.0e-04 loss: 2.240e-01]
a-cold-wall:  92%|#########1| 2754/3000 [1:17:04<08:09,  1.99s/it, lr: 1.0e-04 loss: 2.240e-01]
a-cold-wall:  92%|#########1| 2755/3000 [1:17:04<07:35,  1.86s/it, lr: 1.0e-04 loss: 2.240e-01]
a-cold-wall:  92%|#########1| 2755/3000 [1:17:04<07:35,  1.86s/it, lr: 1.0e-04 loss: 2.240e-01]
a-cold-wall:  92%|#########1| 2755/3000 [1:17:07<07:35,  1.86s/it, lr: 1.0e-04 loss: 1.631e-01]
a-cold-wall:  92%|#########1| 2755/3000 [1:17:07<07:35,  1.86s/it, lr: 1.0e-04 loss: 1.631e-01]
a-cold-wall:  92%|#########1| 2756/3000 [1:17:07<08:44,  2.15s/it, lr: 1.0e-04 loss: 1.631e-01]
a-cold-wall:  92%|#########1| 2756/3000 [1:17:07<08:44,  2.15s/it, lr: 1.0e-04 loss: 1.631e-01]
a-cold-wall:  92%|#########1| 2756/3000 [1:17:10<08:44,  2.15s/it, lr: 1.0e-04 loss: 3.654e-01]
a-cold-wall:  92%|#########1| 2756/3000 [1:17:10<08:44,  2.15s/it, lr: 1.0e-04 loss: 3.654e-01]
a-cold-wall:  92%|#########1| 2757/3000 [1:17:10<09:33,  2.36s/it, lr: 1.0e-04 loss: 3.654e-01]
a-cold-wall:  92%|#########1| 2757/3000 [1:17:10<09:33,  2.36s/it, lr: 1.0e-04 loss: 3.654e-01]
a-cold-wall:  92%|#########1| 2757/3000 [1:17:11<09:33,  2.36s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  92%|#########1| 2757/3000 [1:17:11<09:33,  2.36s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  92%|#########1| 2758/3000 [1:17:11<08:26,  2.09s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  92%|#########1| 2758/3000 [1:17:11<08:26,  2.09s/it, lr: 1.0e-04 loss: 5.715e-01]
a-cold-wall:  92%|#########1| 2758/3000 [1:17:13<08:26,  2.09s/it, lr: 1.0e-04 loss: 6.453e-02]
a-cold-wall:  92%|#########1| 2758/3000 [1:17:13<08:26,  2.09s/it, lr: 1.0e-04 loss: 6.453e-02]
a-cold-wall:  92%|#########1| 2759/3000 [1:17:13<07:36,  1.90s/it, lr: 1.0e-04 loss: 6.453e-02]
a-cold-wall:  92%|#########1| 2759/3000 [1:17:13<07:36,  1.90s/it, lr: 1.0e-04 loss: 6.453e-02]
a-cold-wall:  92%|#########1| 2759/3000 [1:17:14<07:36,  1.90s/it, lr: 1.0e-04 loss: 6.522e-01]
a-cold-wall:  92%|#########1| 2759/3000 [1:17:14<07:36,  1.90s/it, lr: 1.0e-04 loss: 6.522e-01]
a-cold-wall:  92%|#########2| 2760/3000 [1:17:14<07:34,  1.90s/it, lr: 1.0e-04 loss: 6.701e-01]
a-cold-wall:  92%|#########2| 2760/3000 [1:17:14<07:34,  1.90s/it, lr: 1.0e-04 loss: 6.701e-01]
a-cold-wall:  92%|#########2| 2761/3000 [1:17:14<04:46,  1.20s/it, lr: 1.0e-04 loss: 6.701e-01]
a-cold-wall:  92%|#########2| 2761/3000 [1:17:14<04:46,  1.20s/it, lr: 1.0e-04 loss: 6.701e-01]
a-cold-wall:  92%|#########2| 2761/3000 [1:17:17<04:46,  1.20s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  92%|#########2| 2761/3000 [1:17:17<04:46,  1.20s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  92%|#########2| 2762/3000 [1:17:17<06:24,  1.61s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  92%|#########2| 2762/3000 [1:17:17<06:24,  1.61s/it, lr: 1.0e-04 loss: 2.854e-01]
a-cold-wall:  92%|#########2| 2762/3000 [1:17:20<06:24,  1.61s/it, lr: 1.0e-04 loss: 2.395e-01]
a-cold-wall:  92%|#########2| 2762/3000 [1:17:20<06:24,  1.61s/it, lr: 1.0e-04 loss: 2.395e-01]
a-cold-wall:  92%|#########2| 2763/3000 [1:17:20<07:47,  1.97s/it, lr: 1.0e-04 loss: 2.395e-01]
a-cold-wall:  92%|#########2| 2763/3000 [1:17:20<07:47,  1.97s/it, lr: 1.0e-04 loss: 2.395e-01]
a-cold-wall:  92%|#########2| 2763/3000 [1:17:22<07:47,  1.97s/it, lr: 1.0e-04 loss: 1.868e-01]
a-cold-wall:  92%|#########2| 2763/3000 [1:17:22<07:47,  1.97s/it, lr: 1.0e-04 loss: 1.868e-01]
a-cold-wall:  92%|#########2| 2764/3000 [1:17:22<07:11,  1.83s/it, lr: 1.0e-04 loss: 1.868e-01]
a-cold-wall:  92%|#########2| 2764/3000 [1:17:22<07:11,  1.83s/it, lr: 1.0e-04 loss: 1.868e-01]
a-cold-wall:  92%|#########2| 2764/3000 [1:17:24<07:11,  1.83s/it, lr: 1.0e-04 loss: 3.164e-01]
a-cold-wall:  92%|#########2| 2764/3000 [1:17:24<07:11,  1.83s/it, lr: 1.0e-04 loss: 3.164e-01]
a-cold-wall:  92%|#########2| 2765/3000 [1:17:24<08:17,  2.12s/it, lr: 1.0e-04 loss: 3.164e-01]
a-cold-wall:  92%|#########2| 2765/3000 [1:17:24<08:17,  2.12s/it, lr: 1.0e-04 loss: 3.164e-01]
a-cold-wall:  92%|#########2| 2765/3000 [1:17:26<08:17,  2.12s/it, lr: 1.0e-04 loss: 5.042e-01]
a-cold-wall:  92%|#########2| 2765/3000 [1:17:26<08:17,  2.12s/it, lr: 1.0e-04 loss: 5.042e-01]
a-cold-wall:  92%|#########2| 2766/3000 [1:17:26<07:29,  1.92s/it, lr: 1.0e-04 loss: 5.042e-01]
a-cold-wall:  92%|#########2| 2766/3000 [1:17:26<07:29,  1.92s/it, lr: 1.0e-04 loss: 5.042e-01]
a-cold-wall:  92%|#########2| 2766/3000 [1:17:29<07:29,  1.92s/it, lr: 1.0e-04 loss: 2.750e-01]
a-cold-wall:  92%|#########2| 2766/3000 [1:17:29<07:29,  1.92s/it, lr: 1.0e-04 loss: 2.750e-01]
a-cold-wall:  92%|#########2| 2767/3000 [1:17:29<08:30,  2.19s/it, lr: 1.0e-04 loss: 2.750e-01]
a-cold-wall:  92%|#########2| 2767/3000 [1:17:29<08:30,  2.19s/it, lr: 1.0e-04 loss: 2.750e-01]
a-cold-wall:  92%|#########2| 2767/3000 [1:17:32<08:30,  2.19s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  92%|#########2| 2767/3000 [1:17:32<08:30,  2.19s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  92%|#########2| 2768/3000 [1:17:32<09:15,  2.40s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  92%|#########2| 2768/3000 [1:17:32<09:15,  2.40s/it, lr: 1.0e-04 loss: 3.661e-01]
a-cold-wall:  92%|#########2| 2768/3000 [1:17:33<09:15,  2.40s/it, lr: 1.0e-04 loss: 5.351e-01]
a-cold-wall:  92%|#########2| 2768/3000 [1:17:33<09:15,  2.40s/it, lr: 1.0e-04 loss: 5.351e-01]
a-cold-wall:  92%|#########2| 2769/3000 [1:17:33<08:07,  2.11s/it, lr: 1.0e-04 loss: 5.351e-01]
a-cold-wall:  92%|#########2| 2769/3000 [1:17:33<08:07,  2.11s/it, lr: 1.0e-04 loss: 5.351e-01]
a-cold-wall:  92%|#########2| 2769/3000 [1:17:34<08:07,  2.11s/it, lr: 1.0e-04 loss: 7.494e-02]
a-cold-wall:  92%|#########2| 2769/3000 [1:17:34<08:07,  2.11s/it, lr: 1.0e-04 loss: 7.494e-02]
a-cold-wall:  92%|#########2| 2770/3000 [1:17:35<08:05,  2.11s/it, lr: 1.0e-04 loss: 4.520e-01]
a-cold-wall:  92%|#########2| 2770/3000 [1:17:35<08:05,  2.11s/it, lr: 1.0e-04 loss: 4.520e-01]
a-cold-wall:  92%|#########2| 2771/3000 [1:17:35<05:37,  1.48s/it, lr: 1.0e-04 loss: 4.520e-01]
a-cold-wall:  92%|#########2| 2771/3000 [1:17:35<05:37,  1.48s/it, lr: 1.0e-04 loss: 4.520e-01]
a-cold-wall:  92%|#########2| 2771/3000 [1:17:38<05:37,  1.48s/it, lr: 1.0e-04 loss: 2.474e-02]
a-cold-wall:  92%|#########2| 2771/3000 [1:17:38<05:37,  1.48s/it, lr: 1.0e-04 loss: 2.474e-02]
a-cold-wall:  92%|#########2| 2772/3000 [1:17:38<06:56,  1.82s/it, lr: 1.0e-04 loss: 2.474e-02]
a-cold-wall:  92%|#########2| 2772/3000 [1:17:38<06:56,  1.82s/it, lr: 1.0e-04 loss: 2.474e-02]
a-cold-wall:  92%|#########2| 2772/3000 [1:17:41<06:56,  1.82s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  92%|#########2| 2772/3000 [1:17:41<06:56,  1.82s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  92%|#########2| 2773/3000 [1:17:41<07:55,  2.10s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  92%|#########2| 2773/3000 [1:17:41<07:55,  2.10s/it, lr: 1.0e-04 loss: 7.384e-01]
a-cold-wall:  92%|#########2| 2773/3000 [1:17:44<07:55,  2.10s/it, lr: 1.0e-04 loss: 2.473e-01]
a-cold-wall:  92%|#########2| 2773/3000 [1:17:44<07:55,  2.10s/it, lr: 1.0e-04 loss: 2.473e-01]
a-cold-wall:  92%|#########2| 2774/3000 [1:17:44<08:40,  2.30s/it, lr: 1.0e-04 loss: 2.473e-01]
a-cold-wall:  92%|#########2| 2774/3000 [1:17:44<08:40,  2.30s/it, lr: 1.0e-04 loss: 2.473e-01]
a-cold-wall:  92%|#########2| 2774/3000 [1:17:47<08:40,  2.30s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:  92%|#########2| 2774/3000 [1:17:47<08:40,  2.30s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:  92%|#########2| 2775/3000 [1:17:47<09:16,  2.47s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:  92%|#########2| 2775/3000 [1:17:47<09:16,  2.47s/it, lr: 1.0e-04 loss: 1.372e-01]
a-cold-wall:  92%|#########2| 2775/3000 [1:17:50<09:16,  2.47s/it, lr: 1.0e-04 loss: 6.344e-01]
a-cold-wall:  92%|#########2| 2775/3000 [1:17:50<09:16,  2.47s/it, lr: 1.0e-04 loss: 6.344e-01]
a-cold-wall:  93%|#########2| 2776/3000 [1:17:50<09:41,  2.60s/it, lr: 1.0e-04 loss: 6.344e-01]
a-cold-wall:  93%|#########2| 2776/3000 [1:17:50<09:41,  2.60s/it, lr: 1.0e-04 loss: 6.344e-01]
a-cold-wall:  93%|#########2| 2776/3000 [1:17:53<09:41,  2.60s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  93%|#########2| 2776/3000 [1:17:53<09:41,  2.60s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  93%|#########2| 2777/3000 [1:17:53<09:59,  2.69s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  93%|#########2| 2777/3000 [1:17:53<09:59,  2.69s/it, lr: 1.0e-04 loss: 1.464e-01]
a-cold-wall:  93%|#########2| 2777/3000 [1:17:54<09:59,  2.69s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  93%|#########2| 2777/3000 [1:17:54<09:59,  2.69s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  93%|#########2| 2778/3000 [1:17:54<08:06,  2.19s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  93%|#########2| 2778/3000 [1:17:54<08:06,  2.19s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  93%|#########2| 2778/3000 [1:17:54<08:06,  2.19s/it, lr: 1.0e-04 loss: 6.347e-01]
a-cold-wall:  93%|#########2| 2778/3000 [1:17:54<08:06,  2.19s/it, lr: 1.0e-04 loss: 6.347e-01]
a-cold-wall:  93%|#########2| 2779/3000 [1:17:54<06:30,  1.77s/it, lr: 1.0e-04 loss: 6.347e-01]
a-cold-wall:  93%|#########2| 2779/3000 [1:17:54<06:30,  1.77s/it, lr: 1.0e-04 loss: 6.347e-01]
a-cold-wall:  93%|#########2| 2779/3000 [1:17:57<06:30,  1.77s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  93%|#########2| 2779/3000 [1:17:57<06:30,  1.77s/it, lr: 1.0e-04 loss: 3.021e-01]
a-cold-wall:  93%|#########2| 2780/3000 [1:18:00<06:28,  1.77s/it, lr: 1.0e-04 loss: 4.986e-01]
a-cold-wall:  93%|#########2| 2780/3000 [1:18:00<06:28,  1.77s/it, lr: 1.0e-04 loss: 4.986e-01]
a-cold-wall:  93%|#########2| 2781/3000 [1:18:00<05:53,  1.61s/it, lr: 1.0e-04 loss: 4.986e-01]
a-cold-wall:  93%|#########2| 2781/3000 [1:18:00<05:53,  1.61s/it, lr: 1.0e-04 loss: 4.986e-01]
a-cold-wall:  93%|#########2| 2781/3000 [1:18:02<05:53,  1.61s/it, lr: 1.0e-04 loss: 1.542e-02]
a-cold-wall:  93%|#########2| 2781/3000 [1:18:02<05:53,  1.61s/it, lr: 1.0e-04 loss: 1.542e-02]
a-cold-wall:  93%|#########2| 2782/3000 [1:18:02<05:42,  1.57s/it, lr: 1.0e-04 loss: 1.542e-02]
a-cold-wall:  93%|#########2| 2782/3000 [1:18:02<05:42,  1.57s/it, lr: 1.0e-04 loss: 1.542e-02]
a-cold-wall:  93%|#########2| 2782/3000 [1:18:04<05:42,  1.57s/it, lr: 1.0e-04 loss: 5.749e-02]
a-cold-wall:  93%|#########2| 2782/3000 [1:18:04<05:42,  1.57s/it, lr: 1.0e-04 loss: 5.749e-02]
a-cold-wall:  93%|#########2| 2783/3000 [1:18:04<06:56,  1.92s/it, lr: 1.0e-04 loss: 5.749e-02]
a-cold-wall:  93%|#########2| 2783/3000 [1:18:04<06:56,  1.92s/it, lr: 1.0e-04 loss: 5.749e-02]
a-cold-wall:  93%|#########2| 2783/3000 [1:18:06<06:56,  1.92s/it, lr: 1.0e-04 loss: 2.282e-02]
a-cold-wall:  93%|#########2| 2783/3000 [1:18:06<06:56,  1.92s/it, lr: 1.0e-04 loss: 2.282e-02]
a-cold-wall:  93%|#########2| 2784/3000 [1:18:06<06:25,  1.79s/it, lr: 1.0e-04 loss: 2.282e-02]
a-cold-wall:  93%|#########2| 2784/3000 [1:18:06<06:25,  1.79s/it, lr: 1.0e-04 loss: 2.282e-02]
a-cold-wall:  93%|#########2| 2784/3000 [1:18:07<06:25,  1.79s/it, lr: 1.0e-04 loss: 5.799e-01]
a-cold-wall:  93%|#########2| 2784/3000 [1:18:07<06:25,  1.79s/it, lr: 1.0e-04 loss: 5.799e-01]
a-cold-wall:  93%|#########2| 2785/3000 [1:18:07<05:22,  1.50s/it, lr: 1.0e-04 loss: 5.799e-01]
a-cold-wall:  93%|#########2| 2785/3000 [1:18:07<05:22,  1.50s/it, lr: 1.0e-04 loss: 5.799e-01]
a-cold-wall:  93%|#########2| 2785/3000 [1:18:07<05:22,  1.50s/it, lr: 1.0e-04 loss: 6.400e-02]
a-cold-wall:  93%|#########2| 2785/3000 [1:18:07<05:22,  1.50s/it, lr: 1.0e-04 loss: 6.400e-02]
a-cold-wall:  93%|#########2| 2786/3000 [1:18:07<04:35,  1.29s/it, lr: 1.0e-04 loss: 6.400e-02]
a-cold-wall:  93%|#########2| 2786/3000 [1:18:07<04:35,  1.29s/it, lr: 1.0e-04 loss: 6.400e-02]
a-cold-wall:  93%|#########2| 2786/3000 [1:18:10<04:35,  1.29s/it, lr: 1.0e-04 loss: 5.618e-01]
a-cold-wall:  93%|#########2| 2786/3000 [1:18:10<04:35,  1.29s/it, lr: 1.0e-04 loss: 5.618e-01]
a-cold-wall:  93%|#########2| 2787/3000 [1:18:10<06:12,  1.75s/it, lr: 1.0e-04 loss: 5.618e-01]
a-cold-wall:  93%|#########2| 2787/3000 [1:18:10<06:12,  1.75s/it, lr: 1.0e-04 loss: 5.618e-01]
a-cold-wall:  93%|#########2| 2787/3000 [1:18:13<06:12,  1.75s/it, lr: 1.0e-04 loss: 8.728e-02]
a-cold-wall:  93%|#########2| 2787/3000 [1:18:13<06:12,  1.75s/it, lr: 1.0e-04 loss: 8.728e-02]
a-cold-wall:  93%|#########2| 2788/3000 [1:18:13<07:18,  2.07s/it, lr: 1.0e-04 loss: 8.728e-02]
a-cold-wall:  93%|#########2| 2788/3000 [1:18:13<07:18,  2.07s/it, lr: 1.0e-04 loss: 8.728e-02]
a-cold-wall:  93%|#########2| 2788/3000 [1:18:14<07:18,  2.07s/it, lr: 1.0e-04 loss: 2.914e-01]
a-cold-wall:  93%|#########2| 2788/3000 [1:18:14<07:18,  2.07s/it, lr: 1.0e-04 loss: 2.914e-01]
a-cold-wall:  93%|#########2| 2789/3000 [1:18:14<05:54,  1.68s/it, lr: 1.0e-04 loss: 2.914e-01]
a-cold-wall:  93%|#########2| 2789/3000 [1:18:14<05:54,  1.68s/it, lr: 1.0e-04 loss: 2.914e-01]
a-cold-wall:  93%|#########2| 2789/3000 [1:18:17<05:54,  1.68s/it, lr: 1.0e-04 loss: 6.323e-01]
a-cold-wall:  93%|#########2| 2789/3000 [1:18:17<05:54,  1.68s/it, lr: 1.0e-04 loss: 6.323e-01]
a-cold-wall:  93%|#########3| 2790/3000 [1:18:20<05:53,  1.68s/it, lr: 1.0e-04 loss: 1.766e-01]
a-cold-wall:  93%|#########3| 2790/3000 [1:18:20<05:53,  1.68s/it, lr: 1.0e-04 loss: 1.766e-01]
a-cold-wall:  93%|#########3| 2791/3000 [1:18:20<05:27,  1.57s/it, lr: 1.0e-04 loss: 1.766e-01]
a-cold-wall:  93%|#########3| 2791/3000 [1:18:20<05:27,  1.57s/it, lr: 1.0e-04 loss: 1.766e-01]
a-cold-wall:  93%|#########3| 2791/3000 [1:18:23<05:27,  1.57s/it, lr: 1.0e-04 loss: 4.856e-01]
a-cold-wall:  93%|#########3| 2791/3000 [1:18:23<05:27,  1.57s/it, lr: 1.0e-04 loss: 4.856e-01]
a-cold-wall:  93%|#########3| 2792/3000 [1:18:23<06:37,  1.91s/it, lr: 1.0e-04 loss: 4.856e-01]
a-cold-wall:  93%|#########3| 2792/3000 [1:18:23<06:37,  1.91s/it, lr: 1.0e-04 loss: 4.856e-01]
a-cold-wall:  93%|#########3| 2792/3000 [1:18:23<06:37,  1.91s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  93%|#########3| 2792/3000 [1:18:23<06:37,  1.91s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  93%|#########3| 2793/3000 [1:18:23<05:33,  1.61s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  93%|#########3| 2793/3000 [1:18:23<05:33,  1.61s/it, lr: 1.0e-04 loss: 3.553e-01]
a-cold-wall:  93%|#########3| 2793/3000 [1:18:25<05:33,  1.61s/it, lr: 1.0e-04 loss: 7.685e-01]
a-cold-wall:  93%|#########3| 2793/3000 [1:18:25<05:33,  1.61s/it, lr: 1.0e-04 loss: 7.685e-01]
a-cold-wall:  93%|#########3| 2794/3000 [1:18:25<05:21,  1.56s/it, lr: 1.0e-04 loss: 7.685e-01]
a-cold-wall:  93%|#########3| 2794/3000 [1:18:25<05:21,  1.56s/it, lr: 1.0e-04 loss: 7.685e-01]
a-cold-wall:  93%|#########3| 2794/3000 [1:18:26<05:21,  1.56s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  93%|#########3| 2794/3000 [1:18:26<05:21,  1.56s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  93%|#########3| 2795/3000 [1:18:26<05:12,  1.53s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  93%|#########3| 2795/3000 [1:18:26<05:12,  1.53s/it, lr: 1.0e-04 loss: 2.082e-01]
a-cold-wall:  93%|#########3| 2795/3000 [1:18:27<05:12,  1.53s/it, lr: 1.0e-04 loss: 5.855e-01]
a-cold-wall:  93%|#########3| 2795/3000 [1:18:27<05:12,  1.53s/it, lr: 1.0e-04 loss: 5.855e-01]
a-cold-wall:  93%|#########3| 2796/3000 [1:18:27<04:26,  1.30s/it, lr: 1.0e-04 loss: 5.855e-01]
a-cold-wall:  93%|#########3| 2796/3000 [1:18:27<04:26,  1.30s/it, lr: 1.0e-04 loss: 5.855e-01]
a-cold-wall:  93%|#########3| 2796/3000 [1:18:30<04:26,  1.30s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  93%|#########3| 2796/3000 [1:18:30<04:26,  1.30s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  93%|#########3| 2797/3000 [1:18:30<05:54,  1.74s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  93%|#########3| 2797/3000 [1:18:30<05:54,  1.74s/it, lr: 1.0e-04 loss: 6.286e-01]
a-cold-wall:  93%|#########3| 2797/3000 [1:18:31<05:54,  1.74s/it, lr: 1.0e-04 loss: 3.032e-01]
a-cold-wall:  93%|#########3| 2797/3000 [1:18:31<05:54,  1.74s/it, lr: 1.0e-04 loss: 3.032e-01]
a-cold-wall:  93%|#########3| 2798/3000 [1:18:31<05:32,  1.64s/it, lr: 1.0e-04 loss: 3.032e-01]
a-cold-wall:  93%|#########3| 2798/3000 [1:18:31<05:32,  1.64s/it, lr: 1.0e-04 loss: 3.032e-01]
a-cold-wall:  93%|#########3| 2798/3000 [1:18:32<05:32,  1.64s/it, lr: 1.0e-04 loss: 9.020e-02]
a-cold-wall:  93%|#########3| 2798/3000 [1:18:32<05:32,  1.64s/it, lr: 1.0e-04 loss: 9.020e-02]
a-cold-wall:  93%|#########3| 2799/3000 [1:18:32<04:37,  1.38s/it, lr: 1.0e-04 loss: 9.020e-02]
a-cold-wall:  93%|#########3| 2799/3000 [1:18:32<04:37,  1.38s/it, lr: 1.0e-04 loss: 9.020e-02]
a-cold-wall:  93%|#########3| 2799/3000 [1:18:35<04:37,  1.38s/it, lr: 1.0e-04 loss: 8.998e-02]
a-cold-wall:  93%|#########3| 2799/3000 [1:18:35<04:37,  1.38s/it, lr: 1.0e-04 loss: 8.998e-02]
a-cold-wall:  93%|#########3| 2800/3000 [1:18:36<04:36,  1.38s/it, lr: 1.0e-04 loss: 2.442e-01]
a-cold-wall:  93%|#########3| 2800/3000 [1:18:36<04:36,  1.38s/it, lr: 1.0e-04 loss: 2.442e-01]
a-cold-wall:  93%|#########3| 2801/3000 [1:18:36<03:03,  1.09it/s, lr: 1.0e-04 loss: 2.442e-01]
a-cold-wall:  93%|#########3| 2801/3000 [1:18:36<03:03,  1.09it/s, lr: 1.0e-04 loss: 2.442e-01]
a-cold-wall:  93%|#########3| 2801/3000 [1:18:36<03:03,  1.09it/s, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  93%|#########3| 2801/3000 [1:18:36<03:03,  1.09it/s, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  93%|#########3| 2802/3000 [1:18:36<03:04,  1.07it/s, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  93%|#########3| 2802/3000 [1:18:36<03:04,  1.07it/s, lr: 1.0e-04 loss: 4.223e-01]
a-cold-wall:  93%|#########3| 2802/3000 [1:18:37<03:04,  1.07it/s, lr: 1.0e-04 loss: 7.294e-01]
a-cold-wall:  93%|#########3| 2802/3000 [1:18:37<03:04,  1.07it/s, lr: 1.0e-04 loss: 7.294e-01]
a-cold-wall:  93%|#########3| 2803/3000 [1:18:37<02:53,  1.13it/s, lr: 1.0e-04 loss: 7.294e-01]
a-cold-wall:  93%|#########3| 2803/3000 [1:18:37<02:53,  1.13it/s, lr: 1.0e-04 loss: 7.294e-01]
a-cold-wall:  93%|#########3| 2803/3000 [1:18:40<02:53,  1.13it/s, lr: 1.0e-04 loss: 1.439e-01]
a-cold-wall:  93%|#########3| 2803/3000 [1:18:40<02:53,  1.13it/s, lr: 1.0e-04 loss: 1.439e-01]
a-cold-wall:  93%|#########3| 2804/3000 [1:18:40<04:37,  1.42s/it, lr: 1.0e-04 loss: 1.439e-01]
a-cold-wall:  93%|#########3| 2804/3000 [1:18:40<04:37,  1.42s/it, lr: 1.0e-04 loss: 1.439e-01]
a-cold-wall:  93%|#########3| 2804/3000 [1:18:42<04:37,  1.42s/it, lr: 1.0e-04 loss: 6.092e-01]
a-cold-wall:  93%|#########3| 2804/3000 [1:18:42<04:37,  1.42s/it, lr: 1.0e-04 loss: 6.092e-01]
a-cold-wall:  94%|#########3| 2805/3000 [1:18:42<04:47,  1.48s/it, lr: 1.0e-04 loss: 6.092e-01]
a-cold-wall:  94%|#########3| 2805/3000 [1:18:42<04:47,  1.48s/it, lr: 1.0e-04 loss: 6.092e-01]
a-cold-wall:  94%|#########3| 2805/3000 [1:18:43<04:47,  1.48s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  94%|#########3| 2805/3000 [1:18:43<04:47,  1.48s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  94%|#########3| 2806/3000 [1:18:43<04:42,  1.45s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  94%|#########3| 2806/3000 [1:18:43<04:42,  1.45s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  94%|#########3| 2806/3000 [1:18:45<04:42,  1.45s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  94%|#########3| 2806/3000 [1:18:45<04:42,  1.45s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  94%|#########3| 2807/3000 [1:18:45<04:37,  1.44s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  94%|#########3| 2807/3000 [1:18:45<04:37,  1.44s/it, lr: 1.0e-04 loss: 5.834e-01]
a-cold-wall:  94%|#########3| 2807/3000 [1:18:45<04:37,  1.44s/it, lr: 1.0e-04 loss: 2.633e-01]
a-cold-wall:  94%|#########3| 2807/3000 [1:18:45<04:37,  1.44s/it, lr: 1.0e-04 loss: 2.633e-01]
a-cold-wall:  94%|#########3| 2808/3000 [1:18:45<03:58,  1.24s/it, lr: 1.0e-04 loss: 2.633e-01]
a-cold-wall:  94%|#########3| 2808/3000 [1:18:45<03:58,  1.24s/it, lr: 1.0e-04 loss: 2.633e-01]
a-cold-wall:  94%|#########3| 2808/3000 [1:18:46<03:58,  1.24s/it, lr: 1.0e-04 loss: 5.186e-01]
a-cold-wall:  94%|#########3| 2808/3000 [1:18:46<03:58,  1.24s/it, lr: 1.0e-04 loss: 5.186e-01]
a-cold-wall:  94%|#########3| 2809/3000 [1:18:46<03:29,  1.10s/it, lr: 1.0e-04 loss: 5.186e-01]
a-cold-wall:  94%|#########3| 2809/3000 [1:18:46<03:29,  1.10s/it, lr: 1.0e-04 loss: 5.186e-01]
a-cold-wall:  94%|#########3| 2809/3000 [1:18:47<03:29,  1.10s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  94%|#########3| 2809/3000 [1:18:47<03:29,  1.10s/it, lr: 1.0e-04 loss: 6.715e-01]
a-cold-wall:  94%|#########3| 2810/3000 [1:18:48<03:28,  1.10s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  94%|#########3| 2810/3000 [1:18:48<03:28,  1.10s/it, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  94%|#########3| 2811/3000 [1:18:48<02:24,  1.31it/s, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  94%|#########3| 2811/3000 [1:18:48<02:24,  1.31it/s, lr: 1.0e-04 loss: 3.344e-01]
a-cold-wall:  94%|#########3| 2811/3000 [1:18:50<02:24,  1.31it/s, lr: 1.0e-04 loss: 7.030e-01]
a-cold-wall:  94%|#########3| 2811/3000 [1:18:50<02:24,  1.31it/s, lr: 1.0e-04 loss: 7.030e-01]
a-cold-wall:  94%|#########3| 2812/3000 [1:18:50<02:53,  1.08it/s, lr: 1.0e-04 loss: 7.030e-01]
a-cold-wall:  94%|#########3| 2812/3000 [1:18:50<02:53,  1.08it/s, lr: 1.0e-04 loss: 7.030e-01]
a-cold-wall:  94%|#########3| 2812/3000 [1:18:51<02:53,  1.08it/s, lr: 1.0e-04 loss: 5.394e-01]
a-cold-wall:  94%|#########3| 2812/3000 [1:18:51<02:53,  1.08it/s, lr: 1.0e-04 loss: 5.394e-01]
a-cold-wall:  94%|#########3| 2813/3000 [1:18:51<03:16,  1.05s/it, lr: 1.0e-04 loss: 5.394e-01]
a-cold-wall:  94%|#########3| 2813/3000 [1:18:51<03:16,  1.05s/it, lr: 1.0e-04 loss: 5.394e-01]
a-cold-wall:  94%|#########3| 2813/3000 [1:18:52<03:16,  1.05s/it, lr: 1.0e-04 loss: 4.146e-01]
a-cold-wall:  94%|#########3| 2813/3000 [1:18:52<03:16,  1.05s/it, lr: 1.0e-04 loss: 4.146e-01]
a-cold-wall:  94%|#########3| 2814/3000 [1:18:52<03:33,  1.15s/it, lr: 1.0e-04 loss: 4.146e-01]
a-cold-wall:  94%|#########3| 2814/3000 [1:18:52<03:33,  1.15s/it, lr: 1.0e-04 loss: 4.146e-01]
a-cold-wall:  94%|#########3| 2814/3000 [1:18:54<03:33,  1.15s/it, lr: 1.0e-04 loss: 7.598e-01]
a-cold-wall:  94%|#########3| 2814/3000 [1:18:54<03:33,  1.15s/it, lr: 1.0e-04 loss: 7.598e-01]
a-cold-wall:  94%|#########3| 2815/3000 [1:18:54<03:45,  1.22s/it, lr: 1.0e-04 loss: 7.598e-01]
a-cold-wall:  94%|#########3| 2815/3000 [1:18:54<03:45,  1.22s/it, lr: 1.0e-04 loss: 7.598e-01]
a-cold-wall:  94%|#########3| 2815/3000 [1:18:55<03:45,  1.22s/it, lr: 1.0e-04 loss: 4.845e-01]
a-cold-wall:  94%|#########3| 2815/3000 [1:18:55<03:45,  1.22s/it, lr: 1.0e-04 loss: 4.845e-01]
a-cold-wall:  94%|#########3| 2816/3000 [1:18:55<03:54,  1.27s/it, lr: 1.0e-04 loss: 4.845e-01]
a-cold-wall:  94%|#########3| 2816/3000 [1:18:55<03:54,  1.27s/it, lr: 1.0e-04 loss: 4.845e-01]
a-cold-wall:  94%|#########3| 2816/3000 [1:18:56<03:54,  1.27s/it, lr: 1.0e-04 loss: 7.167e-01]
a-cold-wall:  94%|#########3| 2816/3000 [1:18:56<03:54,  1.27s/it, lr: 1.0e-04 loss: 7.167e-01]
a-cold-wall:  94%|#########3| 2817/3000 [1:18:56<03:24,  1.12s/it, lr: 1.0e-04 loss: 7.167e-01]
a-cold-wall:  94%|#########3| 2817/3000 [1:18:56<03:24,  1.12s/it, lr: 1.0e-04 loss: 7.167e-01]
a-cold-wall:  94%|#########3| 2817/3000 [1:18:57<03:24,  1.12s/it, lr: 1.0e-04 loss: 2.690e-01]
a-cold-wall:  94%|#########3| 2817/3000 [1:18:57<03:24,  1.12s/it, lr: 1.0e-04 loss: 2.690e-01]
a-cold-wall:  94%|#########3| 2818/3000 [1:18:57<03:17,  1.08s/it, lr: 1.0e-04 loss: 2.690e-01]
a-cold-wall:  94%|#########3| 2818/3000 [1:18:57<03:17,  1.08s/it, lr: 1.0e-04 loss: 2.690e-01]
a-cold-wall:  94%|#########3| 2818/3000 [1:18:58<03:17,  1.08s/it, lr: 1.0e-04 loss: 1.216e-01]
a-cold-wall:  94%|#########3| 2818/3000 [1:18:58<03:17,  1.08s/it, lr: 1.0e-04 loss: 1.216e-01]
a-cold-wall:  94%|#########3| 2819/3000 [1:18:58<02:57,  1.02it/s, lr: 1.0e-04 loss: 1.216e-01]
a-cold-wall:  94%|#########3| 2819/3000 [1:18:58<02:57,  1.02it/s, lr: 1.0e-04 loss: 1.216e-01]
a-cold-wall:  94%|#########3| 2819/3000 [1:18:58<02:57,  1.02it/s, lr: 1.0e-04 loss: 8.158e-01]
a-cold-wall:  94%|#########3| 2819/3000 [1:18:58<02:57,  1.02it/s, lr: 1.0e-04 loss: 8.158e-01]
a-cold-wall:  94%|#########3| 2820/3000 [1:19:00<02:56,  1.02it/s, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  94%|#########3| 2820/3000 [1:19:00<02:56,  1.02it/s, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  94%|#########4| 2821/3000 [1:19:00<02:32,  1.17it/s, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  94%|#########4| 2821/3000 [1:19:00<02:32,  1.17it/s, lr: 1.0e-04 loss: 3.689e-01]
a-cold-wall:  94%|#########4| 2821/3000 [1:19:01<02:32,  1.17it/s, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  94%|#########4| 2821/3000 [1:19:01<02:32,  1.17it/s, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  94%|#########4| 2822/3000 [1:19:01<02:56,  1.01it/s, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  94%|#########4| 2822/3000 [1:19:01<02:56,  1.01it/s, lr: 1.0e-04 loss: 6.562e-01]
a-cold-wall:  94%|#########4| 2822/3000 [1:19:02<02:56,  1.01it/s, lr: 1.0e-04 loss: 5.581e-01]
a-cold-wall:  94%|#########4| 2822/3000 [1:19:02<02:56,  1.01it/s, lr: 1.0e-04 loss: 5.581e-01]
a-cold-wall:  94%|#########4| 2823/3000 [1:19:02<02:44,  1.08it/s, lr: 1.0e-04 loss: 5.581e-01]
a-cold-wall:  94%|#########4| 2823/3000 [1:19:02<02:44,  1.08it/s, lr: 1.0e-04 loss: 5.581e-01]
a-cold-wall:  94%|#########4| 2823/3000 [1:19:03<02:44,  1.08it/s, lr: 1.0e-04 loss: 1.830e-01]
a-cold-wall:  94%|#########4| 2823/3000 [1:19:03<02:44,  1.08it/s, lr: 1.0e-04 loss: 1.830e-01]
a-cold-wall:  94%|#########4| 2824/3000 [1:19:03<02:34,  1.14it/s, lr: 1.0e-04 loss: 1.830e-01]
a-cold-wall:  94%|#########4| 2824/3000 [1:19:03<02:34,  1.14it/s, lr: 1.0e-04 loss: 1.830e-01]
a-cold-wall:  94%|#########4| 2824/3000 [1:19:04<02:34,  1.14it/s, lr: 1.0e-04 loss: 3.471e-01]
a-cold-wall:  94%|#########4| 2824/3000 [1:19:04<02:34,  1.14it/s, lr: 1.0e-04 loss: 3.471e-01]
a-cold-wall:  94%|#########4| 2825/3000 [1:19:04<02:59,  1.02s/it, lr: 1.0e-04 loss: 3.471e-01]
a-cold-wall:  94%|#########4| 2825/3000 [1:19:04<02:59,  1.02s/it, lr: 1.0e-04 loss: 3.471e-01]
a-cold-wall:  94%|#########4| 2825/3000 [1:19:06<02:59,  1.02s/it, lr: 1.0e-04 loss: 4.825e-01]
a-cold-wall:  94%|#########4| 2825/3000 [1:19:06<02:59,  1.02s/it, lr: 1.0e-04 loss: 4.825e-01]
a-cold-wall:  94%|#########4| 2826/3000 [1:19:06<03:16,  1.13s/it, lr: 1.0e-04 loss: 4.825e-01]
a-cold-wall:  94%|#########4| 2826/3000 [1:19:06<03:16,  1.13s/it, lr: 1.0e-04 loss: 4.825e-01]
a-cold-wall:  94%|#########4| 2826/3000 [1:19:07<03:16,  1.13s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  94%|#########4| 2826/3000 [1:19:07<03:16,  1.13s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  94%|#########4| 2827/3000 [1:19:07<03:29,  1.21s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  94%|#########4| 2827/3000 [1:19:07<03:29,  1.21s/it, lr: 1.0e-04 loss: 4.501e-01]
a-cold-wall:  94%|#########4| 2827/3000 [1:19:08<03:29,  1.21s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  94%|#########4| 2827/3000 [1:19:08<03:29,  1.21s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  94%|#########4| 2828/3000 [1:19:08<03:38,  1.27s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  94%|#########4| 2828/3000 [1:19:08<03:38,  1.27s/it, lr: 1.0e-04 loss: 1.426e-01]
a-cold-wall:  94%|#########4| 2828/3000 [1:19:10<03:38,  1.27s/it, lr: 1.0e-04 loss: 4.052e-01]
a-cold-wall:  94%|#########4| 2828/3000 [1:19:10<03:38,  1.27s/it, lr: 1.0e-04 loss: 4.052e-01]
a-cold-wall:  94%|#########4| 2829/3000 [1:19:10<03:44,  1.31s/it, lr: 1.0e-04 loss: 4.052e-01]
a-cold-wall:  94%|#########4| 2829/3000 [1:19:10<03:44,  1.31s/it, lr: 1.0e-04 loss: 4.052e-01]
a-cold-wall:  94%|#########4| 2829/3000 [1:19:11<03:44,  1.31s/it, lr: 1.0e-04 loss: 7.134e-01]
a-cold-wall:  94%|#########4| 2829/3000 [1:19:11<03:44,  1.31s/it, lr: 1.0e-04 loss: 7.134e-01]
a-cold-wall:  94%|#########4| 2830/3000 [1:19:14<03:43,  1.31s/it, lr: 1.0e-04 loss: 7.351e-01]
a-cold-wall:  94%|#########4| 2830/3000 [1:19:14<03:43,  1.31s/it, lr: 1.0e-04 loss: 7.351e-01]
a-cold-wall:  94%|#########4| 2831/3000 [1:19:14<03:50,  1.37s/it, lr: 1.0e-04 loss: 7.351e-01]
a-cold-wall:  94%|#########4| 2831/3000 [1:19:14<03:50,  1.37s/it, lr: 1.0e-04 loss: 7.351e-01]
a-cold-wall:  94%|#########4| 2831/3000 [1:19:15<03:50,  1.37s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  94%|#########4| 2831/3000 [1:19:15<03:50,  1.37s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  94%|#########4| 2832/3000 [1:19:15<03:23,  1.21s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  94%|#########4| 2832/3000 [1:19:15<03:23,  1.21s/it, lr: 1.0e-04 loss: 3.755e-01]
a-cold-wall:  94%|#########4| 2832/3000 [1:19:16<03:23,  1.21s/it, lr: 1.0e-04 loss: 1.474e-01]
a-cold-wall:  94%|#########4| 2832/3000 [1:19:16<03:23,  1.21s/it, lr: 1.0e-04 loss: 1.474e-01]
a-cold-wall:  94%|#########4| 2833/3000 [1:19:16<03:12,  1.15s/it, lr: 1.0e-04 loss: 1.474e-01]
a-cold-wall:  94%|#########4| 2833/3000 [1:19:16<03:12,  1.15s/it, lr: 1.0e-04 loss: 1.474e-01]
a-cold-wall:  94%|#########4| 2833/3000 [1:19:17<03:12,  1.15s/it, lr: 1.0e-04 loss: 5.201e-01]
a-cold-wall:  94%|#########4| 2833/3000 [1:19:17<03:12,  1.15s/it, lr: 1.0e-04 loss: 5.201e-01]
a-cold-wall:  94%|#########4| 2834/3000 [1:19:17<03:22,  1.22s/it, lr: 1.0e-04 loss: 5.201e-01]
a-cold-wall:  94%|#########4| 2834/3000 [1:19:17<03:22,  1.22s/it, lr: 1.0e-04 loss: 5.201e-01]
a-cold-wall:  94%|#########4| 2834/3000 [1:19:19<03:22,  1.22s/it, lr: 1.0e-04 loss: 8.640e-02]
a-cold-wall:  94%|#########4| 2834/3000 [1:19:19<03:22,  1.22s/it, lr: 1.0e-04 loss: 8.640e-02]
a-cold-wall:  94%|#########4| 2835/3000 [1:19:19<03:31,  1.28s/it, lr: 1.0e-04 loss: 8.640e-02]
a-cold-wall:  94%|#########4| 2835/3000 [1:19:19<03:31,  1.28s/it, lr: 1.0e-04 loss: 8.640e-02]
a-cold-wall:  94%|#########4| 2835/3000 [1:19:20<03:31,  1.28s/it, lr: 1.0e-04 loss: 3.500e-01]
a-cold-wall:  94%|#########4| 2835/3000 [1:19:20<03:31,  1.28s/it, lr: 1.0e-04 loss: 3.500e-01]
a-cold-wall:  95%|#########4| 2836/3000 [1:19:20<03:05,  1.13s/it, lr: 1.0e-04 loss: 3.500e-01]
a-cold-wall:  95%|#########4| 2836/3000 [1:19:20<03:05,  1.13s/it, lr: 1.0e-04 loss: 3.500e-01]
a-cold-wall:  95%|#########4| 2836/3000 [1:19:23<03:05,  1.13s/it, lr: 1.0e-04 loss: 2.505e-01]
a-cold-wall:  95%|#########4| 2836/3000 [1:19:23<03:05,  1.13s/it, lr: 1.0e-04 loss: 2.505e-01]
a-cold-wall:  95%|#########4| 2837/3000 [1:19:23<04:24,  1.62s/it, lr: 1.0e-04 loss: 2.505e-01]
a-cold-wall:  95%|#########4| 2837/3000 [1:19:23<04:24,  1.62s/it, lr: 1.0e-04 loss: 2.505e-01]
a-cold-wall:  95%|#########4| 2837/3000 [1:19:26<04:24,  1.62s/it, lr: 1.0e-04 loss: 6.815e-01]
a-cold-wall:  95%|#########4| 2837/3000 [1:19:26<04:24,  1.62s/it, lr: 1.0e-04 loss: 6.815e-01]
a-cold-wall:  95%|#########4| 2838/3000 [1:19:26<05:21,  1.98s/it, lr: 1.0e-04 loss: 6.815e-01]
a-cold-wall:  95%|#########4| 2838/3000 [1:19:26<05:21,  1.98s/it, lr: 1.0e-04 loss: 6.815e-01]
a-cold-wall:  95%|#########4| 2838/3000 [1:19:26<05:21,  1.98s/it, lr: 1.0e-04 loss: 5.963e-01]
a-cold-wall:  95%|#########4| 2838/3000 [1:19:26<05:21,  1.98s/it, lr: 1.0e-04 loss: 5.963e-01]
a-cold-wall:  95%|#########4| 2839/3000 [1:19:26<04:19,  1.61s/it, lr: 1.0e-04 loss: 5.963e-01]
a-cold-wall:  95%|#########4| 2839/3000 [1:19:26<04:19,  1.61s/it, lr: 1.0e-04 loss: 5.963e-01]
a-cold-wall:  95%|#########4| 2839/3000 [1:19:29<04:19,  1.61s/it, lr: 1.0e-04 loss: 2.065e-01]
a-cold-wall:  95%|#########4| 2839/3000 [1:19:29<04:19,  1.61s/it, lr: 1.0e-04 loss: 2.065e-01]
a-cold-wall:  95%|#########4| 2840/3000 [1:19:31<04:18,  1.61s/it, lr: 1.0e-04 loss: 5.313e-01]
a-cold-wall:  95%|#########4| 2840/3000 [1:19:31<04:18,  1.61s/it, lr: 1.0e-04 loss: 5.313e-01]
a-cold-wall:  95%|#########4| 2841/3000 [1:19:31<03:10,  1.20s/it, lr: 1.0e-04 loss: 5.313e-01]
a-cold-wall:  95%|#########4| 2841/3000 [1:19:31<03:10,  1.20s/it, lr: 1.0e-04 loss: 5.313e-01]
a-cold-wall:  95%|#########4| 2841/3000 [1:19:33<03:10,  1.20s/it, lr: 1.0e-04 loss: 5.808e-01]
a-cold-wall:  95%|#########4| 2841/3000 [1:19:33<03:10,  1.20s/it, lr: 1.0e-04 loss: 5.808e-01]
a-cold-wall:  95%|#########4| 2842/3000 [1:19:33<04:13,  1.60s/it, lr: 1.0e-04 loss: 5.808e-01]
a-cold-wall:  95%|#########4| 2842/3000 [1:19:33<04:13,  1.60s/it, lr: 1.0e-04 loss: 5.808e-01]
a-cold-wall:  95%|#########4| 2842/3000 [1:19:34<04:13,  1.60s/it, lr: 1.0e-04 loss: 1.010e-01]
a-cold-wall:  95%|#########4| 2842/3000 [1:19:34<04:13,  1.60s/it, lr: 1.0e-04 loss: 1.010e-01]
a-cold-wall:  95%|#########4| 2843/3000 [1:19:34<03:45,  1.44s/it, lr: 1.0e-04 loss: 1.010e-01]
a-cold-wall:  95%|#########4| 2843/3000 [1:19:34<03:45,  1.44s/it, lr: 1.0e-04 loss: 1.010e-01]
a-cold-wall:  95%|#########4| 2843/3000 [1:19:37<03:45,  1.44s/it, lr: 1.0e-04 loss: 3.604e-01]
a-cold-wall:  95%|#########4| 2843/3000 [1:19:37<03:45,  1.44s/it, lr: 1.0e-04 loss: 3.604e-01]
a-cold-wall:  95%|#########4| 2844/3000 [1:19:37<04:43,  1.82s/it, lr: 1.0e-04 loss: 3.604e-01]
a-cold-wall:  95%|#########4| 2844/3000 [1:19:37<04:43,  1.82s/it, lr: 1.0e-04 loss: 3.604e-01]
a-cold-wall:  95%|#########4| 2844/3000 [1:19:38<04:43,  1.82s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  95%|#########4| 2844/3000 [1:19:38<04:43,  1.82s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  95%|#########4| 2845/3000 [1:19:38<03:55,  1.52s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  95%|#########4| 2845/3000 [1:19:38<03:55,  1.52s/it, lr: 1.0e-04 loss: 4.925e-01]
a-cold-wall:  95%|#########4| 2845/3000 [1:19:39<03:55,  1.52s/it, lr: 1.0e-04 loss: 8.469e-02]
a-cold-wall:  95%|#########4| 2845/3000 [1:19:39<03:55,  1.52s/it, lr: 1.0e-04 loss: 8.469e-02]
a-cold-wall:  95%|#########4| 2846/3000 [1:19:39<03:20,  1.30s/it, lr: 1.0e-04 loss: 8.469e-02]
a-cold-wall:  95%|#########4| 2846/3000 [1:19:39<03:20,  1.30s/it, lr: 1.0e-04 loss: 8.469e-02]
a-cold-wall:  95%|#########4| 2846/3000 [1:19:40<03:20,  1.30s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  95%|#########4| 2846/3000 [1:19:40<03:20,  1.30s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  95%|#########4| 2847/3000 [1:19:40<03:08,  1.23s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  95%|#########4| 2847/3000 [1:19:40<03:08,  1.23s/it, lr: 1.0e-04 loss: 1.335e-01]
a-cold-wall:  95%|#########4| 2847/3000 [1:19:41<03:08,  1.23s/it, lr: 1.0e-04 loss: 7.400e-02]
a-cold-wall:  95%|#########4| 2847/3000 [1:19:41<03:08,  1.23s/it, lr: 1.0e-04 loss: 7.400e-02]
a-cold-wall:  95%|#########4| 2848/3000 [1:19:41<03:15,  1.29s/it, lr: 1.0e-04 loss: 7.400e-02]
a-cold-wall:  95%|#########4| 2848/3000 [1:19:41<03:15,  1.29s/it, lr: 1.0e-04 loss: 7.400e-02]
a-cold-wall:  95%|#########4| 2848/3000 [1:19:43<03:15,  1.29s/it, lr: 1.0e-04 loss: 4.875e-01]
a-cold-wall:  95%|#########4| 2848/3000 [1:19:43<03:15,  1.29s/it, lr: 1.0e-04 loss: 4.875e-01]
a-cold-wall:  95%|#########4| 2849/3000 [1:19:43<03:24,  1.35s/it, lr: 1.0e-04 loss: 4.875e-01]
a-cold-wall:  95%|#########4| 2849/3000 [1:19:43<03:24,  1.35s/it, lr: 1.0e-04 loss: 4.875e-01]
a-cold-wall:  95%|#########4| 2849/3000 [1:19:43<03:24,  1.35s/it, lr: 1.0e-04 loss: 6.146e-01]
a-cold-wall:  95%|#########4| 2849/3000 [1:19:43<03:24,  1.35s/it, lr: 1.0e-04 loss: 6.146e-01]
a-cold-wall:  95%|#########5| 2850/3000 [1:19:46<03:23,  1.35s/it, lr: 1.0e-04 loss: 4.940e-01]
a-cold-wall:  95%|#########5| 2850/3000 [1:19:46<03:23,  1.35s/it, lr: 1.0e-04 loss: 4.940e-01]
a-cold-wall:  95%|#########5| 2851/3000 [1:19:46<03:26,  1.39s/it, lr: 1.0e-04 loss: 4.940e-01]
a-cold-wall:  95%|#########5| 2851/3000 [1:19:46<03:26,  1.39s/it, lr: 1.0e-04 loss: 4.940e-01]
a-cold-wall:  95%|#########5| 2851/3000 [1:19:49<03:26,  1.39s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  95%|#########5| 2851/3000 [1:19:49<03:26,  1.39s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  95%|#########5| 2852/3000 [1:19:49<04:18,  1.75s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  95%|#########5| 2852/3000 [1:19:49<04:18,  1.75s/it, lr: 1.0e-04 loss: 3.413e-01]
a-cold-wall:  95%|#########5| 2852/3000 [1:19:52<04:18,  1.75s/it, lr: 1.0e-04 loss: 7.796e-01]
a-cold-wall:  95%|#########5| 2852/3000 [1:19:52<04:18,  1.75s/it, lr: 1.0e-04 loss: 7.796e-01]
a-cold-wall:  95%|#########5| 2853/3000 [1:19:52<04:59,  2.04s/it, lr: 1.0e-04 loss: 7.796e-01]
a-cold-wall:  95%|#########5| 2853/3000 [1:19:52<04:59,  2.04s/it, lr: 1.0e-04 loss: 7.796e-01]
a-cold-wall:  95%|#########5| 2853/3000 [1:19:53<04:59,  2.04s/it, lr: 1.0e-04 loss: 5.065e-01]
a-cold-wall:  95%|#########5| 2853/3000 [1:19:53<04:59,  2.04s/it, lr: 1.0e-04 loss: 5.065e-01]
a-cold-wall:  95%|#########5| 2854/3000 [1:19:53<04:06,  1.69s/it, lr: 1.0e-04 loss: 5.065e-01]
a-cold-wall:  95%|#########5| 2854/3000 [1:19:53<04:06,  1.69s/it, lr: 1.0e-04 loss: 5.065e-01]
a-cold-wall:  95%|#########5| 2854/3000 [1:19:56<04:06,  1.69s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  95%|#########5| 2854/3000 [1:19:56<04:06,  1.69s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  95%|#########5| 2855/3000 [1:19:56<04:51,  2.01s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  95%|#########5| 2855/3000 [1:19:56<04:51,  2.01s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  95%|#########5| 2855/3000 [1:19:58<04:51,  2.01s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:  95%|#########5| 2855/3000 [1:19:58<04:51,  2.01s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:  95%|#########5| 2856/3000 [1:19:58<05:23,  2.25s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:  95%|#########5| 2856/3000 [1:19:58<05:23,  2.25s/it, lr: 1.0e-04 loss: 4.914e-01]
a-cold-wall:  95%|#########5| 2856/3000 [1:20:00<05:23,  2.25s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  95%|#########5| 2856/3000 [1:20:00<05:23,  2.25s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  95%|#########5| 2857/3000 [1:20:00<04:47,  2.01s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  95%|#########5| 2857/3000 [1:20:00<04:47,  2.01s/it, lr: 1.0e-04 loss: 1.112e-01]
a-cold-wall:  95%|#########5| 2857/3000 [1:20:01<04:47,  2.01s/it, lr: 1.0e-04 loss: 1.679e-01]
a-cold-wall:  95%|#########5| 2857/3000 [1:20:01<04:47,  2.01s/it, lr: 1.0e-04 loss: 1.679e-01]
a-cold-wall:  95%|#########5| 2858/3000 [1:20:01<04:19,  1.82s/it, lr: 1.0e-04 loss: 1.679e-01]
a-cold-wall:  95%|#########5| 2858/3000 [1:20:01<04:19,  1.82s/it, lr: 1.0e-04 loss: 1.679e-01]
a-cold-wall:  95%|#########5| 2858/3000 [1:20:02<04:19,  1.82s/it, lr: 1.0e-04 loss: 4.581e-01]
a-cold-wall:  95%|#########5| 2858/3000 [1:20:02<04:19,  1.82s/it, lr: 1.0e-04 loss: 4.581e-01]
a-cold-wall:  95%|#########5| 2859/3000 [1:20:02<03:32,  1.50s/it, lr: 1.0e-04 loss: 4.581e-01]
a-cold-wall:  95%|#########5| 2859/3000 [1:20:02<03:32,  1.50s/it, lr: 1.0e-04 loss: 4.581e-01]
a-cold-wall:  95%|#########5| 2859/3000 [1:20:04<03:32,  1.50s/it, lr: 1.0e-04 loss: 1.074e-01]
a-cold-wall:  95%|#########5| 2859/3000 [1:20:04<03:32,  1.50s/it, lr: 1.0e-04 loss: 1.074e-01]
a-cold-wall:  95%|#########5| 2860/3000 [1:20:06<03:30,  1.50s/it, lr: 1.0e-04 loss: 2.437e-01]
a-cold-wall:  95%|#########5| 2860/3000 [1:20:06<03:30,  1.50s/it, lr: 1.0e-04 loss: 2.437e-01]
a-cold-wall:  95%|#########5| 2861/3000 [1:20:06<03:22,  1.46s/it, lr: 1.0e-04 loss: 2.437e-01]
a-cold-wall:  95%|#########5| 2861/3000 [1:20:06<03:22,  1.46s/it, lr: 1.0e-04 loss: 2.437e-01]
a-cold-wall:  95%|#########5| 2861/3000 [1:20:09<03:22,  1.46s/it, lr: 1.0e-04 loss: 9.905e-02]
a-cold-wall:  95%|#########5| 2861/3000 [1:20:09<03:22,  1.46s/it, lr: 1.0e-04 loss: 9.905e-02]
a-cold-wall:  95%|#########5| 2862/3000 [1:20:09<04:07,  1.79s/it, lr: 1.0e-04 loss: 9.905e-02]
a-cold-wall:  95%|#########5| 2862/3000 [1:20:09<04:07,  1.79s/it, lr: 1.0e-04 loss: 9.905e-02]
a-cold-wall:  95%|#########5| 2862/3000 [1:20:11<04:07,  1.79s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  95%|#########5| 2862/3000 [1:20:11<04:07,  1.79s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  95%|#########5| 2863/3000 [1:20:11<03:52,  1.70s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  95%|#########5| 2863/3000 [1:20:11<03:52,  1.70s/it, lr: 1.0e-04 loss: 2.339e-01]
a-cold-wall:  95%|#########5| 2863/3000 [1:20:11<03:52,  1.70s/it, lr: 1.0e-04 loss: 2.005e-01]
a-cold-wall:  95%|#########5| 2863/3000 [1:20:11<03:52,  1.70s/it, lr: 1.0e-04 loss: 2.005e-01]
a-cold-wall:  95%|#########5| 2864/3000 [1:20:11<03:18,  1.46s/it, lr: 1.0e-04 loss: 2.005e-01]
a-cold-wall:  95%|#########5| 2864/3000 [1:20:11<03:18,  1.46s/it, lr: 1.0e-04 loss: 2.005e-01]
a-cold-wall:  95%|#########5| 2864/3000 [1:20:13<03:18,  1.46s/it, lr: 1.0e-04 loss: 3.704e-01]
a-cold-wall:  95%|#########5| 2864/3000 [1:20:13<03:18,  1.46s/it, lr: 1.0e-04 loss: 3.704e-01]
a-cold-wall:  96%|#########5| 2865/3000 [1:20:13<03:15,  1.45s/it, lr: 1.0e-04 loss: 3.704e-01]
a-cold-wall:  96%|#########5| 2865/3000 [1:20:13<03:15,  1.45s/it, lr: 1.0e-04 loss: 3.704e-01]
a-cold-wall:  96%|#########5| 2865/3000 [1:20:14<03:15,  1.45s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  96%|#########5| 2865/3000 [1:20:14<03:15,  1.45s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  96%|#########5| 2866/3000 [1:20:14<03:12,  1.44s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  96%|#########5| 2866/3000 [1:20:14<03:12,  1.44s/it, lr: 1.0e-04 loss: 4.904e-01]
a-cold-wall:  96%|#########5| 2866/3000 [1:20:15<03:12,  1.44s/it, lr: 1.0e-04 loss: 4.268e-01]
a-cold-wall:  96%|#########5| 2866/3000 [1:20:15<03:12,  1.44s/it, lr: 1.0e-04 loss: 4.268e-01]
a-cold-wall:  96%|#########5| 2867/3000 [1:20:15<02:44,  1.23s/it, lr: 1.0e-04 loss: 4.268e-01]
a-cold-wall:  96%|#########5| 2867/3000 [1:20:15<02:44,  1.23s/it, lr: 1.0e-04 loss: 4.268e-01]
a-cold-wall:  96%|#########5| 2867/3000 [1:20:18<02:44,  1.23s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  96%|#########5| 2867/3000 [1:20:18<02:44,  1.23s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  96%|#########5| 2868/3000 [1:20:18<03:45,  1.71s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  96%|#########5| 2868/3000 [1:20:18<03:45,  1.71s/it, lr: 1.0e-04 loss: 1.499e-01]
a-cold-wall:  96%|#########5| 2868/3000 [1:20:21<03:45,  1.71s/it, lr: 1.0e-04 loss: 7.043e-01]
a-cold-wall:  96%|#########5| 2868/3000 [1:20:21<03:45,  1.71s/it, lr: 1.0e-04 loss: 7.043e-01]
a-cold-wall:  96%|#########5| 2869/3000 [1:20:21<04:26,  2.04s/it, lr: 1.0e-04 loss: 7.043e-01]
a-cold-wall:  96%|#########5| 2869/3000 [1:20:21<04:26,  2.04s/it, lr: 1.0e-04 loss: 7.043e-01]
a-cold-wall:  96%|#########5| 2869/3000 [1:20:21<04:26,  2.04s/it, lr: 1.0e-04 loss: 4.473e-01]
a-cold-wall:  96%|#########5| 2869/3000 [1:20:21<04:26,  2.04s/it, lr: 1.0e-04 loss: 4.473e-01]
a-cold-wall:  96%|#########5| 2870/3000 [1:20:22<04:24,  2.04s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  96%|#########5| 2870/3000 [1:20:22<04:24,  2.04s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  96%|#########5| 2871/3000 [1:20:22<02:44,  1.28s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  96%|#########5| 2871/3000 [1:20:22<02:44,  1.28s/it, lr: 1.0e-04 loss: 1.200e-01]
a-cold-wall:  96%|#########5| 2871/3000 [1:20:23<02:44,  1.28s/it, lr: 1.0e-04 loss: 6.729e-01]
a-cold-wall:  96%|#########5| 2871/3000 [1:20:23<02:44,  1.28s/it, lr: 1.0e-04 loss: 6.729e-01]
a-cold-wall:  96%|#########5| 2872/3000 [1:20:23<02:26,  1.15s/it, lr: 1.0e-04 loss: 6.729e-01]
a-cold-wall:  96%|#########5| 2872/3000 [1:20:23<02:26,  1.15s/it, lr: 1.0e-04 loss: 6.729e-01]
a-cold-wall:  96%|#########5| 2872/3000 [1:20:24<02:26,  1.15s/it, lr: 1.0e-04 loss: 2.641e-01]
a-cold-wall:  96%|#########5| 2872/3000 [1:20:24<02:26,  1.15s/it, lr: 1.0e-04 loss: 2.641e-01]
a-cold-wall:  96%|#########5| 2873/3000 [1:20:24<02:20,  1.10s/it, lr: 1.0e-04 loss: 2.641e-01]
a-cold-wall:  96%|#########5| 2873/3000 [1:20:24<02:20,  1.10s/it, lr: 1.0e-04 loss: 2.641e-01]
a-cold-wall:  96%|#########5| 2873/3000 [1:20:25<02:20,  1.10s/it, lr: 1.0e-04 loss: 5.669e-01]
a-cold-wall:  96%|#########5| 2873/3000 [1:20:25<02:20,  1.10s/it, lr: 1.0e-04 loss: 5.669e-01]
a-cold-wall:  96%|#########5| 2874/3000 [1:20:25<02:30,  1.19s/it, lr: 1.0e-04 loss: 5.669e-01]
a-cold-wall:  96%|#########5| 2874/3000 [1:20:25<02:30,  1.19s/it, lr: 1.0e-04 loss: 5.669e-01]
a-cold-wall:  96%|#########5| 2874/3000 [1:20:27<02:30,  1.19s/it, lr: 1.0e-04 loss: 2.621e-01]
a-cold-wall:  96%|#########5| 2874/3000 [1:20:27<02:30,  1.19s/it, lr: 1.0e-04 loss: 2.621e-01]
a-cold-wall:  96%|#########5| 2875/3000 [1:20:27<02:36,  1.26s/it, lr: 1.0e-04 loss: 2.621e-01]
a-cold-wall:  96%|#########5| 2875/3000 [1:20:27<02:36,  1.26s/it, lr: 1.0e-04 loss: 2.621e-01]
a-cold-wall:  96%|#########5| 2875/3000 [1:20:28<02:36,  1.26s/it, lr: 1.0e-04 loss: 5.764e-01]
a-cold-wall:  96%|#########5| 2875/3000 [1:20:28<02:36,  1.26s/it, lr: 1.0e-04 loss: 5.764e-01]
a-cold-wall:  96%|#########5| 2876/3000 [1:20:28<02:42,  1.31s/it, lr: 1.0e-04 loss: 5.764e-01]
a-cold-wall:  96%|#########5| 2876/3000 [1:20:28<02:42,  1.31s/it, lr: 1.0e-04 loss: 5.764e-01]
a-cold-wall:  96%|#########5| 2876/3000 [1:20:29<02:42,  1.31s/it, lr: 1.0e-04 loss: 3.131e-01]
a-cold-wall:  96%|#########5| 2876/3000 [1:20:29<02:42,  1.31s/it, lr: 1.0e-04 loss: 3.131e-01]
a-cold-wall:  96%|#########5| 2877/3000 [1:20:29<02:28,  1.21s/it, lr: 1.0e-04 loss: 3.131e-01]
a-cold-wall:  96%|#########5| 2877/3000 [1:20:29<02:28,  1.21s/it, lr: 1.0e-04 loss: 3.131e-01]
a-cold-wall:  96%|#########5| 2877/3000 [1:20:32<02:28,  1.21s/it, lr: 1.0e-04 loss: 2.337e-01]
a-cold-wall:  96%|#########5| 2877/3000 [1:20:32<02:28,  1.21s/it, lr: 1.0e-04 loss: 2.337e-01]
a-cold-wall:  96%|#########5| 2878/3000 [1:20:32<03:26,  1.69s/it, lr: 1.0e-04 loss: 2.337e-01]
a-cold-wall:  96%|#########5| 2878/3000 [1:20:32<03:26,  1.69s/it, lr: 1.0e-04 loss: 2.337e-01]
a-cold-wall:  96%|#########5| 2878/3000 [1:20:33<03:26,  1.69s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall:  96%|#########5| 2878/3000 [1:20:33<03:26,  1.69s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall:  96%|#########5| 2879/3000 [1:20:33<03:14,  1.61s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall:  96%|#########5| 2879/3000 [1:20:33<03:14,  1.61s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall:  96%|#########5| 2879/3000 [1:20:35<03:14,  1.61s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  96%|#########5| 2879/3000 [1:20:35<03:14,  1.61s/it, lr: 1.0e-04 loss: 1.713e-01]
a-cold-wall:  96%|#########6| 2880/3000 [1:20:38<03:12,  1.61s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  96%|#########6| 2880/3000 [1:20:38<03:12,  1.61s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  96%|#########6| 2881/3000 [1:20:38<03:00,  1.52s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  96%|#########6| 2881/3000 [1:20:38<03:00,  1.52s/it, lr: 1.0e-04 loss: 7.646e-01]
a-cold-wall:  96%|#########6| 2881/3000 [1:20:41<03:00,  1.52s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  96%|#########6| 2881/3000 [1:20:41<03:00,  1.52s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  96%|#########6| 2882/3000 [1:20:41<03:37,  1.84s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  96%|#########6| 2882/3000 [1:20:41<03:37,  1.84s/it, lr: 1.0e-04 loss: 3.864e-01]
a-cold-wall:  96%|#########6| 2882/3000 [1:20:41<03:37,  1.84s/it, lr: 1.0e-04 loss: 8.372e-03]
a-cold-wall:  96%|#########6| 2882/3000 [1:20:41<03:37,  1.84s/it, lr: 1.0e-04 loss: 8.372e-03]
a-cold-wall:  96%|#########6| 2883/3000 [1:20:41<03:02,  1.56s/it, lr: 1.0e-04 loss: 8.372e-03]
a-cold-wall:  96%|#########6| 2883/3000 [1:20:41<03:02,  1.56s/it, lr: 1.0e-04 loss: 8.372e-03]
a-cold-wall:  96%|#########6| 2883/3000 [1:20:44<03:02,  1.56s/it, lr: 1.0e-04 loss: 4.672e-01]
a-cold-wall:  96%|#########6| 2883/3000 [1:20:44<03:02,  1.56s/it, lr: 1.0e-04 loss: 4.672e-01]
a-cold-wall:  96%|#########6| 2884/3000 [1:20:44<03:40,  1.90s/it, lr: 1.0e-04 loss: 4.672e-01]
a-cold-wall:  96%|#########6| 2884/3000 [1:20:44<03:40,  1.90s/it, lr: 1.0e-04 loss: 4.672e-01]
a-cold-wall:  96%|#########6| 2884/3000 [1:20:45<03:40,  1.90s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  96%|#########6| 2884/3000 [1:20:45<03:40,  1.90s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  96%|#########6| 2885/3000 [1:20:45<03:01,  1.58s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  96%|#########6| 2885/3000 [1:20:45<03:01,  1.58s/it, lr: 1.0e-04 loss: 4.994e-02]
a-cold-wall:  96%|#########6| 2885/3000 [1:20:46<03:01,  1.58s/it, lr: 1.0e-04 loss: 1.740e-01]
a-cold-wall:  96%|#########6| 2885/3000 [1:20:46<03:01,  1.58s/it, lr: 1.0e-04 loss: 1.740e-01]
a-cold-wall:  96%|#########6| 2886/3000 [1:20:46<02:33,  1.34s/it, lr: 1.0e-04 loss: 1.740e-01]
a-cold-wall:  96%|#########6| 2886/3000 [1:20:46<02:33,  1.34s/it, lr: 1.0e-04 loss: 1.740e-01]
a-cold-wall:  96%|#########6| 2886/3000 [1:20:46<02:33,  1.34s/it, lr: 1.0e-04 loss: 3.034e-02]
a-cold-wall:  96%|#########6| 2886/3000 [1:20:46<02:33,  1.34s/it, lr: 1.0e-04 loss: 3.034e-02]
a-cold-wall:  96%|#########6| 2887/3000 [1:20:46<02:12,  1.17s/it, lr: 1.0e-04 loss: 3.034e-02]
a-cold-wall:  96%|#########6| 2887/3000 [1:20:46<02:12,  1.17s/it, lr: 1.0e-04 loss: 3.034e-02]
a-cold-wall:  96%|#########6| 2887/3000 [1:20:48<02:12,  1.17s/it, lr: 1.0e-04 loss: 7.517e-01]
a-cold-wall:  96%|#########6| 2887/3000 [1:20:48<02:12,  1.17s/it, lr: 1.0e-04 loss: 7.517e-01]
a-cold-wall:  96%|#########6| 2888/3000 [1:20:48<02:24,  1.29s/it, lr: 1.0e-04 loss: 7.517e-01]
a-cold-wall:  96%|#########6| 2888/3000 [1:20:48<02:24,  1.29s/it, lr: 1.0e-04 loss: 7.517e-01]
a-cold-wall:  96%|#########6| 2888/3000 [1:20:49<02:24,  1.29s/it, lr: 1.0e-04 loss: 5.714e-01]
a-cold-wall:  96%|#########6| 2888/3000 [1:20:49<02:24,  1.29s/it, lr: 1.0e-04 loss: 5.714e-01]
a-cold-wall:  96%|#########6| 2889/3000 [1:20:49<02:04,  1.13s/it, lr: 1.0e-04 loss: 5.714e-01]
a-cold-wall:  96%|#########6| 2889/3000 [1:20:49<02:04,  1.13s/it, lr: 1.0e-04 loss: 5.714e-01]
a-cold-wall:  96%|#########6| 2889/3000 [1:20:51<02:04,  1.13s/it, lr: 1.0e-04 loss: 3.360e-01]
a-cold-wall:  96%|#########6| 2889/3000 [1:20:51<02:04,  1.13s/it, lr: 1.0e-04 loss: 3.360e-01]
a-cold-wall:  96%|#########6| 2890/3000 [1:20:52<02:03,  1.13s/it, lr: 1.0e-04 loss: 5.820e-01]
a-cold-wall:  96%|#########6| 2890/3000 [1:20:52<02:03,  1.13s/it, lr: 1.0e-04 loss: 5.820e-01]
a-cold-wall:  96%|#########6| 2891/3000 [1:20:52<01:25,  1.28it/s, lr: 1.0e-04 loss: 5.820e-01]
a-cold-wall:  96%|#########6| 2891/3000 [1:20:52<01:25,  1.28it/s, lr: 1.0e-04 loss: 5.820e-01]
a-cold-wall:  96%|#########6| 2891/3000 [1:20:54<01:25,  1.28it/s, lr: 1.0e-04 loss: 2.314e-01]
a-cold-wall:  96%|#########6| 2891/3000 [1:20:54<01:25,  1.28it/s, lr: 1.0e-04 loss: 2.314e-01]
a-cold-wall:  96%|#########6| 2892/3000 [1:20:54<01:41,  1.07it/s, lr: 1.0e-04 loss: 2.314e-01]
a-cold-wall:  96%|#########6| 2892/3000 [1:20:54<01:41,  1.07it/s, lr: 1.0e-04 loss: 2.314e-01]
a-cold-wall:  96%|#########6| 2892/3000 [1:20:57<01:41,  1.07it/s, lr: 1.0e-04 loss: 5.110e-01]
a-cold-wall:  96%|#########6| 2892/3000 [1:20:57<01:41,  1.07it/s, lr: 1.0e-04 loss: 5.110e-01]
a-cold-wall:  96%|#########6| 2893/3000 [1:20:57<02:36,  1.46s/it, lr: 1.0e-04 loss: 5.110e-01]
a-cold-wall:  96%|#########6| 2893/3000 [1:20:57<02:36,  1.46s/it, lr: 1.0e-04 loss: 5.110e-01]
a-cold-wall:  96%|#########6| 2893/3000 [1:20:58<02:36,  1.46s/it, lr: 1.0e-04 loss: 4.401e-01]
a-cold-wall:  96%|#########6| 2893/3000 [1:20:58<02:36,  1.46s/it, lr: 1.0e-04 loss: 4.401e-01]
a-cold-wall:  96%|#########6| 2894/3000 [1:20:58<02:33,  1.45s/it, lr: 1.0e-04 loss: 4.401e-01]
a-cold-wall:  96%|#########6| 2894/3000 [1:20:58<02:33,  1.45s/it, lr: 1.0e-04 loss: 4.401e-01]
a-cold-wall:  96%|#########6| 2894/3000 [1:20:59<02:33,  1.45s/it, lr: 1.0e-04 loss: 6.463e-01]
a-cold-wall:  96%|#########6| 2894/3000 [1:20:59<02:33,  1.45s/it, lr: 1.0e-04 loss: 6.463e-01]
a-cold-wall:  96%|#########6| 2895/3000 [1:20:59<02:11,  1.26s/it, lr: 1.0e-04 loss: 6.463e-01]
a-cold-wall:  96%|#########6| 2895/3000 [1:20:59<02:11,  1.26s/it, lr: 1.0e-04 loss: 6.463e-01]
a-cold-wall:  96%|#########6| 2895/3000 [1:21:00<02:11,  1.26s/it, lr: 1.0e-04 loss: 4.822e-01]
a-cold-wall:  96%|#########6| 2895/3000 [1:21:00<02:11,  1.26s/it, lr: 1.0e-04 loss: 4.822e-01]
a-cold-wall:  97%|#########6| 2896/3000 [1:21:00<02:16,  1.31s/it, lr: 1.0e-04 loss: 4.822e-01]
a-cold-wall:  97%|#########6| 2896/3000 [1:21:00<02:16,  1.31s/it, lr: 1.0e-04 loss: 4.822e-01]
a-cold-wall:  97%|#########6| 2896/3000 [1:21:01<02:16,  1.31s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  97%|#########6| 2896/3000 [1:21:01<02:16,  1.31s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  97%|#########6| 2897/3000 [1:21:01<01:58,  1.15s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  97%|#########6| 2897/3000 [1:21:01<01:58,  1.15s/it, lr: 1.0e-04 loss: 6.756e-01]
a-cold-wall:  97%|#########6| 2897/3000 [1:21:02<01:58,  1.15s/it, lr: 1.0e-04 loss: 1.762e-01]
a-cold-wall:  97%|#########6| 2897/3000 [1:21:02<01:58,  1.15s/it, lr: 1.0e-04 loss: 1.762e-01]
a-cold-wall:  97%|#########6| 2898/3000 [1:21:02<02:05,  1.23s/it, lr: 1.0e-04 loss: 1.762e-01]
a-cold-wall:  97%|#########6| 2898/3000 [1:21:02<02:05,  1.23s/it, lr: 1.0e-04 loss: 1.762e-01]
a-cold-wall:  97%|#########6| 2898/3000 [1:21:04<02:05,  1.23s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  97%|#########6| 2898/3000 [1:21:04<02:05,  1.23s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  97%|#########6| 2899/3000 [1:21:04<02:10,  1.29s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  97%|#########6| 2899/3000 [1:21:04<02:10,  1.29s/it, lr: 1.0e-04 loss: 1.018e-01]
a-cold-wall:  97%|#########6| 2899/3000 [1:21:07<02:10,  1.29s/it, lr: 1.0e-04 loss: 5.052e-01]
a-cold-wall:  97%|#########6| 2899/3000 [1:21:07<02:10,  1.29s/it, lr: 1.0e-04 loss: 5.052e-01]
a-cold-wall:  97%|#########6| 2900/3000 [1:21:08<02:09,  1.29s/it, lr: 1.0e-04 loss: 5.744e-01]
a-cold-wall:  97%|#########6| 2900/3000 [1:21:08<02:09,  1.29s/it, lr: 1.0e-04 loss: 5.744e-01]
a-cold-wall:  97%|#########6| 2901/3000 [1:21:08<01:41,  1.03s/it, lr: 1.0e-04 loss: 5.744e-01]
a-cold-wall:  97%|#########6| 2901/3000 [1:21:08<01:41,  1.03s/it, lr: 1.0e-04 loss: 5.744e-01]
a-cold-wall:  97%|#########6| 2901/3000 [1:21:09<01:41,  1.03s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  97%|#########6| 2901/3000 [1:21:09<01:41,  1.03s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  97%|#########6| 2902/3000 [1:21:09<01:40,  1.02s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  97%|#########6| 2902/3000 [1:21:09<01:40,  1.02s/it, lr: 1.0e-04 loss: 1.353e-01]
a-cold-wall:  97%|#########6| 2902/3000 [1:21:10<01:40,  1.02s/it, lr: 1.0e-04 loss: 7.709e-01]
a-cold-wall:  97%|#########6| 2902/3000 [1:21:10<01:40,  1.02s/it, lr: 1.0e-04 loss: 7.709e-01]
a-cold-wall:  97%|#########6| 2903/3000 [1:21:10<01:32,  1.05it/s, lr: 1.0e-04 loss: 7.709e-01]
a-cold-wall:  97%|#########6| 2903/3000 [1:21:10<01:32,  1.05it/s, lr: 1.0e-04 loss: 7.709e-01]
a-cold-wall:  97%|#########6| 2903/3000 [1:21:11<01:32,  1.05it/s, lr: 1.0e-04 loss: 2.607e-01]
a-cold-wall:  97%|#########6| 2903/3000 [1:21:11<01:32,  1.05it/s, lr: 1.0e-04 loss: 2.607e-01]
a-cold-wall:  97%|#########6| 2904/3000 [1:21:11<01:43,  1.08s/it, lr: 1.0e-04 loss: 2.607e-01]
a-cold-wall:  97%|#########6| 2904/3000 [1:21:11<01:43,  1.08s/it, lr: 1.0e-04 loss: 2.607e-01]
a-cold-wall:  97%|#########6| 2904/3000 [1:21:14<01:43,  1.08s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  97%|#########6| 2904/3000 [1:21:14<01:43,  1.08s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  97%|#########6| 2905/3000 [1:21:14<02:30,  1.58s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  97%|#########6| 2905/3000 [1:21:14<02:30,  1.58s/it, lr: 1.0e-04 loss: 4.776e-01]
a-cold-wall:  97%|#########6| 2905/3000 [1:21:17<02:30,  1.58s/it, lr: 1.0e-04 loss: 4.909e-01]
a-cold-wall:  97%|#########6| 2905/3000 [1:21:17<02:30,  1.58s/it, lr: 1.0e-04 loss: 4.909e-01]
a-cold-wall:  97%|#########6| 2906/3000 [1:21:17<03:03,  1.95s/it, lr: 1.0e-04 loss: 4.909e-01]
a-cold-wall:  97%|#########6| 2906/3000 [1:21:17<03:03,  1.95s/it, lr: 1.0e-04 loss: 4.909e-01]
a-cold-wall:  97%|#########6| 2906/3000 [1:21:18<03:03,  1.95s/it, lr: 1.0e-04 loss: 7.552e-02]
a-cold-wall:  97%|#########6| 2906/3000 [1:21:18<03:03,  1.95s/it, lr: 1.0e-04 loss: 7.552e-02]
a-cold-wall:  97%|#########6| 2907/3000 [1:21:18<02:29,  1.61s/it, lr: 1.0e-04 loss: 7.552e-02]
a-cold-wall:  97%|#########6| 2907/3000 [1:21:18<02:29,  1.61s/it, lr: 1.0e-04 loss: 7.552e-02]
a-cold-wall:  97%|#########6| 2907/3000 [1:21:19<02:29,  1.61s/it, lr: 1.0e-04 loss: 1.293e-01]
a-cold-wall:  97%|#########6| 2907/3000 [1:21:19<02:29,  1.61s/it, lr: 1.0e-04 loss: 1.293e-01]
a-cold-wall:  97%|#########6| 2908/3000 [1:21:19<02:05,  1.36s/it, lr: 1.0e-04 loss: 1.293e-01]
a-cold-wall:  97%|#########6| 2908/3000 [1:21:19<02:05,  1.36s/it, lr: 1.0e-04 loss: 1.293e-01]
a-cold-wall:  97%|#########6| 2908/3000 [1:21:20<02:05,  1.36s/it, lr: 1.0e-04 loss: 8.700e-01]
a-cold-wall:  97%|#########6| 2908/3000 [1:21:20<02:05,  1.36s/it, lr: 1.0e-04 loss: 8.700e-01]
a-cold-wall:  97%|#########6| 2909/3000 [1:21:20<02:06,  1.39s/it, lr: 1.0e-04 loss: 8.700e-01]
a-cold-wall:  97%|#########6| 2909/3000 [1:21:20<02:06,  1.39s/it, lr: 1.0e-04 loss: 8.700e-01]
a-cold-wall:  97%|#########6| 2909/3000 [1:21:23<02:06,  1.39s/it, lr: 1.0e-04 loss: 3.835e-01]
a-cold-wall:  97%|#########6| 2909/3000 [1:21:23<02:06,  1.39s/it, lr: 1.0e-04 loss: 3.835e-01]
a-cold-wall:  97%|#########7| 2910/3000 [1:21:24<02:05,  1.39s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  97%|#########7| 2910/3000 [1:21:24<02:05,  1.39s/it, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  97%|#########7| 2911/3000 [1:21:24<01:22,  1.08it/s, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  97%|#########7| 2911/3000 [1:21:24<01:22,  1.08it/s, lr: 1.0e-04 loss: 0.000e+00]
a-cold-wall:  97%|#########7| 2911/3000 [1:21:25<01:22,  1.08it/s, lr: 1.0e-04 loss: 2.050e-01]
a-cold-wall:  97%|#########7| 2911/3000 [1:21:25<01:22,  1.08it/s, lr: 1.0e-04 loss: 2.050e-01]
a-cold-wall:  97%|#########7| 2912/3000 [1:21:25<01:32,  1.05s/it, lr: 1.0e-04 loss: 2.050e-01]
a-cold-wall:  97%|#########7| 2912/3000 [1:21:25<01:32,  1.05s/it, lr: 1.0e-04 loss: 2.050e-01]
a-cold-wall:  97%|#########7| 2912/3000 [1:21:26<01:32,  1.05s/it, lr: 1.0e-04 loss: 4.462e-01]
a-cold-wall:  97%|#########7| 2912/3000 [1:21:26<01:32,  1.05s/it, lr: 1.0e-04 loss: 4.462e-01]
a-cold-wall:  97%|#########7| 2913/3000 [1:21:26<01:24,  1.03it/s, lr: 1.0e-04 loss: 4.462e-01]
a-cold-wall:  97%|#########7| 2913/3000 [1:21:26<01:24,  1.03it/s, lr: 1.0e-04 loss: 4.462e-01]
a-cold-wall:  97%|#########7| 2913/3000 [1:21:29<01:24,  1.03it/s, lr: 1.0e-04 loss: 4.277e-01]
a-cold-wall:  97%|#########7| 2913/3000 [1:21:29<01:24,  1.03it/s, lr: 1.0e-04 loss: 4.277e-01]
a-cold-wall:  97%|#########7| 2914/3000 [1:21:29<02:08,  1.50s/it, lr: 1.0e-04 loss: 4.277e-01]
a-cold-wall:  97%|#########7| 2914/3000 [1:21:29<02:08,  1.50s/it, lr: 1.0e-04 loss: 4.277e-01]
a-cold-wall:  97%|#########7| 2914/3000 [1:21:30<02:08,  1.50s/it, lr: 1.0e-04 loss: 2.163e-01]
a-cold-wall:  97%|#########7| 2914/3000 [1:21:30<02:08,  1.50s/it, lr: 1.0e-04 loss: 2.163e-01]
a-cold-wall:  97%|#########7| 2915/3000 [1:21:30<01:55,  1.36s/it, lr: 1.0e-04 loss: 2.163e-01]
a-cold-wall:  97%|#########7| 2915/3000 [1:21:30<01:55,  1.36s/it, lr: 1.0e-04 loss: 2.163e-01]
a-cold-wall:  97%|#########7| 2915/3000 [1:21:31<01:55,  1.36s/it, lr: 1.0e-04 loss: 3.498e-01]
a-cold-wall:  97%|#########7| 2915/3000 [1:21:31<01:55,  1.36s/it, lr: 1.0e-04 loss: 3.498e-01]
a-cold-wall:  97%|#########7| 2916/3000 [1:21:31<01:39,  1.18s/it, lr: 1.0e-04 loss: 3.498e-01]
a-cold-wall:  97%|#########7| 2916/3000 [1:21:31<01:39,  1.18s/it, lr: 1.0e-04 loss: 3.498e-01]
a-cold-wall:  97%|#########7| 2916/3000 [1:21:33<01:39,  1.18s/it, lr: 1.0e-04 loss: 4.304e-01]
a-cold-wall:  97%|#########7| 2916/3000 [1:21:33<01:39,  1.18s/it, lr: 1.0e-04 loss: 4.304e-01]
a-cold-wall:  97%|#########7| 2917/3000 [1:21:33<02:18,  1.67s/it, lr: 1.0e-04 loss: 4.304e-01]
a-cold-wall:  97%|#########7| 2917/3000 [1:21:33<02:18,  1.67s/it, lr: 1.0e-04 loss: 4.304e-01]
a-cold-wall:  97%|#########7| 2917/3000 [1:21:35<02:18,  1.67s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  97%|#########7| 2917/3000 [1:21:35<02:18,  1.67s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  97%|#########7| 2918/3000 [1:21:35<02:11,  1.60s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  97%|#########7| 2918/3000 [1:21:35<02:11,  1.60s/it, lr: 1.0e-04 loss: 4.321e-01]
a-cold-wall:  97%|#########7| 2918/3000 [1:21:36<02:11,  1.60s/it, lr: 1.0e-04 loss: 8.992e-02]
a-cold-wall:  97%|#########7| 2918/3000 [1:21:36<02:11,  1.60s/it, lr: 1.0e-04 loss: 8.992e-02]
a-cold-wall:  97%|#########7| 2919/3000 [1:21:36<02:05,  1.55s/it, lr: 1.0e-04 loss: 8.992e-02]
a-cold-wall:  97%|#########7| 2919/3000 [1:21:36<02:05,  1.55s/it, lr: 1.0e-04 loss: 8.992e-02]
a-cold-wall:  97%|#########7| 2919/3000 [1:21:37<02:05,  1.55s/it, lr: 1.0e-04 loss: 5.813e-01]
a-cold-wall:  97%|#########7| 2919/3000 [1:21:37<02:05,  1.55s/it, lr: 1.0e-04 loss: 5.813e-01]
a-cold-wall:  97%|#########7| 2920/3000 [1:21:38<02:04,  1.55s/it, lr: 1.0e-04 loss: 6.338e-01]
a-cold-wall:  97%|#########7| 2920/3000 [1:21:38<02:04,  1.55s/it, lr: 1.0e-04 loss: 6.338e-01]
a-cold-wall:  97%|#########7| 2921/3000 [1:21:38<01:32,  1.17s/it, lr: 1.0e-04 loss: 6.338e-01]
a-cold-wall:  97%|#########7| 2921/3000 [1:21:38<01:32,  1.17s/it, lr: 1.0e-04 loss: 6.338e-01]
a-cold-wall:  97%|#########7| 2921/3000 [1:21:41<01:32,  1.17s/it, lr: 1.0e-04 loss: 1.623e-01]
a-cold-wall:  97%|#########7| 2921/3000 [1:21:41<01:32,  1.17s/it, lr: 1.0e-04 loss: 1.623e-01]
a-cold-wall:  97%|#########7| 2922/3000 [1:21:41<02:03,  1.59s/it, lr: 1.0e-04 loss: 1.623e-01]
a-cold-wall:  97%|#########7| 2922/3000 [1:21:41<02:03,  1.59s/it, lr: 1.0e-04 loss: 1.623e-01]
a-cold-wall:  97%|#########7| 2922/3000 [1:21:44<02:03,  1.59s/it, lr: 1.0e-04 loss: 3.178e-01]
a-cold-wall:  97%|#########7| 2922/3000 [1:21:44<02:03,  1.59s/it, lr: 1.0e-04 loss: 3.178e-01]
a-cold-wall:  97%|#########7| 2923/3000 [1:21:44<02:27,  1.92s/it, lr: 1.0e-04 loss: 3.178e-01]
a-cold-wall:  97%|#########7| 2923/3000 [1:21:44<02:27,  1.92s/it, lr: 1.0e-04 loss: 3.178e-01]
a-cold-wall:  97%|#########7| 2923/3000 [1:21:47<02:27,  1.92s/it, lr: 1.0e-04 loss: 1.767e-01]
a-cold-wall:  97%|#########7| 2923/3000 [1:21:47<02:27,  1.92s/it, lr: 1.0e-04 loss: 1.767e-01]
a-cold-wall:  97%|#########7| 2924/3000 [1:21:47<02:44,  2.17s/it, lr: 1.0e-04 loss: 1.767e-01]
a-cold-wall:  97%|#########7| 2924/3000 [1:21:47<02:44,  2.17s/it, lr: 1.0e-04 loss: 1.767e-01]
a-cold-wall:  97%|#########7| 2924/3000 [1:21:50<02:44,  2.17s/it, lr: 1.0e-04 loss: 3.389e-01]
a-cold-wall:  97%|#########7| 2924/3000 [1:21:50<02:44,  2.17s/it, lr: 1.0e-04 loss: 3.389e-01]
a-cold-wall:  98%|#########7| 2925/3000 [1:21:50<02:56,  2.36s/it, lr: 1.0e-04 loss: 3.389e-01]
a-cold-wall:  98%|#########7| 2925/3000 [1:21:50<02:56,  2.36s/it, lr: 1.0e-04 loss: 3.389e-01]
a-cold-wall:  98%|#########7| 2925/3000 [1:21:51<02:56,  2.36s/it, lr: 1.0e-04 loss: 3.975e-01]
a-cold-wall:  98%|#########7| 2925/3000 [1:21:51<02:56,  2.36s/it, lr: 1.0e-04 loss: 3.975e-01]
a-cold-wall:  98%|#########7| 2926/3000 [1:21:51<02:20,  1.89s/it, lr: 1.0e-04 loss: 3.975e-01]
a-cold-wall:  98%|#########7| 2926/3000 [1:21:51<02:20,  1.89s/it, lr: 1.0e-04 loss: 3.975e-01]
a-cold-wall:  98%|#########7| 2926/3000 [1:21:53<02:20,  1.89s/it, lr: 1.0e-04 loss: 2.659e-01]
a-cold-wall:  98%|#########7| 2926/3000 [1:21:53<02:20,  1.89s/it, lr: 1.0e-04 loss: 2.659e-01]
a-cold-wall:  98%|#########7| 2927/3000 [1:21:53<02:38,  2.17s/it, lr: 1.0e-04 loss: 2.659e-01]
a-cold-wall:  98%|#########7| 2927/3000 [1:21:53<02:38,  2.17s/it, lr: 1.0e-04 loss: 2.659e-01]
a-cold-wall:  98%|#########7| 2927/3000 [1:21:55<02:38,  2.17s/it, lr: 1.0e-04 loss: 1.007e-01]
a-cold-wall:  98%|#########7| 2927/3000 [1:21:55<02:38,  2.17s/it, lr: 1.0e-04 loss: 1.007e-01]
a-cold-wall:  98%|#########7| 2928/3000 [1:21:55<02:24,  2.00s/it, lr: 1.0e-04 loss: 1.007e-01]
a-cold-wall:  98%|#########7| 2928/3000 [1:21:55<02:24,  2.00s/it, lr: 1.0e-04 loss: 1.007e-01]
a-cold-wall:  98%|#########7| 2928/3000 [1:21:57<02:24,  2.00s/it, lr: 1.0e-04 loss: 6.578e-01]
a-cold-wall:  98%|#########7| 2928/3000 [1:21:57<02:24,  2.00s/it, lr: 1.0e-04 loss: 6.578e-01]
a-cold-wall:  98%|#########7| 2929/3000 [1:21:57<02:09,  1.83s/it, lr: 1.0e-04 loss: 6.578e-01]
a-cold-wall:  98%|#########7| 2929/3000 [1:21:57<02:09,  1.83s/it, lr: 1.0e-04 loss: 6.578e-01]
a-cold-wall:  98%|#########7| 2929/3000 [1:21:57<02:09,  1.83s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  98%|#########7| 2929/3000 [1:21:57<02:09,  1.83s/it, lr: 1.0e-04 loss: 4.673e-01]
a-cold-wall:  98%|#########7| 2930/3000 [1:21:59<02:08,  1.83s/it, lr: 1.0e-04 loss: 6.847e-01]
a-cold-wall:  98%|#########7| 2930/3000 [1:21:59<02:08,  1.83s/it, lr: 1.0e-04 loss: 6.847e-01]
a-cold-wall:  98%|#########7| 2931/3000 [1:21:59<01:30,  1.32s/it, lr: 1.0e-04 loss: 6.847e-01]
a-cold-wall:  98%|#########7| 2931/3000 [1:21:59<01:30,  1.32s/it, lr: 1.0e-04 loss: 6.847e-01]
a-cold-wall:  98%|#########7| 2931/3000 [1:22:00<01:30,  1.32s/it, lr: 1.0e-04 loss: 7.039e-01]
a-cold-wall:  98%|#########7| 2931/3000 [1:22:00<01:30,  1.32s/it, lr: 1.0e-04 loss: 7.039e-01]
a-cold-wall:  98%|#########7| 2932/3000 [1:22:00<01:31,  1.34s/it, lr: 1.0e-04 loss: 7.039e-01]
a-cold-wall:  98%|#########7| 2932/3000 [1:22:00<01:31,  1.34s/it, lr: 1.0e-04 loss: 7.039e-01]
a-cold-wall:  98%|#########7| 2932/3000 [1:22:03<01:31,  1.34s/it, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  98%|#########7| 2932/3000 [1:22:03<01:31,  1.34s/it, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  98%|#########7| 2933/3000 [1:22:03<01:56,  1.74s/it, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  98%|#########7| 2933/3000 [1:22:03<01:56,  1.74s/it, lr: 1.0e-04 loss: 3.817e-01]
a-cold-wall:  98%|#########7| 2933/3000 [1:22:04<01:56,  1.74s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  98%|#########7| 2933/3000 [1:22:04<01:56,  1.74s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  98%|#########7| 2934/3000 [1:22:04<01:49,  1.66s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  98%|#########7| 2934/3000 [1:22:04<01:49,  1.66s/it, lr: 1.0e-04 loss: 3.282e-01]
a-cold-wall:  98%|#########7| 2934/3000 [1:22:05<01:49,  1.66s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  98%|#########7| 2934/3000 [1:22:05<01:49,  1.66s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  98%|#########7| 2935/3000 [1:22:05<01:31,  1.41s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  98%|#########7| 2935/3000 [1:22:05<01:31,  1.41s/it, lr: 1.0e-04 loss: 4.046e-01]
a-cold-wall:  98%|#########7| 2935/3000 [1:22:08<01:31,  1.41s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  98%|#########7| 2935/3000 [1:22:08<01:31,  1.41s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  98%|#########7| 2936/3000 [1:22:08<01:57,  1.83s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  98%|#########7| 2936/3000 [1:22:08<01:57,  1.83s/it, lr: 1.0e-04 loss: 1.956e-01]
a-cold-wall:  98%|#########7| 2936/3000 [1:22:09<01:57,  1.83s/it, lr: 1.0e-04 loss: 1.669e-01]
a-cold-wall:  98%|#########7| 2936/3000 [1:22:09<01:57,  1.83s/it, lr: 1.0e-04 loss: 1.669e-01]
a-cold-wall:  98%|#########7| 2937/3000 [1:22:09<01:47,  1.71s/it, lr: 1.0e-04 loss: 1.669e-01]
a-cold-wall:  98%|#########7| 2937/3000 [1:22:09<01:47,  1.71s/it, lr: 1.0e-04 loss: 1.669e-01]
a-cold-wall:  98%|#########7| 2937/3000 [1:22:12<01:47,  1.71s/it, lr: 1.0e-04 loss: 2.612e-01]
a-cold-wall:  98%|#########7| 2937/3000 [1:22:12<01:47,  1.71s/it, lr: 1.0e-04 loss: 2.612e-01]
a-cold-wall:  98%|#########7| 2938/3000 [1:22:12<02:07,  2.05s/it, lr: 1.0e-04 loss: 2.612e-01]
a-cold-wall:  98%|#########7| 2938/3000 [1:22:12<02:07,  2.05s/it, lr: 1.0e-04 loss: 2.612e-01]
a-cold-wall:  98%|#########7| 2938/3000 [1:22:13<02:07,  2.05s/it, lr: 1.0e-04 loss: 9.914e-02]
a-cold-wall:  98%|#########7| 2938/3000 [1:22:13<02:07,  2.05s/it, lr: 1.0e-04 loss: 9.914e-02]
a-cold-wall:  98%|#########7| 2939/3000 [1:22:13<01:41,  1.66s/it, lr: 1.0e-04 loss: 9.914e-02]
a-cold-wall:  98%|#########7| 2939/3000 [1:22:13<01:41,  1.66s/it, lr: 1.0e-04 loss: 9.914e-02]
a-cold-wall:  98%|#########7| 2939/3000 [1:22:17<01:41,  1.66s/it, lr: 1.0e-04 loss: 6.077e-01]
a-cold-wall:  98%|#########7| 2939/3000 [1:22:17<01:41,  1.66s/it, lr: 1.0e-04 loss: 6.077e-01]
a-cold-wall:  98%|#########8| 2940/3000 [1:22:19<01:39,  1.66s/it, lr: 1.0e-04 loss: 3.423e-02]
a-cold-wall:  98%|#########8| 2940/3000 [1:22:19<01:39,  1.66s/it, lr: 1.0e-04 loss: 3.423e-02]
a-cold-wall:  98%|#########8| 2941/3000 [1:22:19<01:31,  1.56s/it, lr: 1.0e-04 loss: 3.423e-02]
a-cold-wall:  98%|#########8| 2941/3000 [1:22:19<01:31,  1.56s/it, lr: 1.0e-04 loss: 3.423e-02]
a-cold-wall:  98%|#########8| 2941/3000 [1:22:22<01:31,  1.56s/it, lr: 1.0e-04 loss: 4.137e-01]
a-cold-wall:  98%|#########8| 2941/3000 [1:22:22<01:31,  1.56s/it, lr: 1.0e-04 loss: 4.137e-01]
a-cold-wall:  98%|#########8| 2942/3000 [1:22:22<01:48,  1.88s/it, lr: 1.0e-04 loss: 4.137e-01]
a-cold-wall:  98%|#########8| 2942/3000 [1:22:22<01:48,  1.88s/it, lr: 1.0e-04 loss: 4.137e-01]
a-cold-wall:  98%|#########8| 2942/3000 [1:22:24<01:48,  1.88s/it, lr: 1.0e-04 loss: 2.613e-01]
a-cold-wall:  98%|#########8| 2942/3000 [1:22:24<01:48,  1.88s/it, lr: 1.0e-04 loss: 2.613e-01]
a-cold-wall:  98%|#########8| 2943/3000 [1:22:24<01:43,  1.82s/it, lr: 1.0e-04 loss: 2.613e-01]
a-cold-wall:  98%|#########8| 2943/3000 [1:22:24<01:43,  1.82s/it, lr: 1.0e-04 loss: 2.613e-01]
a-cold-wall:  98%|#########8| 2943/3000 [1:22:25<01:43,  1.82s/it, lr: 1.0e-04 loss: 4.567e-01]
a-cold-wall:  98%|#########8| 2943/3000 [1:22:25<01:43,  1.82s/it, lr: 1.0e-04 loss: 4.567e-01]
a-cold-wall:  98%|#########8| 2944/3000 [1:22:25<01:36,  1.72s/it, lr: 1.0e-04 loss: 4.567e-01]
a-cold-wall:  98%|#########8| 2944/3000 [1:22:25<01:36,  1.72s/it, lr: 1.0e-04 loss: 4.567e-01]
a-cold-wall:  98%|#########8| 2944/3000 [1:22:26<01:36,  1.72s/it, lr: 1.0e-04 loss: 4.129e-01]
a-cold-wall:  98%|#########8| 2944/3000 [1:22:26<01:36,  1.72s/it, lr: 1.0e-04 loss: 4.129e-01]
a-cold-wall:  98%|#########8| 2945/3000 [1:22:26<01:19,  1.45s/it, lr: 1.0e-04 loss: 4.129e-01]
a-cold-wall:  98%|#########8| 2945/3000 [1:22:26<01:19,  1.45s/it, lr: 1.0e-04 loss: 4.129e-01]
a-cold-wall:  98%|#########8| 2945/3000 [1:22:28<01:19,  1.45s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  98%|#########8| 2945/3000 [1:22:28<01:19,  1.45s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  98%|#########8| 2946/3000 [1:22:28<01:17,  1.44s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  98%|#########8| 2946/3000 [1:22:28<01:17,  1.44s/it, lr: 1.0e-04 loss: 5.298e-01]
a-cold-wall:  98%|#########8| 2946/3000 [1:22:30<01:17,  1.44s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:  98%|#########8| 2946/3000 [1:22:30<01:17,  1.44s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:  98%|#########8| 2947/3000 [1:22:30<01:38,  1.86s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:  98%|#########8| 2947/3000 [1:22:30<01:38,  1.86s/it, lr: 1.0e-04 loss: 5.792e-01]
a-cold-wall:  98%|#########8| 2947/3000 [1:22:32<01:38,  1.86s/it, lr: 1.0e-04 loss: 2.321e-01]
a-cold-wall:  98%|#########8| 2947/3000 [1:22:32<01:38,  1.86s/it, lr: 1.0e-04 loss: 2.321e-01]
a-cold-wall:  98%|#########8| 2948/3000 [1:22:32<01:30,  1.73s/it, lr: 1.0e-04 loss: 2.321e-01]
a-cold-wall:  98%|#########8| 2948/3000 [1:22:32<01:30,  1.73s/it, lr: 1.0e-04 loss: 2.321e-01]
a-cold-wall:  98%|#########8| 2948/3000 [1:22:33<01:30,  1.73s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  98%|#########8| 2948/3000 [1:22:33<01:30,  1.73s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  98%|#########8| 2949/3000 [1:22:33<01:13,  1.44s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  98%|#########8| 2949/3000 [1:22:33<01:13,  1.44s/it, lr: 1.0e-04 loss: 5.144e-02]
a-cold-wall:  98%|#########8| 2949/3000 [1:22:36<01:13,  1.44s/it, lr: 1.0e-04 loss: 1.715e-01]
a-cold-wall:  98%|#########8| 2949/3000 [1:22:36<01:13,  1.44s/it, lr: 1.0e-04 loss: 1.715e-01]
a-cold-wall:  98%|#########8| 2950/3000 [1:22:37<01:11,  1.44s/it, lr: 1.0e-04 loss: 4.766e-01]
a-cold-wall:  98%|#########8| 2950/3000 [1:22:37<01:11,  1.44s/it, lr: 1.0e-04 loss: 4.766e-01]
a-cold-wall:  98%|#########8| 2951/3000 [1:22:37<00:54,  1.10s/it, lr: 1.0e-04 loss: 4.766e-01]
a-cold-wall:  98%|#########8| 2951/3000 [1:22:37<00:54,  1.10s/it, lr: 1.0e-04 loss: 4.766e-01]
a-cold-wall:  98%|#########8| 2951/3000 [1:22:40<00:54,  1.10s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:  98%|#########8| 2951/3000 [1:22:40<00:54,  1.10s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:  98%|#########8| 2952/3000 [1:22:40<01:14,  1.54s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:  98%|#########8| 2952/3000 [1:22:40<01:14,  1.54s/it, lr: 1.0e-04 loss: 5.278e-01]
a-cold-wall:  98%|#########8| 2952/3000 [1:22:43<01:14,  1.54s/it, lr: 1.0e-04 loss: 2.190e-02]
a-cold-wall:  98%|#########8| 2952/3000 [1:22:43<01:14,  1.54s/it, lr: 1.0e-04 loss: 2.190e-02]
a-cold-wall:  98%|#########8| 2953/3000 [1:22:43<01:28,  1.88s/it, lr: 1.0e-04 loss: 2.190e-02]
a-cold-wall:  98%|#########8| 2953/3000 [1:22:43<01:28,  1.88s/it, lr: 1.0e-04 loss: 2.190e-02]
a-cold-wall:  98%|#########8| 2953/3000 [1:22:44<01:28,  1.88s/it, lr: 1.0e-04 loss: 7.408e-01]
a-cold-wall:  98%|#########8| 2953/3000 [1:22:44<01:28,  1.88s/it, lr: 1.0e-04 loss: 7.408e-01]
a-cold-wall:  98%|#########8| 2954/3000 [1:22:44<01:20,  1.76s/it, lr: 1.0e-04 loss: 7.408e-01]
a-cold-wall:  98%|#########8| 2954/3000 [1:22:44<01:20,  1.76s/it, lr: 1.0e-04 loss: 7.408e-01]
a-cold-wall:  98%|#########8| 2954/3000 [1:22:45<01:20,  1.76s/it, lr: 1.0e-04 loss: 3.283e-01]
a-cold-wall:  98%|#########8| 2954/3000 [1:22:45<01:20,  1.76s/it, lr: 1.0e-04 loss: 3.283e-01]
a-cold-wall:  98%|#########8| 2955/3000 [1:22:45<01:06,  1.48s/it, lr: 1.0e-04 loss: 3.283e-01]
a-cold-wall:  98%|#########8| 2955/3000 [1:22:45<01:06,  1.48s/it, lr: 1.0e-04 loss: 3.283e-01]
a-cold-wall:  98%|#########8| 2955/3000 [1:22:46<01:06,  1.48s/it, lr: 1.0e-04 loss: 9.066e-02]
a-cold-wall:  98%|#########8| 2955/3000 [1:22:46<01:06,  1.48s/it, lr: 1.0e-04 loss: 9.066e-02]
a-cold-wall:  99%|#########8| 2956/3000 [1:22:46<01:04,  1.46s/it, lr: 1.0e-04 loss: 9.066e-02]
a-cold-wall:  99%|#########8| 2956/3000 [1:22:46<01:04,  1.46s/it, lr: 1.0e-04 loss: 9.066e-02]
a-cold-wall:  99%|#########8| 2956/3000 [1:22:47<01:04,  1.46s/it, lr: 1.0e-04 loss: 5.258e-02]
a-cold-wall:  99%|#########8| 2956/3000 [1:22:47<01:04,  1.46s/it, lr: 1.0e-04 loss: 5.258e-02]
a-cold-wall:  99%|#########8| 2957/3000 [1:22:47<00:56,  1.32s/it, lr: 1.0e-04 loss: 5.258e-02]
a-cold-wall:  99%|#########8| 2957/3000 [1:22:47<00:56,  1.32s/it, lr: 1.0e-04 loss: 5.258e-02]
a-cold-wall:  99%|#########8| 2957/3000 [1:22:48<00:56,  1.32s/it, lr: 1.0e-04 loss: 5.311e-01]
a-cold-wall:  99%|#########8| 2957/3000 [1:22:48<00:56,  1.32s/it, lr: 1.0e-04 loss: 5.311e-01]
a-cold-wall:  99%|#########8| 2958/3000 [1:22:48<00:48,  1.16s/it, lr: 1.0e-04 loss: 5.311e-01]
a-cold-wall:  99%|#########8| 2958/3000 [1:22:48<00:48,  1.16s/it, lr: 1.0e-04 loss: 5.311e-01]
a-cold-wall:  99%|#########8| 2958/3000 [1:22:51<00:48,  1.16s/it, lr: 1.0e-04 loss: 2.334e-01]
a-cold-wall:  99%|#########8| 2958/3000 [1:22:51<00:48,  1.16s/it, lr: 1.0e-04 loss: 2.334e-01]
a-cold-wall:  99%|#########8| 2959/3000 [1:22:51<01:08,  1.67s/it, lr: 1.0e-04 loss: 2.334e-01]
a-cold-wall:  99%|#########8| 2959/3000 [1:22:51<01:08,  1.67s/it, lr: 1.0e-04 loss: 2.334e-01]
a-cold-wall:  99%|#########8| 2959/3000 [1:22:52<01:08,  1.67s/it, lr: 1.0e-04 loss: 5.988e-01]
a-cold-wall:  99%|#########8| 2959/3000 [1:22:52<01:08,  1.67s/it, lr: 1.0e-04 loss: 5.988e-01]
a-cold-wall:  99%|#########8| 2960/3000 [1:22:52<01:06,  1.67s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  99%|#########8| 2960/3000 [1:22:52<01:06,  1.67s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  99%|#########8| 2961/3000 [1:22:52<00:41,  1.08s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  99%|#########8| 2961/3000 [1:22:52<00:41,  1.08s/it, lr: 1.0e-04 loss: 5.373e-01]
a-cold-wall:  99%|#########8| 2961/3000 [1:22:55<00:41,  1.08s/it, lr: 1.0e-04 loss: 2.577e-01]
a-cold-wall:  99%|#########8| 2961/3000 [1:22:55<00:41,  1.08s/it, lr: 1.0e-04 loss: 2.577e-01]
a-cold-wall:  99%|#########8| 2962/3000 [1:22:55<00:58,  1.53s/it, lr: 1.0e-04 loss: 2.577e-01]
a-cold-wall:  99%|#########8| 2962/3000 [1:22:55<00:58,  1.53s/it, lr: 1.0e-04 loss: 2.577e-01]
a-cold-wall:  99%|#########8| 2962/3000 [1:22:57<00:58,  1.53s/it, lr: 1.0e-04 loss: 1.094e-01]
a-cold-wall:  99%|#########8| 2962/3000 [1:22:57<00:58,  1.53s/it, lr: 1.0e-04 loss: 1.094e-01]
a-cold-wall:  99%|#########8| 2963/3000 [1:22:57<00:55,  1.51s/it, lr: 1.0e-04 loss: 1.094e-01]
a-cold-wall:  99%|#########8| 2963/3000 [1:22:57<00:55,  1.51s/it, lr: 1.0e-04 loss: 1.094e-01]
a-cold-wall:  99%|#########8| 2963/3000 [1:23:00<00:55,  1.51s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  99%|#########8| 2963/3000 [1:23:00<00:55,  1.51s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  99%|#########8| 2964/3000 [1:23:00<01:07,  1.88s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  99%|#########8| 2964/3000 [1:23:00<01:07,  1.88s/it, lr: 1.0e-04 loss: 3.841e-01]
a-cold-wall:  99%|#########8| 2964/3000 [1:23:03<01:07,  1.88s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  99%|#########8| 2964/3000 [1:23:03<01:07,  1.88s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  99%|#########8| 2965/3000 [1:23:03<01:15,  2.16s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  99%|#########8| 2965/3000 [1:23:03<01:15,  2.16s/it, lr: 1.0e-04 loss: 4.543e-01]
a-cold-wall:  99%|#########8| 2965/3000 [1:23:04<01:15,  2.16s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  99%|#########8| 2965/3000 [1:23:04<01:15,  2.16s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  99%|#########8| 2966/3000 [1:23:04<01:06,  1.97s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  99%|#########8| 2966/3000 [1:23:04<01:06,  1.97s/it, lr: 1.0e-04 loss: 5.012e-01]
a-cold-wall:  99%|#########8| 2966/3000 [1:23:05<01:06,  1.97s/it, lr: 1.0e-04 loss: 2.570e-01]
a-cold-wall:  99%|#########8| 2966/3000 [1:23:05<01:06,  1.97s/it, lr: 1.0e-04 loss: 2.570e-01]
a-cold-wall:  99%|#########8| 2967/3000 [1:23:05<00:55,  1.68s/it, lr: 1.0e-04 loss: 2.570e-01]
a-cold-wall:  99%|#########8| 2967/3000 [1:23:05<00:55,  1.68s/it, lr: 1.0e-04 loss: 2.570e-01]
a-cold-wall:  99%|#########8| 2967/3000 [1:23:06<00:55,  1.68s/it, lr: 1.0e-04 loss: 2.226e-01]
a-cold-wall:  99%|#########8| 2967/3000 [1:23:06<00:55,  1.68s/it, lr: 1.0e-04 loss: 2.226e-01]
a-cold-wall:  99%|#########8| 2968/3000 [1:23:06<00:51,  1.60s/it, lr: 1.0e-04 loss: 2.226e-01]
a-cold-wall:  99%|#########8| 2968/3000 [1:23:06<00:51,  1.60s/it, lr: 1.0e-04 loss: 2.226e-01]
a-cold-wall:  99%|#########8| 2968/3000 [1:23:09<00:51,  1.60s/it, lr: 1.0e-04 loss: 7.776e-01]
a-cold-wall:  99%|#########8| 2968/3000 [1:23:09<00:51,  1.60s/it, lr: 1.0e-04 loss: 7.776e-01]
a-cold-wall:  99%|#########8| 2969/3000 [1:23:09<01:01,  1.99s/it, lr: 1.0e-04 loss: 7.776e-01]
a-cold-wall:  99%|#########8| 2969/3000 [1:23:09<01:01,  1.99s/it, lr: 1.0e-04 loss: 7.776e-01]
a-cold-wall:  99%|#########8| 2969/3000 [1:23:12<01:01,  1.99s/it, lr: 1.0e-04 loss: 7.575e-01]
a-cold-wall:  99%|#########8| 2969/3000 [1:23:12<01:01,  1.99s/it, lr: 1.0e-04 loss: 7.575e-01]
a-cold-wall:  99%|#########9| 2970/3000 [1:23:15<00:59,  1.99s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  99%|#########9| 2970/3000 [1:23:15<00:59,  1.99s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  99%|#########9| 2971/3000 [1:23:15<00:50,  1.75s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  99%|#########9| 2971/3000 [1:23:15<00:50,  1.75s/it, lr: 1.0e-04 loss: 4.608e-01]
a-cold-wall:  99%|#########9| 2971/3000 [1:23:16<00:50,  1.75s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  99%|#########9| 2971/3000 [1:23:16<00:50,  1.75s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  99%|#########9| 2972/3000 [1:23:16<00:42,  1.50s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  99%|#########9| 2972/3000 [1:23:16<00:42,  1.50s/it, lr: 1.0e-04 loss: 6.964e-01]
a-cold-wall:  99%|#########9| 2972/3000 [1:23:18<00:42,  1.50s/it, lr: 1.0e-04 loss: 5.741e-01]
a-cold-wall:  99%|#########9| 2972/3000 [1:23:18<00:42,  1.50s/it, lr: 1.0e-04 loss: 5.741e-01]
a-cold-wall:  99%|#########9| 2973/3000 [1:23:18<00:40,  1.49s/it, lr: 1.0e-04 loss: 5.741e-01]
a-cold-wall:  99%|#########9| 2973/3000 [1:23:18<00:40,  1.49s/it, lr: 1.0e-04 loss: 5.741e-01]
a-cold-wall:  99%|#########9| 2973/3000 [1:23:18<00:40,  1.49s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  99%|#########9| 2973/3000 [1:23:18<00:40,  1.49s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  99%|#########9| 2974/3000 [1:23:18<00:33,  1.29s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  99%|#########9| 2974/3000 [1:23:18<00:33,  1.29s/it, lr: 1.0e-04 loss: 2.990e-01]
a-cold-wall:  99%|#########9| 2974/3000 [1:23:21<00:33,  1.29s/it, lr: 1.0e-04 loss: 5.708e-01]
a-cold-wall:  99%|#########9| 2974/3000 [1:23:21<00:33,  1.29s/it, lr: 1.0e-04 loss: 5.708e-01]
a-cold-wall:  99%|#########9| 2975/3000 [1:23:21<00:43,  1.73s/it, lr: 1.0e-04 loss: 5.708e-01]
a-cold-wall:  99%|#########9| 2975/3000 [1:23:21<00:43,  1.73s/it, lr: 1.0e-04 loss: 5.708e-01]
a-cold-wall:  99%|#########9| 2975/3000 [1:23:22<00:43,  1.73s/it, lr: 1.0e-04 loss: 4.014e-01]
a-cold-wall:  99%|#########9| 2975/3000 [1:23:22<00:43,  1.73s/it, lr: 1.0e-04 loss: 4.014e-01]
a-cold-wall:  99%|#########9| 2976/3000 [1:23:22<00:35,  1.48s/it, lr: 1.0e-04 loss: 4.014e-01]
a-cold-wall:  99%|#########9| 2976/3000 [1:23:22<00:35,  1.48s/it, lr: 1.0e-04 loss: 4.014e-01]
a-cold-wall:  99%|#########9| 2976/3000 [1:23:25<00:35,  1.48s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  99%|#########9| 2976/3000 [1:23:25<00:35,  1.48s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  99%|#########9| 2977/3000 [1:23:25<00:43,  1.88s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  99%|#########9| 2977/3000 [1:23:25<00:43,  1.88s/it, lr: 1.0e-04 loss: 1.122e-01]
a-cold-wall:  99%|#########9| 2977/3000 [1:23:26<00:43,  1.88s/it, lr: 1.0e-04 loss: 7.120e-02]
a-cold-wall:  99%|#########9| 2977/3000 [1:23:26<00:43,  1.88s/it, lr: 1.0e-04 loss: 7.120e-02]
a-cold-wall:  99%|#########9| 2978/3000 [1:23:26<00:38,  1.75s/it, lr: 1.0e-04 loss: 7.120e-02]
a-cold-wall:  99%|#########9| 2978/3000 [1:23:26<00:38,  1.75s/it, lr: 1.0e-04 loss: 7.120e-02]
a-cold-wall:  99%|#########9| 2978/3000 [1:23:27<00:38,  1.75s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:  99%|#########9| 2978/3000 [1:23:27<00:38,  1.75s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:  99%|#########9| 2979/3000 [1:23:27<00:32,  1.53s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:  99%|#########9| 2979/3000 [1:23:27<00:32,  1.53s/it, lr: 1.0e-04 loss: 4.583e-01]
a-cold-wall:  99%|#########9| 2979/3000 [1:23:30<00:32,  1.53s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  99%|#########9| 2979/3000 [1:23:30<00:32,  1.53s/it, lr: 1.0e-04 loss: 2.723e-01]
a-cold-wall:  99%|#########9| 2980/3000 [1:23:31<00:30,  1.53s/it, lr: 1.0e-04 loss: 3.473e-01]
a-cold-wall:  99%|#########9| 2980/3000 [1:23:31<00:30,  1.53s/it, lr: 1.0e-04 loss: 3.473e-01]
a-cold-wall:  99%|#########9| 2981/3000 [1:23:31<00:19,  1.01s/it, lr: 1.0e-04 loss: 3.473e-01]
a-cold-wall:  99%|#########9| 2981/3000 [1:23:31<00:19,  1.01s/it, lr: 1.0e-04 loss: 3.473e-01]
a-cold-wall:  99%|#########9| 2981/3000 [1:23:34<00:19,  1.01s/it, lr: 1.0e-04 loss: 2.655e-01]
a-cold-wall:  99%|#########9| 2981/3000 [1:23:34<00:19,  1.01s/it, lr: 1.0e-04 loss: 2.655e-01]
a-cold-wall:  99%|#########9| 2982/3000 [1:23:34<00:26,  1.48s/it, lr: 1.0e-04 loss: 2.655e-01]
a-cold-wall:  99%|#########9| 2982/3000 [1:23:34<00:26,  1.48s/it, lr: 1.0e-04 loss: 2.655e-01]
a-cold-wall:  99%|#########9| 2982/3000 [1:23:37<00:26,  1.48s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  99%|#########9| 2982/3000 [1:23:37<00:26,  1.48s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  99%|#########9| 2983/3000 [1:23:37<00:31,  1.87s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  99%|#########9| 2983/3000 [1:23:37<00:31,  1.87s/it, lr: 1.0e-04 loss: 3.681e-01]
a-cold-wall:  99%|#########9| 2983/3000 [1:23:38<00:31,  1.87s/it, lr: 1.0e-04 loss: 1.538e-01]
a-cold-wall:  99%|#########9| 2983/3000 [1:23:38<00:31,  1.87s/it, lr: 1.0e-04 loss: 1.538e-01]
a-cold-wall:  99%|#########9| 2984/3000 [1:23:39<00:28,  1.78s/it, lr: 1.0e-04 loss: 1.538e-01]
a-cold-wall:  99%|#########9| 2984/3000 [1:23:39<00:28,  1.78s/it, lr: 1.0e-04 loss: 1.538e-01]
a-cold-wall:  99%|#########9| 2984/3000 [1:23:39<00:28,  1.78s/it, lr: 1.0e-04 loss: 1.749e-01]
a-cold-wall:  99%|#########9| 2984/3000 [1:23:39<00:28,  1.78s/it, lr: 1.0e-04 loss: 1.749e-01]
a-cold-wall: 100%|#########9| 2985/3000 [1:23:39<00:22,  1.49s/it, lr: 1.0e-04 loss: 1.749e-01]
a-cold-wall: 100%|#########9| 2985/3000 [1:23:39<00:22,  1.49s/it, lr: 1.0e-04 loss: 1.749e-01]
a-cold-wall: 100%|#########9| 2985/3000 [1:23:41<00:22,  1.49s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall: 100%|#########9| 2985/3000 [1:23:41<00:22,  1.49s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall: 100%|#########9| 2986/3000 [1:23:41<00:20,  1.47s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall: 100%|#########9| 2986/3000 [1:23:41<00:20,  1.47s/it, lr: 1.0e-04 loss: 2.755e-01]
a-cold-wall: 100%|#########9| 2986/3000 [1:23:42<00:20,  1.47s/it, lr: 1.0e-04 loss: 3.462e-01]
a-cold-wall: 100%|#########9| 2986/3000 [1:23:42<00:20,  1.47s/it, lr: 1.0e-04 loss: 3.462e-01]
a-cold-wall: 100%|#########9| 2987/3000 [1:23:42<00:18,  1.46s/it, lr: 1.0e-04 loss: 3.462e-01]
a-cold-wall: 100%|#########9| 2987/3000 [1:23:42<00:18,  1.46s/it, lr: 1.0e-04 loss: 3.462e-01]
a-cold-wall: 100%|#########9| 2987/3000 [1:23:43<00:18,  1.46s/it, lr: 1.0e-04 loss: 4.736e-01]
a-cold-wall: 100%|#########9| 2987/3000 [1:23:43<00:18,  1.46s/it, lr: 1.0e-04 loss: 4.736e-01]
a-cold-wall: 100%|#########9| 2988/3000 [1:23:43<00:15,  1.26s/it, lr: 1.0e-04 loss: 4.736e-01]
a-cold-wall: 100%|#########9| 2988/3000 [1:23:43<00:15,  1.26s/it, lr: 1.0e-04 loss: 4.736e-01]
a-cold-wall: 100%|#########9| 2988/3000 [1:23:44<00:15,  1.26s/it, lr: 1.0e-04 loss: 7.275e-02]
a-cold-wall: 100%|#########9| 2988/3000 [1:23:44<00:15,  1.26s/it, lr: 1.0e-04 loss: 7.275e-02]
a-cold-wall: 100%|#########9| 2989/3000 [1:23:44<00:14,  1.31s/it, lr: 1.0e-04 loss: 7.275e-02]
a-cold-wall: 100%|#########9| 2989/3000 [1:23:44<00:14,  1.31s/it, lr: 1.0e-04 loss: 7.275e-02]
a-cold-wall: 100%|#########9| 2989/3000 [1:23:47<00:14,  1.31s/it, lr: 1.0e-04 loss: 6.010e-01]
a-cold-wall: 100%|#########9| 2989/3000 [1:23:47<00:14,  1.31s/it, lr: 1.0e-04 loss: 6.010e-01]
a-cold-wall: 100%|#########9| 2990/3000 [1:23:49<00:13,  1.31s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall: 100%|#########9| 2990/3000 [1:23:49<00:13,  1.31s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall: 100%|#########9| 2991/3000 [1:23:49<00:09,  1.03s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall: 100%|#########9| 2991/3000 [1:23:49<00:09,  1.03s/it, lr: 1.0e-04 loss: 4.203e-01]
a-cold-wall: 100%|#########9| 2991/3000 [1:23:50<00:09,  1.03s/it, lr: 1.0e-04 loss: 4.091e-01]
a-cold-wall: 100%|#########9| 2991/3000 [1:23:50<00:09,  1.03s/it, lr: 1.0e-04 loss: 4.091e-01]
a-cold-wall: 100%|#########9| 2992/3000 [1:23:50<00:09,  1.14s/it, lr: 1.0e-04 loss: 4.091e-01]
a-cold-wall: 100%|#########9| 2992/3000 [1:23:50<00:09,  1.14s/it, lr: 1.0e-04 loss: 4.091e-01]
a-cold-wall: 100%|#########9| 2992/3000 [1:23:51<00:09,  1.14s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall: 100%|#########9| 2992/3000 [1:23:51<00:09,  1.14s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall: 100%|#########9| 2993/3000 [1:23:51<00:08,  1.22s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall: 100%|#########9| 2993/3000 [1:23:51<00:08,  1.22s/it, lr: 1.0e-04 loss: 4.694e-01]
a-cold-wall: 100%|#########9| 2993/3000 [1:23:52<00:08,  1.22s/it, lr: 1.0e-04 loss: 3.129e-01]
a-cold-wall: 100%|#########9| 2993/3000 [1:23:52<00:08,  1.22s/it, lr: 1.0e-04 loss: 3.129e-01]
a-cold-wall: 100%|#########9| 2994/3000 [1:23:52<00:06,  1.09s/it, lr: 1.0e-04 loss: 3.129e-01]
a-cold-wall: 100%|#########9| 2994/3000 [1:23:52<00:06,  1.09s/it, lr: 1.0e-04 loss: 3.129e-01]
a-cold-wall: 100%|#########9| 2994/3000 [1:23:53<00:06,  1.09s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall: 100%|#########9| 2994/3000 [1:23:53<00:06,  1.09s/it, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall: 100%|#########9| 2995/3000 [1:23:53<00:04,  1.01it/s, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall: 100%|#########9| 2995/3000 [1:23:53<00:04,  1.01it/s, lr: 1.0e-04 loss: 3.339e-01]
a-cold-wall: 100%|#########9| 2995/3000 [1:23:56<00:04,  1.01it/s, lr: 1.0e-04 loss: 3.141e-01]
a-cold-wall: 100%|#########9| 2995/3000 [1:23:56<00:04,  1.01it/s, lr: 1.0e-04 loss: 3.141e-01]
a-cold-wall: 100%|#########9| 2996/3000 [1:23:56<00:06,  1.54s/it, lr: 1.0e-04 loss: 3.141e-01]
a-cold-wall: 100%|#########9| 2996/3000 [1:23:56<00:06,  1.54s/it, lr: 1.0e-04 loss: 3.141e-01]
a-cold-wall: 100%|#########9| 2996/3000 [1:23:57<00:06,  1.54s/it, lr: 1.0e-04 loss: 5.900e-01]
a-cold-wall: 100%|#########9| 2996/3000 [1:23:57<00:06,  1.54s/it, lr: 1.0e-04 loss: 5.900e-01]
a-cold-wall: 100%|#########9| 2997/3000 [1:23:57<00:03,  1.31s/it, lr: 1.0e-04 loss: 5.900e-01]
a-cold-wall: 100%|#########9| 2997/3000 [1:23:57<00:03,  1.31s/it, lr: 1.0e-04 loss: 5.900e-01]
a-cold-wall: 100%|#########9| 2997/3000 [1:23:58<00:03,  1.31s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall: 100%|#########9| 2997/3000 [1:23:58<00:03,  1.31s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall: 100%|#########9| 2998/3000 [1:23:58<00:02,  1.39s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall: 100%|#########9| 2998/3000 [1:23:58<00:02,  1.39s/it, lr: 1.0e-04 loss: 4.547e-01]
a-cold-wall: 100%|#########9| 2998/3000 [1:23:59<00:02,  1.39s/it, lr: 1.0e-04 loss: 5.349e-01]
a-cold-wall: 100%|#########9| 2998/3000 [1:23:59<00:02,  1.39s/it, lr: 1.0e-04 loss: 5.349e-01]
a-cold-wall: 100%|#########9| 2999/3000 [1:23:59<00:01,  1.20s/it, lr: 1.0e-04 loss: 5.349e-01]
a-cold-wall: 100%|#########9| 2999/3000 [1:23:59<00:01,  1.20s/it, lr: 1.0e-04 loss: 5.349e-01]
a-cold-wall: 100%|#########9| 2999/3000 [1:23:59<00:01,  1.68s/it, lr: 1.0e-04 loss: 5.349e-01]
a-cold-wall: 100%|#########9| 2999/3000 [1:23:59<00:01,  1.68s/it, lr: 1.0e-04 loss: 5.349e-01]

Unloading assistant lora

Generating Images: 0it [00:00, ?it/s]
Generating Images: 0it [00:00, ?it/s]
                                     
                                     

Loading assistant lora

Saved checkpoint to /data/app/output/a-cold-wall/a-cold-wall.safetensors
Saved optimizer to /data/app/output/a-cold-wall/optimizer.pt